-- Logs begin at Thu 2022-06-16 13:58:46 UTC, end at Thu 2022-06-16 15:25:56 UTC. -- Jun 16 14:41:38.598709 dv-cinder-837165-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 16 14:41:38.609895 dv-cinder-837165-3-smb devstack@keystone.service[80164]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 16 14:41:38.611905 dv-cinder-837165-3-smb devstack@keystone.service[80164]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 14:41:38 2022] *** Jun 16 14:41:38.611905 dv-cinder-837165-3-smb devstack@keystone.service[80164]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 14:41:38.611905 dv-cinder-837165-3-smb devstack@keystone.service[80164]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 14:41:38.611905 dv-cinder-837165-3-smb devstack@keystone.service[80164]: nodename: dv-cinder-837165-3-smb Jun 16 14:41:38.611905 dv-cinder-837165-3-smb devstack@keystone.service[80164]: machine: x86_64 Jun 16 14:41:38.611905 dv-cinder-837165-3-smb devstack@keystone.service[80164]: clock source: unix Jun 16 14:41:38.611905 dv-cinder-837165-3-smb devstack@keystone.service[80164]: pcre jit disabled Jun 16 14:41:38.611905 dv-cinder-837165-3-smb devstack@keystone.service[80164]: detected number of CPU cores: 4 Jun 16 14:41:38.611905 dv-cinder-837165-3-smb devstack@keystone.service[80164]: current working directory: / Jun 16 14:41:38.611905 dv-cinder-837165-3-smb devstack@keystone.service[80164]: detected binary path: /usr/bin/uwsgi-core Jun 16 14:41:38.611905 dv-cinder-837165-3-smb devstack@keystone.service[80164]: your processes number limit is 47680 Jun 16 14:41:38.611905 dv-cinder-837165-3-smb devstack@keystone.service[80164]: your memory page size is 4096 bytes Jun 16 14:41:38.611905 dv-cinder-837165-3-smb devstack@keystone.service[80164]: detected max file descriptor number: 2048 Jun 16 14:41:38.611905 dv-cinder-837165-3-smb devstack@keystone.service[80164]: lock engine: pthread robust mutexes Jun 16 14:41:38.612643 dv-cinder-837165-3-smb devstack@keystone.service[80164]: thunder lock: enabled Jun 16 14:41:38.612643 dv-cinder-837165-3-smb devstack@keystone.service[80164]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 16 14:41:38.612643 dv-cinder-837165-3-smb devstack@keystone.service[80164]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 14:41:38.656443 dv-cinder-837165-3-smb devstack@keystone.service[80164]: Python main interpreter initialized at 0x55e53cc969c0 Jun 16 14:41:38.656443 dv-cinder-837165-3-smb devstack@keystone.service[80164]: python threads support enabled Jun 16 14:41:38.656443 dv-cinder-837165-3-smb devstack@keystone.service[80164]: your server socket listen backlog is limited to 100 connections Jun 16 14:41:38.656443 dv-cinder-837165-3-smb devstack@keystone.service[80164]: your mercy for graceful operations on workers is 90 seconds Jun 16 14:41:38.656981 dv-cinder-837165-3-smb devstack@keystone.service[80164]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 14:41:38.656981 dv-cinder-837165-3-smb devstack@keystone.service[80164]: *** Operational MODE: preforking *** Jun 16 14:41:38.663646 dv-cinder-837165-3-smb devstack@keystone.service[80164]: *** uWSGI is running in multiple interpreter mode *** Jun 16 14:41:38.663646 dv-cinder-837165-3-smb devstack@keystone.service[80164]: spawned uWSGI master process (pid: 80164) Jun 16 14:41:38.663646 dv-cinder-837165-3-smb devstack@keystone.service[80164]: spawned uWSGI worker 1 (pid: 80175, cores: 1) Jun 16 14:41:38.663646 dv-cinder-837165-3-smb devstack@keystone.service[80164]: spawned uWSGI worker 2 (pid: 80176, cores: 1) Jun 16 14:41:38.663646 dv-cinder-837165-3-smb devstack@keystone.service[80164]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 14:41:38.657364 dv-cinder-837165-3-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 16 14:41:44.312291 dv-cinder-837165-3-smb devstack@keystone.service[80176]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 14:41:44.312291 dv-cinder-837165-3-smb devstack@keystone.service[80176]: from cryptography.utils import int_from_bytes Jun 16 14:41:44.313113 dv-cinder-837165-3-smb devstack@keystone.service[80176]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 14:41:44.313113 dv-cinder-837165-3-smb devstack@keystone.service[80176]: from cryptography.utils import int_from_bytes Jun 16 14:41:44.314833 dv-cinder-837165-3-smb devstack@keystone.service[80175]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 14:41:44.314833 dv-cinder-837165-3-smb devstack@keystone.service[80175]: from cryptography.utils import int_from_bytes Jun 16 14:41:44.315292 dv-cinder-837165-3-smb devstack@keystone.service[80175]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 14:41:44.315292 dv-cinder-837165-3-smb devstack@keystone.service[80175]: from cryptography.utils import int_from_bytes Jun 16 14:41:44.363053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 14:41:44.363983 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 14:41:44.364170 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 14:41:44.364395 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] command line args: [] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 14:41:44.364679 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 14:41:44.364810 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 14:41:44.364893 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ================================================================================ {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 14:41:44.364961 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] command line args: [] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 14:41:44.365089 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] admin_token = **** {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.365174 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 14:41:44.365310 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ================================================================================ {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 14:41:44.365388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] config_dir = [] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.365497 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.365572 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] admin_token = **** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.365679 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] config_source = [] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.365808 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] config_dir = [] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.365904 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] debug = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.366010 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.366102 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.366298 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] config_source = [] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.366367 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] debug = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.366433 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.366571 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.366697 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.366799 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.366902 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.367003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.367104 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.367210 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.367306 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] list_limit = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.367471 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] log_config_append = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.367640 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.367754 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.367861 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] list_limit = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.368042 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] log_dir = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.368200 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] log_config_append = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.368200 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.368526 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] log_file = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.368650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] log_dir = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.368731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.368797 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] log_file = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.368911 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.368991 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.369111 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.369190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.369381 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.369546 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.369676 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.369877 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.370038 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.370233 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.370233 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.370470 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.370578 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.370578 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.370891 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.371151 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.371261 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.371415 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.371520 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.371638 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.371808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.371808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.372081 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.372183 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.372342 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.372459 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.372621 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.372725 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.372828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.372987 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.85/identity {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.373104 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.85/identity {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.373207 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] publish_errors = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.373307 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] publish_errors = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.373420 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.373528 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.373680 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.373784 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.373891 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.373992 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.374100 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.374225 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.374326 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.374427 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.374534 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] standard_threads = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.374698 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] standard_threads = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.374808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.374907 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.375005 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.375103 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.375204 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.375311 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.375412 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] use_journal = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.375509 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] use_journal = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.375606 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] use_json = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.375711 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] use_json = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.375809 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] use_stderr = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.375946 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] use_stderr = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.376057 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] use_syslog = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.376165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] use_syslog = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.376271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.376377 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:41:44.376477 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.376588 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.376688 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.376786 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.376892 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.376999 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.377110 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.377216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.377323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.377423 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.377529 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.377629 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.377859 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.377966 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.378067 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.378166 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.378265 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.378364 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.378473 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.378573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.378675 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.378782 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.378891 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.378992 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.379103 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.379216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.379329 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.379437 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.379551 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.379661 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.379863 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.380089 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.380195 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.380295 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.380400 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.380513 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.380624 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.380624 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.380816 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.380922 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.381023 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.381131 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.381242 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.381352 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.381455 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.381555 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.381662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.381762 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.381873 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.381982 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.382099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.382192 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.382284 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.382375 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.382476 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.382569 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.382660 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.382757 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.382850 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.382941 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.383041 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.383135 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.383225 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.383315 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.383406 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.383505 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.383605 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.383704 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.383796 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.383953 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.384049 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.384156 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.384261 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.384373 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.384486 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.384605 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.384734 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.384977 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.385108 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.385232 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.385353 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.385458 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.385531 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.385607 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.385677 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.385677 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.385799 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.385907 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.385994 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.386147 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.386231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.386426 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.386506 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.386660 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.386827 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.386976 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.387108 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.387225 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.387300 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.387427 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.387501 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.387621 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.387752 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.387832 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.388008 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.388080 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.388231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.388319 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.388473 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.388578 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.388712 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.388816 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.388949 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.389060 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.389185 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.389303 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.389401 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.389493 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.389669 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.389811 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.389911 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.390025 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.390106 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.390217 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.390336 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.390468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.390596 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.390722 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.390832 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.390913 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.391063 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.391151 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.391299 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.391425 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.391536 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.391621 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.391803 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.391901 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.392064 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.392157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.392313 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.392401 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.392559 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.392640 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.392797 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.392888 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.393034 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.393147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.393275 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.393385 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.393536 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.393696 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.393793 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.393852 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.393996 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.394107 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.394265 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.394343 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.394466 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.394547 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.394705 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.394785 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.395007 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.395139 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.395209 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.395277 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.395401 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.395482 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.395666 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.395749 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.395926 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.396022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.396169 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.396256 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.396401 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.396474 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.396636 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.396759 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.396872 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.396992 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.397096 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.397221 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.397323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.397458 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.397538 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.397692 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.397774 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.397925 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.398017 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.398159 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.398258 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.398393 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.398481 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.398625 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.398715 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.398868 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.398955 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.399107 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.399215 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.399358 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.399488 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.399600 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.399707 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.399843 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.399995 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.400130 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.400224 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.400374 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.400462 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] auth.external = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.400606 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] auth.external = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.400689 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.400839 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.401131 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.401251 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.401363 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.401446 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.401593 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] auth.password = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.401676 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] auth.password = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.401826 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] auth.token = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.401937 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] auth.token = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.402257 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.402509 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.402763 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.402899 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.402981 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.403061 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.403236 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.403520 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.403737 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.403939 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.404121 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] credential.caching = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.404228 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.404303 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.404373 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.404490 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.404618 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.404747 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.404858 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.404986 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.405098 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] credential.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.405233 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.405349 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.405470 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.405601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.405738 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.405850 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.405993 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.406075 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.406231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.406324 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.406485 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.406567 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.406773 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.406854 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.407021 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.407109 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.407270 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.407351 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.407513 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.407599 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.407770 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.407860 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.408030 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] federation.caching = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.408113 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.408269 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.408361 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.408515 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.408605 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.408761 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.408843 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.408991 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.409072 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] federation.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.409238 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.409329 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.409476 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.409566 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.409723 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.409804 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.409955 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.410045 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.410203 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.410285 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.410441 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.410521 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.410689 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.410816 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.410925 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.411014 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.caching = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.411174 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.411254 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.411412 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.411571 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.411645 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.411715 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.411971 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.412066 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.412138 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.412206 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.412390 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.412495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.412621 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.412739 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.412876 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.413059 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.413218 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.413372 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.413448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.413614 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.413738 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.413858 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.413858 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.414105 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.414230 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.414309 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.414478 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.414651 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.414651 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.414926 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.415083 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.415228 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.415366 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.415524 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.415647 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.415769 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.415769 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.416035 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.416168 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.416290 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.416410 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.416546 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.416629 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.416738 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.416846 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.416973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.417105 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.417225 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.417306 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.417396 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.417628 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.417715 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.417814 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.418009 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.418209 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.418355 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.418355 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.418658 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.418800 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.418882 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.418942 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.419033 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.419269 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.419426 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.419507 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.419569 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.419721 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.419906 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.420011 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.420100 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.420223 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.420307 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.420419 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.420537 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.420680 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.420810 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.420889 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.420949 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.421006 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.421139 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.421228 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.421348 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.421409 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.421466 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.421524 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.421631 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.421941 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.422165 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.422259 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.422370 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.422456 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.422523 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.422627 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.422692 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.422772 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.422863 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.422953 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.422953 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.423083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.423178 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.423366 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.423441 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.423606 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.423676 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.423851 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.424304 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.424471 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.424541 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.424714 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.424784 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.424966 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.425042 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.425197 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.425273 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.425448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.425528 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.425684 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.425754 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.425916 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.425988 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.426152 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.426234 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.426386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.426457 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.426619 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.426689 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.426849 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.426932 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.427086 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.427156 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.427317 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.427388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.427562 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.427639 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.427847 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.428355 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.428793 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.428910 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.429031 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.429161 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.429282 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.429401 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.429518 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.429636 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.429753 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.429889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.430009 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.430128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.430245 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.430363 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.430479 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.430606 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.430724 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.430844 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.430964 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.431084 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.431166 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.431290 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.431370 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.431495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.431574 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.431687 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.431764 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.431943 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.432023 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.432178 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.432282 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.432345 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.432402 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.432473 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.432535 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.432535 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.432639 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.432840 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.432962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.433052 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.433227 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.433350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.433489 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] resource.caching = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.433738 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] resource.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.433931 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.434138 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.434138 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.434347 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.434428 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.434542 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.434670 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.434800 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.434918 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.435036 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.435153 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.435270 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.435393 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.435599 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.435724 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.435902 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.436096 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.436278 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.436469 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] role.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.436680 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] role.caching = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.436893 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] role.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.437075 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] role.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.437260 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.437440 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.437626 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.437824 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.438005 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.438191 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.438378 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.438556 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.438745 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.438943 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.439124 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.439327 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.439509 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.439691 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.440007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.440200 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.440386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.440565 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.440750 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.440932 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.441133 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.441321 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.441503 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.441693 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.441881 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.442076 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.442276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.442462 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.442640 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.442829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.443010 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.443191 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.443390 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.443573 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.443755 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.443964 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.444148 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.444331 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.444549 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.444734 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.444923 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.445109 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.445287 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.445468 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.445665 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.445862 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.446096 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.446281 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.446484 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.446667 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.446849 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.447027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.447196 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.447365 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.447478 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.447644 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.447910 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.448098 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.448235 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.448410 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.448545 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.448678 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.448826 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.448907 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.449000 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.449228 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.449390 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] token.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.449546 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] token.caching = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.449668 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.449752 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.449823 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.449894 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.450024 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.450155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.450275 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.450393 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.450511 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.450634 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.450713 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.450889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.451034 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.451188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.451268 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.451338 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.451407 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.451486 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.451557 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.451627 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.451696 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.451765 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.451834 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.451988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.452063 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.452171 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.452248 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.452353 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.452430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.452508 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.452580 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.452639 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.452697 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.452697 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] database.connection = **** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.452920 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.452996 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.453062 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] database.connection = **** {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.453213 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.453330 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.453440 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.453536 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.453616 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.453731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.453806 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.453906 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.453990 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.454097 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.454174 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.454244 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.454308 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.454434 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.454565 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.454669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.454791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.454871 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.454937 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.455077 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.455189 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.455265 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.455381 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.455505 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.455634 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.455737 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.455737 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.455986 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.456116 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.456214 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.456347 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.456482 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.456576 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.456694 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.456810 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:41:44.456906 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 14:41:44.457032 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 14:41:44.577024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.577245 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.577468 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.579337 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.579571 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.579795 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.586145 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.588391 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.615894 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.616291 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.617936 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.618208 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.673133 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.673427 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.722842 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.723173 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.723266 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.723398 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.791953 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.792244 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.792410 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.792679 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.792773 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.792985 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.793113 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.793113 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.793362 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.793487 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.793611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.793735 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.818190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.818440 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.818582 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.818713 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.818859 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.818990 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.819133 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.819263 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.819389 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.819513 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.819636 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.819770 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.819911 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.820034 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.831215 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.835695 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.844174 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.844417 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.844599 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.844842 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.845104 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.845276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.845428 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.847656 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.847842 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.848125 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.848322 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.848553 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.848763 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.848977 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:41:44.863026 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.863204 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 14:41:44.863384 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.863552 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.863648 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 14:41:44.863755 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 14:41:44.863916 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.864151 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.864298 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 14:41:44.864384 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.864459 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.864636 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.864719 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.864939 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.865035 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.865111 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.876024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.876295 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.876496 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.876664 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.876750 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.876858 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.877031 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.877305 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.885183 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:41:44.885869 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:41:44.888632 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:41:44.888848 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.889124 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.889269 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:41:44.889386 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.889507 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.889665 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.889782 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.889925 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.890053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.890191 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.890306 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.890459 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.890573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.890725 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.890838 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.890998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.891093 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.891258 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.891390 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.891566 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.891834 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.917824 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.918945 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.919454 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:41:44.919754 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.920623 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:41:44.920904 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.925351 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:41:44.925765 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.926039 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.926550 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:41:44.926830 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.927108 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.933300 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:41:44.933776 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.934731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:41:44.935020 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.938268 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:41:44.938680 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.938887 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.939159 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.939452 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.939644 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:41:44.939746 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.939955 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.940068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.940240 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.940344 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.940523 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.940808 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.941118 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.941427 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.941700 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.959047 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.959342 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.960887 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.961181 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.964007 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:41:44.966030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:41:44.968121 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.968525 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.969705 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.969998 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.973502 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:41:44.975150 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:41:44.977108 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:41:44.978760 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:41:44.981042 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.981371 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.981570 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.981844 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.982133 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.982394 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.982606 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.982913 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.983161 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.983442 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.983717 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:44.984018 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.001315 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:41:45.001596 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.001861 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.002133 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.003196 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:41:45.003482 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.003749 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.004050 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.009939 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.011866 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.012039 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.012312 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.013681 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.013959 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.016822 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:41:45.017114 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.017376 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.017648 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.017930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.018637 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:41:45.018923 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.019213 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.019504 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.019777 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.031645 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:41:45.031951 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.032237 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.032516 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.032890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.033164 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.033437 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.033526 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:41:45.033722 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.034004 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.034281 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.034564 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.034838 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.035136 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.051855 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:41:45.053966 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:41:45.055120 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:41:45.057281 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:41:45.058475 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.060343 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.061169 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.061983 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:41:45.062255 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.062532 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.063198 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.065110 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:41:45.065388 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.065668 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.069792 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.071353 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:41:45.072947 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.074787 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.074927 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:41:45.075069 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.075316 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.075585 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.078180 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.078475 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.078760 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.079033 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.084705 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:41:45.084972 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.085291 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.088545 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:41:45.088859 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.089137 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.093734 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:41:45.094011 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.094285 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.094622 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.094839 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.095225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.095508 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.095789 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.096087 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.096354 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.096620 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.096881 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.097147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.097409 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.097522 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:41:45.097773 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.098056 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.098324 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.098601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.098876 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.099156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.099535 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.099813 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.100111 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.100383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.100653 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.100919 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.101188 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:41:45.134968 dv-cinder-837165-3-smb devstack@keystone.service[80176]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55e53cc969c0 pid: 80176 (default app) Jun 16 14:41:45.138827 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2c69e-e5cd-4e71-a0e3-21f3940aab82 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:45.138965 dv-cinder-837165-3-smb devstack@keystone.service[80175]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55e53cc969c0 pid: 80175 (default app) Jun 16 14:41:45.139120 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2c69e-e5cd-4e71-a0e3-21f3940aab82 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:45.139394 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2c69e-e5cd-4e71-a0e3-21f3940aab82 None None] PATH_INFO: `/v3` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:45.143658 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1/1] 10.222.0.85 () {50 vars in 791 bytes} [Thu Jun 16 14:41:45 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:53.254027 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c440eb-fe40-427c-849d-bac681303c6f None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:53.254640 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c440eb-fe40-427c-849d-bac681303c6f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:53.254640 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c440eb-fe40-427c-849d-bac681303c6f None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:53.258921 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1/2] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:41:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:41:53.264616 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19113d4-5813-40b7-883c-e58f26e85f2f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:53.265091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19113d4-5813-40b7-883c-e58f26e85f2f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:53.265188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19113d4-5813-40b7-883c-e58f26e85f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:53.335295 dv-cinder-837165-3-smb devstack@keystone.service[80176]: INFO dbcounter [None req-f19113d4-5813-40b7-883c-e58f26e85f2f None None] Registered counter for database keystone Jun 16 14:41:53.357365 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG oslo_db.sqlalchemy.engines [None req-f19113d4-5813-40b7-883c-e58f26e85f2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80176) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:41:53.364966 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writer thread running {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:41:53.552429 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG passlib.handlers.bcrypt [None req-f19113d4-5813-40b7-883c-e58f26e85f2f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80176) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 16 14:41:53.552778 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG passlib.handlers.bcrypt [None req-f19113d4-5813-40b7-883c-e58f26e85f2f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80176) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 16 14:41:53.617312 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-f19113d4-5813-40b7-883c-e58f26e85f2f None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:53.618958 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f19113d4-5813-40b7-883c-e58f26e85f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:53.750473 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 2/3] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 487 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 16 14:41:53.923658 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c440eb-fe40-427c-849d-bac681303c6f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:53.997356 dv-cinder-837165-3-smb devstack@keystone.service[80175]: INFO dbcounter [None req-41c440eb-fe40-427c-849d-bac681303c6f None None] Registered counter for database keystone Jun 16 14:41:54.017410 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG oslo_db.sqlalchemy.engines [None req-41c440eb-fe40-427c-849d-bac681303c6f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80175) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:41:54.024589 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writer thread running {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:41:54.147544 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c440eb-fe40-427c-849d-bac681303c6f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:54.153956 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209059c9-d122-4234-b3cc-e2cb93ced2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:54.154631 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209059c9-d122-4234-b3cc-e2cb93ced2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:54.154915 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209059c9-d122-4234-b3cc-e2cb93ced2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:54.155189 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209059c9-d122-4234-b3cc-e2cb93ced2c4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:54.164738 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209059c9-d122-4234-b3cc-e2cb93ced2c4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:54.218780 dv-cinder-837165-3-smb devstack@keystone.service[80175]: WARNING keystone.common.rbac_enforcer.enforcer [None req-209059c9-d122-4234-b3cc-e2cb93ced2c4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 16 14:41:54.219038 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209059c9-d122-4234-b3cc-e2cb93ced2c4 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:54.229985 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 2/4] 10.222.0.85 () {58 vars in 1324 bytes} [Thu Jun 16 14:41:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 14:41:54.236758 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19113d4-5813-40b7-883c-e58f26e85f2f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:54.254991 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19113d4-5813-40b7-883c-e58f26e85f2f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:54.260624 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1e4a3-1adb-47ca-822e-8e6dee42967b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:54.261990 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1e4a3-1adb-47ca-822e-8e6dee42967b admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:54.262623 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1e4a3-1adb-47ca-822e-8e6dee42967b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:54.262905 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1e4a3-1adb-47ca-822e-8e6dee42967b admin admin] PATH_INFO: `/v3/projects/d8f4fd10bac54b6ca305e8af48785eb7` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:54.264902 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1e4a3-1adb-47ca-822e-8e6dee42967b admin admin] RBAC: Authorizing `identity:get_project(project_id=d8f4fd10bac54b6ca305e8af48785eb7)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:54.325224 dv-cinder-837165-3-smb devstack@keystone.service[80176]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3ec1e4a3-1adb-47ca-822e-8e6dee42967b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 16 14:41:54.325568 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1e4a3-1adb-47ca-822e-8e6dee42967b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:54.330430 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 3/5] 10.222.0.85 () {56 vars in 1207 bytes} [Thu Jun 16 14:41:54 2022] GET /identity/v3/projects/d8f4fd10bac54b6ca305e8af48785eb7 => generated 344 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:56.476542 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6ed48-8c12-48f8-9eaa-a6ece1cfc9bd None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:56.477144 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6ed48-8c12-48f8-9eaa-a6ece1cfc9bd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:56.477144 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6ed48-8c12-48f8-9eaa-a6ece1cfc9bd None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:56.481331 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 3/6] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:41:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:56.487077 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59b60b-7d01-400a-852d-e2dd6c746d66 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:56.487523 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59b60b-7d01-400a-852d-e2dd6c746d66 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:56.487619 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59b60b-7d01-400a-852d-e2dd6c746d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:56.508298 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-7b59b60b-7d01-400a-852d-e2dd6c746d66 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:56.509882 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7b59b60b-7d01-400a-852d-e2dd6c746d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:56.519767 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 4/7] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 16 14:41:56.543486 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6ed48-8c12-48f8-9eaa-a6ece1cfc9bd None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:56.557384 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6ed48-8c12-48f8-9eaa-a6ece1cfc9bd None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:56.562207 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ffe76f-faa5-4b35-9036-239c72f3121d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:56.562866 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffe76f-faa5-4b35-9036-239c72f3121d admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:56.563498 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffe76f-faa5-4b35-9036-239c72f3121d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:56.563498 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffe76f-faa5-4b35-9036-239c72f3121d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:56.571890 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ffe76f-faa5-4b35-9036-239c72f3121d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:56.573749 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ffe76f-faa5-4b35-9036-239c72f3121d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:56.582868 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 4/8] 10.222.0.85 () {58 vars in 1324 bytes} [Thu Jun 16 14:41:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 14:41:56.588721 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59b60b-7d01-400a-852d-e2dd6c746d66 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:56.598642 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59b60b-7d01-400a-852d-e2dd6c746d66 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:56.604242 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2783a-6c29-44e6-8a0e-92608cca6028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:56.605295 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2783a-6c29-44e6-8a0e-92608cca6028 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:56.605695 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2783a-6c29-44e6-8a0e-92608cca6028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:56.606197 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2783a-6c29-44e6-8a0e-92608cca6028 admin admin] PATH_INFO: `/v3/users/d15ddf8d03bc44188d865237c74fbf2f` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:56.609098 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2783a-6c29-44e6-8a0e-92608cca6028 admin admin] RBAC: Authorizing `identity:get_user(user_id=d15ddf8d03bc44188d865237c74fbf2f)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:56.609614 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2783a-6c29-44e6-8a0e-92608cca6028 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:56.611242 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 5/9] 10.222.0.85 () {56 vars in 1198 bytes} [Thu Jun 16 14:41:56 2022] GET /identity/v3/users/d15ddf8d03bc44188d865237c74fbf2f => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:41:58.800279 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c8f44-2ded-412d-af46-1cce376eafd0 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:58.800819 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c8f44-2ded-412d-af46-1cce376eafd0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:58.800819 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c8f44-2ded-412d-af46-1cce376eafd0 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:58.802190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 5/10] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:41:58.807588 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d461c-9592-49b6-ac4d-57ad384bab2b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:58.808028 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d461c-9592-49b6-ac4d-57ad384bab2b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:58.808287 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d461c-9592-49b6-ac4d-57ad384bab2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:58.826391 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-001d461c-9592-49b6-ac4d-57ad384bab2b None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:58.827515 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-001d461c-9592-49b6-ac4d-57ad384bab2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:58.834034 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f4682-5b1f-4441-aa7e-53da0c3b052a None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:58.834325 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f4682-5b1f-4441-aa7e-53da0c3b052a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:58.834605 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f4682-5b1f-4441-aa7e-53da0c3b052a None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:58.836012 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 6/11] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:41:58.841626 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ec7b1-2593-40ea-b93e-c2e1ada5c65b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:58.841948 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ec7b1-2593-40ea-b93e-c2e1ada5c65b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:58.842202 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ec7b1-2593-40ea-b93e-c2e1ada5c65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:58.882253 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG passlib.handlers.bcrypt [None req-8d9ec7b1-2593-40ea-b93e-c2e1ada5c65b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80175) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 16 14:41:58.882666 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG passlib.handlers.bcrypt [None req-8d9ec7b1-2593-40ea-b93e-c2e1ada5c65b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80175) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 16 14:41:58.914871 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 6/12] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:58.928454 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-8d9ec7b1-2593-40ea-b93e-c2e1ada5c65b None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:41:58.930047 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8d9ec7b1-2593-40ea-b93e-c2e1ada5c65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:41:58.939588 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d461c-9592-49b6-ac4d-57ad384bab2b None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:58.965313 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:59.033225 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 7/13] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:41:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:41:59.049645 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d461c-9592-49b6-ac4d-57ad384bab2b None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:59.056098 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ec7b1-2593-40ea-b93e-c2e1ada5c65b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:59.084635 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989bc3d7-f4d7-4a85-bddc-9d33d0ad3501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:59.085371 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bc3d7-f4d7-4a85-bddc-9d33d0ad3501 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:59.085643 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bc3d7-f4d7-4a85-bddc-9d33d0ad3501 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:59.085906 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bc3d7-f4d7-4a85-bddc-9d33d0ad3501 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:59.098743 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989bc3d7-f4d7-4a85-bddc-9d33d0ad3501 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:41:59.110486 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-989bc3d7-f4d7-4a85-bddc-9d33d0ad3501 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:41:59.110486 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:59.110486 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:59.110486 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:59.110486 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:59.110486 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:59.110486 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:59.110486 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:59.110486 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:59.110486 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:59.110486 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:59.110486 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:59.110486 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:41:59.110486 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:41:59.110486 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:41:59.110486 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:41:59.111401 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:41:59.111401 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:41:59.111401 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:41:59.111401 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:41:59.111401 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:59.111401 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:59.111401 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:59.111401 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:59.111401 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:59.111401 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:59.111401 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:59.111401 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:59.111401 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:59.111401 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:59.111401 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:59.111401 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:59.112249 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:59.112249 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:59.112249 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:59.112249 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:59.112249 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:41:59.112249 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:41:59.112249 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:41:59.112249 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:41:59.112249 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:41:59.112249 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:41:59.112249 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:41:59.112249 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:41:59.112249 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 7/14] 10.222.0.85 () {56 vars in 1096 bytes} [Thu Jun 16 14:41:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:41:59.118117 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989bc3d7-f4d7-4a85-bddc-9d33d0ad3501 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:59.166337 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ec7b1-2593-40ea-b93e-c2e1ada5c65b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:59.168860 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:59.204629 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:59.208165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a340fc3-ebc2-4076-8cb2-ffc1f1c97bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:59.209099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a340fc3-ebc2-4076-8cb2-ffc1f1c97bea None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:59.209388 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a340fc3-ebc2-4076-8cb2-ffc1f1c97bea None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:59.209675 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a340fc3-ebc2-4076-8cb2-ffc1f1c97bea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:59.225146 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989bc3d7-f4d7-4a85-bddc-9d33d0ad3501 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:59.260657 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82e5ae-ac94-4e23-b72d-bdfc2c4f138d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:59.261964 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82e5ae-ac94-4e23-b72d-bdfc2c4f138d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:59.262252 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82e5ae-ac94-4e23-b72d-bdfc2c4f138d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:59.262530 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82e5ae-ac94-4e23-b72d-bdfc2c4f138d None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:59.263282 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82e5ae-ac94-4e23-b72d-bdfc2c4f138d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:59.263588 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82e5ae-ac94-4e23-b72d-bdfc2c4f138d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:59.265031 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82e5ae-ac94-4e23-b72d-bdfc2c4f138d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:59.277599 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 8/15] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:41:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:59.279998 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a340fc3-ebc2-4076-8cb2-ffc1f1c97bea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:59.281658 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a340fc3-ebc2-4076-8cb2-ffc1f1c97bea None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:59.283066 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82e5ae-ac94-4e23-b72d-bdfc2c4f138d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:59.383998 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 8/16] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:41:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:59.386886 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82e5ae-ac94-4e23-b72d-bdfc2c4f138d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:59.390104 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a340fc3-ebc2-4076-8cb2-ffc1f1c97bea None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:59.392972 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:59.422592 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540dbe03-5c45-4d55-bda4-22f746b66956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:59.423523 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dbe03-5c45-4d55-bda4-22f746b66956 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:59.424192 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dbe03-5c45-4d55-bda4-22f746b66956 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:59.424471 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dbe03-5c45-4d55-bda4-22f746b66956 None admin] PATH_INFO: `/v3/users/d15ddf8d03bc44188d865237c74fbf2f` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:59.425796 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540dbe03-5c45-4d55-bda4-22f746b66956 None admin] RBAC: Authorizing `identity:get_user(user_id=d15ddf8d03bc44188d865237c74fbf2f)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:59.427291 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540dbe03-5c45-4d55-bda4-22f746b66956 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:59.428986 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 9/17] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:41:59 2022] GET /identity/v3/users/d15ddf8d03bc44188d865237c74fbf2f => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:59.435249 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540dbe03-5c45-4d55-bda4-22f746b66956 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:59.451118 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:59.499727 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a340fc3-ebc2-4076-8cb2-ffc1f1c97bea None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:59.537801 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be35d60-6094-4b92-a0bb-e036dace8bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:59.538605 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be35d60-6094-4b92-a0bb-e036dace8bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:59.538890 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be35d60-6094-4b92-a0bb-e036dace8bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:59.539171 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be35d60-6094-4b92-a0bb-e036dace8bd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:59.546739 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540dbe03-5c45-4d55-bda4-22f746b66956 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:59.558479 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be35d60-6094-4b92-a0bb-e036dace8bd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:59.560046 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be35d60-6094-4b92-a0bb-e036dace8bd9 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:59.581842 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-5be35d60-6094-4b92-a0bb-e036dace8bd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:59.581842 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:41:59.581842 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:41:59.581842 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:41:59.581842 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:41:59.581842 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:41:59.581842 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:41:59.581842 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:41:59.581842 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:41:59.581842 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:41:59.581842 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:41:59.581842 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:41:59.581842 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:41:59.581842 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:41:59.581842 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:41:59.582919 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:41:59.582919 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:41:59.582919 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:41:59.582919 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:41:59.582919 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:41:59.582919 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:41:59.582919 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:41:59.582919 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:41:59.582919 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:41:59.582919 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:41:59.582919 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:41:59.582919 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:41:59.582919 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:41:59.582919 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:41:59.582919 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:41:59.582919 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:41:59.582919 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:41:59.583959 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:41:59.583959 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:41:59.583959 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:41:59.583959 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:41:59.584441 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 9/18] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:41:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:41:59.588033 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f721cdc-b9a3-4c96-9ce9-9dd15ddf5b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:59.588893 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f721cdc-b9a3-4c96-9ce9-9dd15ddf5b7e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:59.589224 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f721cdc-b9a3-4c96-9ce9-9dd15ddf5b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:59.589496 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f721cdc-b9a3-4c96-9ce9-9dd15ddf5b7e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:59.590339 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be35d60-6094-4b92-a0bb-e036dace8bd9 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:59.590789 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f721cdc-b9a3-4c96-9ce9-9dd15ddf5b7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:59.592331 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f721cdc-b9a3-4c96-9ce9-9dd15ddf5b7e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:59.594014 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 10/19] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:41:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:59.599647 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f721cdc-b9a3-4c96-9ce9-9dd15ddf5b7e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:41:59.648234 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:59.682411 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:59.692580 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be35d60-6094-4b92-a0bb-e036dace8bd9 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:59.703525 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f721cdc-b9a3-4c96-9ce9-9dd15ddf5b7e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:41:59.735070 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa938ac-9cfb-4b3a-9dc9-4657e523a7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:59.735744 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa938ac-9cfb-4b3a-9dc9-4657e523a7ae None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:59.736061 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa938ac-9cfb-4b3a-9dc9-4657e523a7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:59.736342 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa938ac-9cfb-4b3a-9dc9-4657e523a7ae None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:59.737072 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa938ac-9cfb-4b3a-9dc9-4657e523a7ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:59.737381 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa938ac-9cfb-4b3a-9dc9-4657e523a7ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:59.738793 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa938ac-9cfb-4b3a-9dc9-4657e523a7ae None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:59.742302 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bcc243-d793-41d3-9e70-ee84acae12e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:41:59.742967 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcc243-d793-41d3-9e70-ee84acae12e6 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:41:59.743250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcc243-d793-41d3-9e70-ee84acae12e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:41:59.743523 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcc243-d793-41d3-9e70-ee84acae12e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:41:59.744397 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bcc243-d793-41d3-9e70-ee84acae12e6 None admin] RBAC: Adding query filter params (role.id=95dcfa6c726a4d01a41d2642554fd338, scope.domain.id=default, user.id=d15ddf8d03bc44188d865237c74fbf2f) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:41:59.744706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bcc243-d793-41d3-9e70-ee84acae12e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:41:59.746171 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bcc243-d793-41d3-9e70-ee84acae12e6 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:41:59.752981 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 11/20] 10.222.0.85 () {56 vars in 1322 bytes} [Thu Jun 16 14:41:59 2022] GET /identity/v3/role_assignments?user.id=d15ddf8d03bc44188d865237c74fbf2f&scope.domain.id=default&role.id=95dcfa6c726a4d01a41d2642554fd338 => generated 233 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:41:59.756571 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 10/21] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:02.078850 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ad84d-184e-4d89-9eb1-f79c72a8c537 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:02.079740 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ad84d-184e-4d89-9eb1-f79c72a8c537 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:02.080185 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ad84d-184e-4d89-9eb1-f79c72a8c537 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:02.081693 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 12/22] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:02.087230 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccc4b5-f2cd-4adc-b1dd-658311a20cf0 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:02.088061 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccc4b5-f2cd-4adc-b1dd-658311a20cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:02.088493 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccc4b5-f2cd-4adc-b1dd-658311a20cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:02.111629 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f2ccc4b5-f2cd-4adc-b1dd-658311a20cf0 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:02.113083 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f2ccc4b5-f2cd-4adc-b1dd-658311a20cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:02.203794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 11/23] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:02.234155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ad84d-184e-4d89-9eb1-f79c72a8c537 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:02.376664 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ad84d-184e-4d89-9eb1-f79c72a8c537 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:02.420056 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63472de-e768-4cd6-bb7c-8b02d55419c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:02.421162 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63472de-e768-4cd6-bb7c-8b02d55419c9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:02.421598 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63472de-e768-4cd6-bb7c-8b02d55419c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:02.422037 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63472de-e768-4cd6-bb7c-8b02d55419c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:02.440823 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63472de-e768-4cd6-bb7c-8b02d55419c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:02.448930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-c63472de-e768-4cd6-bb7c-8b02d55419c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:02.448930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:02.448930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:02.448930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:02.448930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:02.448930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:02.448930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:02.448930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:02.448930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:02.448930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:02.448930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:02.448930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:02.448930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:02.448930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:02.448930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:02.448930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:02.449857 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:02.449857 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:02.449857 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:02.449857 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:02.449857 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:02.449857 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:02.449857 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:02.449857 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:02.449857 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:02.449857 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:02.449857 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:02.449857 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:02.449857 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:02.449857 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:02.449857 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:02.449857 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:02.451091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:02.451091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:02.451091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:02.451091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:02.451091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:02.451091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:02.451091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:02.451091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:02.451091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:02.451091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:02.451091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:02.451091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:42:02.451091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 13/24] 10.222.0.85 () {56 vars in 1096 bytes} [Thu Jun 16 14:42:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:02.456517 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ccc4b5-f2cd-4adc-b1dd-658311a20cf0 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:02.490866 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ca9c3-611e-4b7a-8509-231a2acffa76 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:02.491208 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ca9c3-611e-4b7a-8509-231a2acffa76 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:02.491547 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ca9c3-611e-4b7a-8509-231a2acffa76 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:02.493661 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 14/25] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:02.505124 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05442d73-7168-4c35-827b-4f656b5e3caa None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:02.505743 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05442d73-7168-4c35-827b-4f656b5e3caa None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:02.506230 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05442d73-7168-4c35-827b-4f656b5e3caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:02.516892 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:02.522045 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:02.537739 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-05442d73-7168-4c35-827b-4f656b5e3caa None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:02.539288 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-05442d73-7168-4c35-827b-4f656b5e3caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:02.584087 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ccc4b5-f2cd-4adc-b1dd-658311a20cf0 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:02.625332 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b776d1-6198-4439-810c-2554d00d1865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:02.626763 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b776d1-6198-4439-810c-2554d00d1865 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:02.627217 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b776d1-6198-4439-810c-2554d00d1865 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:02.627627 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b776d1-6198-4439-810c-2554d00d1865 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:02.628548 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b776d1-6198-4439-810c-2554d00d1865 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:02.628980 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b776d1-6198-4439-810c-2554d00d1865 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:02.630519 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b776d1-6198-4439-810c-2554d00d1865 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:02.648254 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 12/26] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:02.656673 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b776d1-6198-4439-810c-2554d00d1865 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:02.686645 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 15/27] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:42:02.741751 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620511b5-67b8-48a9-bbba-0ae053ceb661 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:02.742366 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620511b5-67b8-48a9-bbba-0ae053ceb661 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:02.742918 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620511b5-67b8-48a9-bbba-0ae053ceb661 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:02.744883 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 16/28] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:02.750618 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92091ade-58e1-4be2-9775-0ed848ac7aeb None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:02.751204 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92091ade-58e1-4be2-9775-0ed848ac7aeb None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:02.751677 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92091ade-58e1-4be2-9775-0ed848ac7aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:02.782022 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-92091ade-58e1-4be2-9775-0ed848ac7aeb None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:02.783639 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-92091ade-58e1-4be2-9775-0ed848ac7aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:02.795267 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b776d1-6198-4439-810c-2554d00d1865 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:02.808593 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:02.842870 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9f1b9-f178-4e04-be43-68ec1a051e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:02.844210 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9f1b9-f178-4e04-be43-68ec1a051e3a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:02.844670 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9f1b9-f178-4e04-be43-68ec1a051e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:02.845121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9f1b9-f178-4e04-be43-68ec1a051e3a None admin] PATH_INFO: `/v3/users/d15ddf8d03bc44188d865237c74fbf2f` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:02.848570 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe9f1b9-f178-4e04-be43-68ec1a051e3a None admin] RBAC: Authorizing `identity:get_user(user_id=d15ddf8d03bc44188d865237c74fbf2f)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:02.850364 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe9f1b9-f178-4e04-be43-68ec1a051e3a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:02.853428 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 13/29] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:02 2022] GET /identity/v3/users/d15ddf8d03bc44188d865237c74fbf2f => generated 247 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:02.859000 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9f1b9-f178-4e04-be43-68ec1a051e3a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:02.940163 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 17/30] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:02.940973 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92091ade-58e1-4be2-9775-0ed848ac7aeb None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:03.049264 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9f1b9-f178-4e04-be43-68ec1a051e3a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:03.084283 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:03.122535 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7b429-2ba0-4f0e-a3ff-ab7b1e6285d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:03.123383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7b429-2ba0-4f0e-a3ff-ab7b1e6285d1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:03.123672 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7b429-2ba0-4f0e-a3ff-ab7b1e6285d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:03.123983 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7b429-2ba0-4f0e-a3ff-ab7b1e6285d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:03.149550 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7b429-2ba0-4f0e-a3ff-ab7b1e6285d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:03.151048 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7b429-2ba0-4f0e-a3ff-ab7b1e6285d1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:03.166954 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92091ade-58e1-4be2-9775-0ed848ac7aeb None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:03.188532 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-eaf7b429-2ba0-4f0e-a3ff-ab7b1e6285d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:03.188532 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:03.188532 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:03.188532 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:03.188532 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:03.188532 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:03.188532 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:03.188532 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:03.188532 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:03.188532 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:03.188532 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:03.188532 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:03.188532 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:03.188532 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:03.188532 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:03.189432 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:03.189432 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:03.189432 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:03.189432 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:03.189432 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:03.189432 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:03.189432 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:03.189432 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:03.189432 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:03.189432 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:03.189432 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:03.189432 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:03.189432 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:03.189432 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:03.189432 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:03.189432 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:03.189432 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:03.190279 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:03.190279 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:03.190279 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:03.190279 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:42:03.190279 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 14/31] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:03.191022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7b429-2ba0-4f0e-a3ff-ab7b1e6285d1 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:03.244588 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666b381-124c-4957-b8a0-70f1b61404c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:03.245868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666b381-124c-4957-b8a0-70f1b61404c1 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:03.246374 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666b381-124c-4957-b8a0-70f1b61404c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:03.246850 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666b381-124c-4957-b8a0-70f1b61404c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:03.249384 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666b381-124c-4957-b8a0-70f1b61404c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:03.251105 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666b381-124c-4957-b8a0-70f1b61404c1 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:03.253206 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 18/32] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:03.255655 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666b381-124c-4957-b8a0-70f1b61404c1 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:03.264471 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:03.368883 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7b429-2ba0-4f0e-a3ff-ab7b1e6285d1 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:03.411049 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666b381-124c-4957-b8a0-70f1b61404c1 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:03.412351 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d798b-7c61-4319-852e-b24138ae69ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:03.413144 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d798b-7c61-4319-852e-b24138ae69ac None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:03.413548 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d798b-7c61-4319-852e-b24138ae69ac None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:03.413926 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d798b-7c61-4319-852e-b24138ae69ac None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:03.415097 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d798b-7c61-4319-852e-b24138ae69ac None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:03.417521 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d798b-7c61-4319-852e-b24138ae69ac None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:03.469550 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:03.478441 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa541d99-f379-41d7-a8c4-be1a35fb40ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:03.479581 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa541d99-f379-41d7-a8c4-be1a35fb40ae None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:03.480225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa541d99-f379-41d7-a8c4-be1a35fb40ae None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:03.480702 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa541d99-f379-41d7-a8c4-be1a35fb40ae None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:03.482141 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa541d99-f379-41d7-a8c4-be1a35fb40ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:03.482702 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa541d99-f379-41d7-a8c4-be1a35fb40ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:03.484788 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa541d99-f379-41d7-a8c4-be1a35fb40ae None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:03.508075 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 19/33] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:03.509312 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa541d99-f379-41d7-a8c4-be1a35fb40ae None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:03.602841 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 15/34] 10.222.0.85 () {60 vars in 1131 bytes} [Thu Jun 16 14:42:03 2022] POST /identity/v3/roles => generated 225 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:42:03.605353 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467e632-565e-4e66-8225-67e2dc81ae2b None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:03.605998 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467e632-565e-4e66-8225-67e2dc81ae2b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:03.606634 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467e632-565e-4e66-8225-67e2dc81ae2b None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:03.609016 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 16/35] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:03.610531 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467e632-565e-4e66-8225-67e2dc81ae2b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:03.659832 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa541d99-f379-41d7-a8c4-be1a35fb40ae None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:03.701724 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232ab3e-50a6-4e69-a17a-ffc244087d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:03.702915 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232ab3e-50a6-4e69-a17a-ffc244087d61 None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:03.703339 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232ab3e-50a6-4e69-a17a-ffc244087d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:03.703789 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232ab3e-50a6-4e69-a17a-ffc244087d61 None admin] PATH_INFO: `/v3/domains/default/users/d15ddf8d03bc44188d865237c74fbf2f/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:03.706559 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b232ab3e-50a6-4e69-a17a-ffc244087d61 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d15ddf8d03bc44188d865237c74fbf2f, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:03.708450 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b232ab3e-50a6-4e69-a17a-ffc244087d61 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:03.761300 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:03.785306 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467e632-565e-4e66-8225-67e2dc81ae2b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:03.839229 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d329f-714d-4a37-b257-ef8976aef145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:03.840366 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d329f-714d-4a37-b257-ef8976aef145 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:03.840870 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d329f-714d-4a37-b257-ef8976aef145 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:03.841354 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d329f-714d-4a37-b257-ef8976aef145 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:03.842480 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d329f-714d-4a37-b257-ef8976aef145 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:03.851971 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d329f-714d-4a37-b257-ef8976aef145 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:04.098971 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 17/36] 10.222.0.85 () {60 vars in 1141 bytes} [Thu Jun 16 14:42:03 2022] POST /identity/v3/projects => generated 301 bytes in 489 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:42:04.100922 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c463c-adb6-45f7-9e7f-1d5ae71aeb03 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:04.101452 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c463c-adb6-45f7-9e7f-1d5ae71aeb03 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:04.101981 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c463c-adb6-45f7-9e7f-1d5ae71aeb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:04.110908 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 20/37] 10.222.0.85 () {58 vars in 1361 bytes} [Thu Jun 16 14:42:03 2022] PUT /identity/v3/domains/default/users/d15ddf8d03bc44188d865237c74fbf2f/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:42:04.113497 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e9111-29e5-434f-900a-8495f21bb2cd None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:04.113497 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e9111-29e5-434f-900a-8495f21bb2cd None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:04.113741 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e9111-29e5-434f-900a-8495f21bb2cd None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:04.118307 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 21/38] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:04.124939 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7691fd-76ac-4b61-ada4-6e3347fc7a80 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:04.125382 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7691fd-76ac-4b61-ada4-6e3347fc7a80 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:04.125829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7691fd-76ac-4b61-ada4-6e3347fc7a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:04.128466 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d55c463c-adb6-45f7-9e7f-1d5ae71aeb03 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:04.130879 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d55c463c-adb6-45f7-9e7f-1d5ae71aeb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:04.165236 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-9d7691fd-76ac-4b61-ada4-6e3347fc7a80 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:04.167347 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9d7691fd-76ac-4b61-ada4-6e3347fc7a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:04.238603 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 18/39] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:04.277741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c463c-adb6-45f7-9e7f-1d5ae71aeb03 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:04.370237 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:04.386099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:04.393158 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 22/40] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:42:04.420781 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7691fd-76ac-4b61-ada4-6e3347fc7a80 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:04.431202 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c463c-adb6-45f7-9e7f-1d5ae71aeb03 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:04.474639 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d521e61-bd4c-49c2-8610-9073067c5c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:04.474639 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d521e61-bd4c-49c2-8610-9073067c5c16 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:04.474639 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d521e61-bd4c-49c2-8610-9073067c5c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:04.474639 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d521e61-bd4c-49c2-8610-9073067c5c16 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:04.475035 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d521e61-bd4c-49c2-8610-9073067c5c16 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:04.475655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d521e61-bd4c-49c2-8610-9073067c5c16 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:04.502877 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 19/41] 10.222.0.85 () {60 vars in 1131 bytes} [Thu Jun 16 14:42:04 2022] POST /identity/v3/roles => generated 219 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:42:04.564665 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7691fd-76ac-4b61-ada4-6e3347fc7a80 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:04.618455 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565d65d-d022-45d7-9fb9-e027c29f0f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:04.619560 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565d65d-d022-45d7-9fb9-e027c29f0f24 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:04.620086 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565d65d-d022-45d7-9fb9-e027c29f0f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:04.620719 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565d65d-d022-45d7-9fb9-e027c29f0f24 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:04.621912 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565d65d-d022-45d7-9fb9-e027c29f0f24 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:04.623774 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565d65d-d022-45d7-9fb9-e027c29f0f24 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:04.637530 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9f54a-ce1a-4df7-a05d-6c749d39683a None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:04.637822 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9f54a-ce1a-4df7-a05d-6c749d39683a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:04.638116 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9f54a-ce1a-4df7-a05d-6c749d39683a None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:04.639619 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 20/42] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:42:04.646470 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 23/43] 10.222.0.85 () {60 vars in 1131 bytes} [Thu Jun 16 14:42:04 2022] POST /identity/v3/roles => generated 223 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:42:04.646959 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cf2b1-4a46-41c7-a8ef-d1c18d6d507b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:04.647254 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cf2b1-4a46-41c7-a8ef-d1c18d6d507b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:04.647739 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cf2b1-4a46-41c7-a8ef-d1c18d6d507b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:04.678045 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-2e7cf2b1-4a46-41c7-a8ef-d1c18d6d507b None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:04.679977 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2e7cf2b1-4a46-41c7-a8ef-d1c18d6d507b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:04.780677 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 21/44] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:42:04.819777 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565d65d-d022-45d7-9fb9-e027c29f0f24 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:04.887418 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:04.968144 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565d65d-d022-45d7-9fb9-e027c29f0f24 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:05.005581 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11f488-4d85-427b-a472-4c760305230f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:05.006394 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11f488-4d85-427b-a472-4c760305230f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:05.006682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11f488-4d85-427b-a472-4c760305230f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:05.006962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11f488-4d85-427b-a472-4c760305230f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:05.008245 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d11f488-4d85-427b-a472-4c760305230f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:05.009735 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d11f488-4d85-427b-a472-4c760305230f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:05.011761 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 24/45] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:05.017172 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7cf2b1-4a46-41c7-a8ef-d1c18d6d507b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:05.083663 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:05.134545 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7cf2b1-4a46-41c7-a8ef-d1c18d6d507b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:05.174370 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e1789-1381-480c-8404-c981edea9358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:05.174979 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e1789-1381-480c-8404-c981edea9358 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:05.175267 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e1789-1381-480c-8404-c981edea9358 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:05.175549 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e1789-1381-480c-8404-c981edea9358 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:05.176324 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e1789-1381-480c-8404-c981edea9358 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:05.177858 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e1789-1381-480c-8404-c981edea9358 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:05.209260 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 22/46] 10.222.0.85 () {60 vars in 1141 bytes} [Thu Jun 16 14:42:05 2022] POST /identity/v3/projects => generated 312 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:42:06.606449 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cf291-3b09-431d-a2b0-4d63f7c7e3cc None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:06.607043 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cf291-3b09-431d-a2b0-4d63f7c7e3cc None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:06.607043 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cf291-3b09-431d-a2b0-4d63f7c7e3cc None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:06.608470 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 25/47] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:06.614203 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0b7a0-babe-4d03-996a-698207cd02ba None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:06.614655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0b7a0-babe-4d03-996a-698207cd02ba None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:06.614749 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0b7a0-babe-4d03-996a-698207cd02ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:06.633661 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a9b0b7a0-babe-4d03-996a-698207cd02ba None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:06.634902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a9b0b7a0-babe-4d03-996a-698207cd02ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:06.708948 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 23/48] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:06.733193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cf291-3b09-431d-a2b0-4d63f7c7e3cc None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:06.844911 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cf291-3b09-431d-a2b0-4d63f7c7e3cc None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:06.856021 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:06.882209 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c67d5-6a33-429d-a05f-7751b814baf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:06.883023 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c67d5-6a33-429d-a05f-7751b814baf4 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:06.883303 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c67d5-6a33-429d-a05f-7751b814baf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:06.883583 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c67d5-6a33-429d-a05f-7751b814baf4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:06.895039 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c67d5-6a33-429d-a05f-7751b814baf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:06.902845 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-646c67d5-6a33-429d-a05f-7751b814baf4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:06.902845 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:06.902845 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:06.902845 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:06.902845 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:06.902845 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:06.902845 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:06.902845 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:06.902845 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:06.902845 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:06.902845 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:06.902845 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:06.902845 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:06.902845 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:06.902845 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:06.902845 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:06.903752 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:06.903752 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:06.903752 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:06.903752 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:06.903752 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:06.903752 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:06.903752 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:06.903752 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:06.903752 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:06.903752 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:06.903752 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:06.903752 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:06.903752 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:06.903752 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:06.903752 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:06.903752 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:06.904535 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:06.904535 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:06.904535 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:06.904535 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:06.904535 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:06.904535 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:06.904535 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:06.904535 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:06.904535 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:06.904535 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:06.904535 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:06.904535 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:42:06.904535 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 26/49] 10.222.0.85 () {56 vars in 1096 bytes} [Thu Jun 16 14:42:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:06.910228 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0b7a0-babe-4d03-996a-698207cd02ba None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:06.959408 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:07.024736 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0b7a0-babe-4d03-996a-698207cd02ba None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:07.063668 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef22c0-9106-4b2c-b2e2-ec31958f1c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:07.064407 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef22c0-9106-4b2c-b2e2-ec31958f1c54 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:07.064675 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef22c0-9106-4b2c-b2e2-ec31958f1c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:07.064953 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef22c0-9106-4b2c-b2e2-ec31958f1c54 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:07.065716 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef22c0-9106-4b2c-b2e2-ec31958f1c54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:07.066028 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef22c0-9106-4b2c-b2e2-ec31958f1c54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:07.067479 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef22c0-9106-4b2c-b2e2-ec31958f1c54 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:07.076781 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 24/50] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:07.082503 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c67d5-6a33-429d-a05f-7751b814baf4 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:07.194792 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c67d5-6a33-429d-a05f-7751b814baf4 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:07.233660 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b05b8e-67ab-4f9a-a23b-4181dedc807b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:07.234558 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b05b8e-67ab-4f9a-a23b-4181dedc807b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:07.234842 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b05b8e-67ab-4f9a-a23b-4181dedc807b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:07.235119 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b05b8e-67ab-4f9a-a23b-4181dedc807b None admin] PATH_INFO: `/v3/users/d15ddf8d03bc44188d865237c74fbf2f` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:07.236370 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b05b8e-67ab-4f9a-a23b-4181dedc807b None admin] RBAC: Authorizing `identity:get_user(user_id=d15ddf8d03bc44188d865237c74fbf2f)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:07.237987 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b05b8e-67ab-4f9a-a23b-4181dedc807b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:07.239666 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 27/51] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:07 2022] GET /identity/v3/users/d15ddf8d03bc44188d865237c74fbf2f => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:07.245475 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef22c0-9106-4b2c-b2e2-ec31958f1c54 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:07.363075 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef22c0-9106-4b2c-b2e2-ec31958f1c54 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:07.368821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:07.368989 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ada8a8-77f7-4715-9b89-1cb06712d614 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:07.368989 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ada8a8-77f7-4715-9b89-1cb06712d614 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:07.368989 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ada8a8-77f7-4715-9b89-1cb06712d614 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:07.368989 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 28/52] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:07.374322 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52807bb5-3aec-410d-9087-f624186b2fd1 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:07.374609 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52807bb5-3aec-410d-9087-f624186b2fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:07.374888 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52807bb5-3aec-410d-9087-f624186b2fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:07.393061 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-52807bb5-3aec-410d-9087-f624186b2fd1 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:07.394299 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-52807bb5-3aec-410d-9087-f624186b2fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:07.402444 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c14b9-91b7-4888-8ca2-0de239e6035a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:07.403316 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c14b9-91b7-4888-8ca2-0de239e6035a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:07.403636 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c14b9-91b7-4888-8ca2-0de239e6035a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:07.403969 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c14b9-91b7-4888-8ca2-0de239e6035a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:07.405253 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c14b9-91b7-4888-8ca2-0de239e6035a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:07.406747 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c14b9-91b7-4888-8ca2-0de239e6035a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:07.408504 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 25/53] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:07.414640 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c14b9-91b7-4888-8ca2-0de239e6035a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:07.433504 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:07.477243 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 29/54] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:07.500848 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52807bb5-3aec-410d-9087-f624186b2fd1 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:07.527904 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c14b9-91b7-4888-8ca2-0de239e6035a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:07.576333 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb9803-ed7d-4377-978f-f43d77d348f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:07.577428 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb9803-ed7d-4377-978f-f43d77d348f9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:07.577831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb9803-ed7d-4377-978f-f43d77d348f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:07.578216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb9803-ed7d-4377-978f-f43d77d348f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:07.579488 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb9803-ed7d-4377-978f-f43d77d348f9 None admin] RBAC: Adding query filter params (role.id=95dcfa6c726a4d01a41d2642554fd338, scope.domain.id=default, user.id=d15ddf8d03bc44188d865237c74fbf2f) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:07.580002 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb9803-ed7d-4377-978f-f43d77d348f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:07.582261 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb9803-ed7d-4377-978f-f43d77d348f9 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:07.598595 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 26/55] 10.222.0.85 () {56 vars in 1322 bytes} [Thu Jun 16 14:42:07 2022] GET /identity/v3/role_assignments?user.id=d15ddf8d03bc44188d865237c74fbf2f&scope.domain.id=default&role.id=95dcfa6c726a4d01a41d2642554fd338 => generated 530 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:07.662273 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52807bb5-3aec-410d-9087-f624186b2fd1 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:07.701901 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aaea46-fd9f-4a06-86b2-bd9abe6b1d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:07.702722 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aaea46-fd9f-4a06-86b2-bd9abe6b1d12 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:07.703008 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aaea46-fd9f-4a06-86b2-bd9abe6b1d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:07.703291 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aaea46-fd9f-4a06-86b2-bd9abe6b1d12 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:07.704562 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aaea46-fd9f-4a06-86b2-bd9abe6b1d12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:07.706080 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aaea46-fd9f-4a06-86b2-bd9abe6b1d12 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:07.707748 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 30/56] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:07.713764 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb9803-ed7d-4377-978f-f43d77d348f9 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:07.763095 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:07.832691 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb9803-ed7d-4377-978f-f43d77d348f9 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:07.870109 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef36b2-b973-47bb-aa7b-c2bc6d8ebc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:07.870968 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef36b2-b973-47bb-aa7b-c2bc6d8ebc55 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:07.871258 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef36b2-b973-47bb-aa7b-c2bc6d8ebc55 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:07.871661 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef36b2-b973-47bb-aa7b-c2bc6d8ebc55 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:07.872437 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef36b2-b973-47bb-aa7b-c2bc6d8ebc55 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:07.874018 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef36b2-b973-47bb-aa7b-c2bc6d8ebc55 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:07.905700 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 27/57] 10.222.0.85 () {60 vars in 1140 bytes} [Thu Jun 16 14:42:07 2022] POST /identity/v3/projects => generated 298 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:42:10.039751 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18637e0-0543-4e81-b0c0-75566422779e None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:10.040334 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18637e0-0543-4e81-b0c0-75566422779e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:10.040421 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18637e0-0543-4e81-b0c0-75566422779e None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:10.042190 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 31/58] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:10.048130 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9056ab-b37a-4e3c-ba1c-16580cd5d3a6 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:10.048902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9056ab-b37a-4e3c-ba1c-16580cd5d3a6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:10.049081 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9056ab-b37a-4e3c-ba1c-16580cd5d3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:10.067352 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4b9056ab-b37a-4e3c-ba1c-16580cd5d3a6 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:10.068591 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4b9056ab-b37a-4e3c-ba1c-16580cd5d3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:10.141294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 28/59] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:10.165652 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18637e0-0543-4e81-b0c0-75566422779e None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:10.203804 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:10.269852 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18637e0-0543-4e81-b0c0-75566422779e None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:10.306301 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aadb30-16b2-44e2-948c-b4b7beb84225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:10.307014 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aadb30-16b2-44e2-948c-b4b7beb84225 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:10.307322 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aadb30-16b2-44e2-948c-b4b7beb84225 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:10.307603 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aadb30-16b2-44e2-948c-b4b7beb84225 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:10.309055 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aadb30-16b2-44e2-948c-b4b7beb84225 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:10.310537 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aadb30-16b2-44e2-948c-b4b7beb84225 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:10.312236 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 32/60] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:10.318084 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9056ab-b37a-4e3c-ba1c-16580cd5d3a6 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:10.339305 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:10.422502 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9056ab-b37a-4e3c-ba1c-16580cd5d3a6 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:10.457636 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946b06e-a889-4684-92e1-18ef33f74835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:10.458305 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946b06e-a889-4684-92e1-18ef33f74835 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:10.458589 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946b06e-a889-4684-92e1-18ef33f74835 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:10.458863 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946b06e-a889-4684-92e1-18ef33f74835 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:10.459572 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946b06e-a889-4684-92e1-18ef33f74835 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:10.461146 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946b06e-a889-4684-92e1-18ef33f74835 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:10.488198 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 29/61] 10.222.0.85 () {60 vars in 1132 bytes} [Thu Jun 16 14:42:10 2022] POST /identity/v3/users => generated 275 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:42:13.747461 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b3e3b-8439-4e47-91c2-d80f9829278e None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:13.747461 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b3e3b-8439-4e47-91c2-d80f9829278e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:13.747461 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b3e3b-8439-4e47-91c2-d80f9829278e None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:13.747461 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 33/62] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:13.753405 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a218f28-34dc-47cd-8740-c309e4593f16 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:13.753843 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a218f28-34dc-47cd-8740-c309e4593f16 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:13.753966 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a218f28-34dc-47cd-8740-c309e4593f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:13.780996 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5a218f28-34dc-47cd-8740-c309e4593f16 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:13.782944 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5a218f28-34dc-47cd-8740-c309e4593f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:13.894386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 30/63] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:13.931388 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a218f28-34dc-47cd-8740-c309e4593f16 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:13.931569 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360401d-21cc-4a84-9986-ef763443c3b0 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:13.931841 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360401d-21cc-4a84-9986-ef763443c3b0 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:13.932360 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360401d-21cc-4a84-9986-ef763443c3b0 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:13.934758 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 34/64] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:13.939905 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:13.947503 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad6fc8-f605-4e47-b806-2fc34514e744 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:13.948117 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad6fc8-f605-4e47-b806-2fc34514e744 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:13.948807 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad6fc8-f605-4e47-b806-2fc34514e744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:13.984051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d1ad6fc8-f605-4e47-b806-2fc34514e744 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:13.985302 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d1ad6fc8-f605-4e47-b806-2fc34514e744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:14.077376 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a218f28-34dc-47cd-8740-c309e4593f16 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:14.099504 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 35/65] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:42:14.101282 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39362499-442f-438f-9be8-d36d8d68c0a6 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:14.101743 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39362499-442f-438f-9be8-d36d8d68c0a6 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:14.102161 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39362499-442f-438f-9be8-d36d8d68c0a6 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:14.103753 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 36/66] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:14.110558 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292d243-dcf1-40fb-a210-5a9595a7bf99 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:14.110846 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292d243-dcf1-40fb-a210-5a9595a7bf99 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:14.111128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292d243-dcf1-40fb-a210-5a9595a7bf99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:14.118531 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b18bb-f39d-4983-873e-39c3b82d03bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:14.120932 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b18bb-f39d-4983-873e-39c3b82d03bc None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:14.123062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b18bb-f39d-4983-873e-39c3b82d03bc None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:14.123811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b18bb-f39d-4983-873e-39c3b82d03bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:14.135931 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-f292d243-dcf1-40fb-a210-5a9595a7bf99 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:14.137420 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f292d243-dcf1-40fb-a210-5a9595a7bf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:14.139649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b18bb-f39d-4983-873e-39c3b82d03bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:14.151161 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-053b18bb-f39d-4983-873e-39c3b82d03bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:14.151161 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:14.151161 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:14.151161 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:14.151161 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:14.151161 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:14.151161 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:14.151161 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:14.151161 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:14.151161 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:14.151161 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:14.151161 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:14.151161 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:14.151161 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:14.151161 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:14.151161 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:14.152189 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:14.152189 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:14.152189 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:14.152189 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:14.152189 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:14.152189 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:14.152189 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:14.152189 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:14.152189 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:14.152189 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:14.152189 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:14.152189 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:14.152189 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:14.152189 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:14.152189 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:14.152189 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:14.152952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:14.152952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:14.152952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:14.152952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:14.152952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:14.152952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:14.152952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:14.152952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:14.152952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:14.152952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:14.152952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:14.152952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:42:14.152952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 31/67] 10.222.0.85 () {56 vars in 1096 bytes} [Thu Jun 16 14:42:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:14.153760 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b18bb-f39d-4983-873e-39c3b82d03bc None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:14.177710 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:14.240422 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 37/68] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:14.241509 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f292d243-dcf1-40fb-a210-5a9595a7bf99 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:14.248582 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:14.296190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b18bb-f39d-4983-873e-39c3b82d03bc None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:14.332200 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472fdf0b-dee1-4780-ac5d-d48f581efe82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:14.333022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472fdf0b-dee1-4780-ac5d-d48f581efe82 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:14.333308 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472fdf0b-dee1-4780-ac5d-d48f581efe82 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:14.333590 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472fdf0b-dee1-4780-ac5d-d48f581efe82 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:14.345863 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472fdf0b-dee1-4780-ac5d-d48f581efe82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:14.353609 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-472fdf0b-dee1-4780-ac5d-d48f581efe82 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:42:14.353609 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:14.353609 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:14.353609 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:14.353609 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:14.353609 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:14.353609 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:14.353609 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:14.353609 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:14.353609 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:14.353609 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:14.353609 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:14.353609 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:14.353609 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:14.353609 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:14.353609 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:14.354537 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:14.354537 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:14.354537 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:14.354537 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:14.354537 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:14.354537 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:14.354537 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:14.354537 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:14.354537 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:14.354537 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:14.354537 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:14.354537 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:14.354537 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:14.354537 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:14.354537 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:14.354537 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:14.355578 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:14.355578 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:14.355578 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:14.355578 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:14.355578 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:14.355578 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:14.355578 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:14.355578 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:14.355578 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:14.355578 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:14.355578 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:42:14.355578 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:42:14.355578 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 32/69] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:14.356770 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9640697-f9ed-465f-b74b-9aef72c3a7d9 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:14.356770 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9640697-f9ed-465f-b74b-9aef72c3a7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:14.356882 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9640697-f9ed-465f-b74b-9aef72c3a7d9 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:14.358297 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 33/70] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:14.362973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9640697-f9ed-465f-b74b-9aef72c3a7d9 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:14.365623 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f292d243-dcf1-40fb-a210-5a9595a7bf99 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:14.404918 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08344ae8-15a5-48ad-8bda-6d7ba10d0893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:14.405596 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08344ae8-15a5-48ad-8bda-6d7ba10d0893 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:14.405886 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08344ae8-15a5-48ad-8bda-6d7ba10d0893 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:14.406323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08344ae8-15a5-48ad-8bda-6d7ba10d0893 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:14.407097 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08344ae8-15a5-48ad-8bda-6d7ba10d0893 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:14.407409 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08344ae8-15a5-48ad-8bda-6d7ba10d0893 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:14.408922 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08344ae8-15a5-48ad-8bda-6d7ba10d0893 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:14.420080 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 38/71] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:14.420975 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08344ae8-15a5-48ad-8bda-6d7ba10d0893 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:14.452636 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:14.486750 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9640697-f9ed-465f-b74b-9aef72c3a7d9 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:14.512954 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:14.524765 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db081122-0ded-416d-a107-836edb2f2981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:14.525596 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db081122-0ded-416d-a107-836edb2f2981 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:14.525882 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db081122-0ded-416d-a107-836edb2f2981 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:14.526165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db081122-0ded-416d-a107-836edb2f2981 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:14.531419 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08344ae8-15a5-48ad-8bda-6d7ba10d0893 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:14.536543 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db081122-0ded-416d-a107-836edb2f2981 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:14.544552 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-db081122-0ded-416d-a107-836edb2f2981 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:42:14.544552 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:14.544552 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:14.544552 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:14.544552 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:14.544552 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:14.544552 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:14.544552 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:14.544552 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:14.544552 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:14.544552 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:14.544552 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:14.544552 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:14.544552 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:14.544552 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:14.544552 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:14.545492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:14.545492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:14.545492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:14.545492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:14.545492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:14.545492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:14.545492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:14.545492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:14.545492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:14.545492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:14.545492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:14.545492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:14.545492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:14.545492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:14.545492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:14.545492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:14.550893 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:14.550893 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:14.550893 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:14.550893 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:14.550893 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:14.550893 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:14.550893 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:14.550893 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:14.550893 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:14.550893 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:14.550893 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:42:14.550893 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:42:14.550893 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 34/72] 10.222.0.85 () {56 vars in 1114 bytes} [Thu Jun 16 14:42:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:14.550893 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d949d-beb8-4bbd-b48d-2d624ea35327 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:14.551570 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d949d-beb8-4bbd-b48d-2d624ea35327 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:14.551570 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d949d-beb8-4bbd-b48d-2d624ea35327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:14.566087 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1a0d949d-beb8-4bbd-b48d-2d624ea35327 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:14.567307 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1a0d949d-beb8-4bbd-b48d-2d624ea35327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:14.573570 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d57eb7a-c119-4e9c-99be-495181e93fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:14.574331 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57eb7a-c119-4e9c-99be-495181e93fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:14.574621 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57eb7a-c119-4e9c-99be-495181e93fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:14.574903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57eb7a-c119-4e9c-99be-495181e93fd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:14.575663 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d57eb7a-c119-4e9c-99be-495181e93fd8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:14.576019 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d57eb7a-c119-4e9c-99be-495181e93fd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:14.577435 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d57eb7a-c119-4e9c-99be-495181e93fd8 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:14.585886 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 39/73] 10.222.0.85 () {56 vars in 1101 bytes} [Thu Jun 16 14:42:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:14.586693 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d57eb7a-c119-4e9c-99be-495181e93fd8 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:14.634660 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 35/74] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:14.636089 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253731b-863e-45d4-ab8c-0626c0b1e902 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:14.636388 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253731b-863e-45d4-ab8c-0626c0b1e902 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:14.636683 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253731b-863e-45d4-ab8c-0626c0b1e902 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:14.638191 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 36/75] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:14.640752 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253731b-863e-45d4-ab8c-0626c0b1e902 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:14.675424 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:14.688701 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d57eb7a-c119-4e9c-99be-495181e93fd8 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:14.723971 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb397cdb-2785-427e-acf8-795251e3216b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:14.724847 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb397cdb-2785-427e-acf8-795251e3216b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:14.725134 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb397cdb-2785-427e-acf8-795251e3216b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:14.725411 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb397cdb-2785-427e-acf8-795251e3216b None admin] PATH_INFO: `/v3/users/d15ddf8d03bc44188d865237c74fbf2f` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:14.726666 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb397cdb-2785-427e-acf8-795251e3216b None admin] RBAC: Authorizing `identity:get_user(user_id=d15ddf8d03bc44188d865237c74fbf2f)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:14.728180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb397cdb-2785-427e-acf8-795251e3216b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:14.729993 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 40/76] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:14 2022] GET /identity/v3/users/d15ddf8d03bc44188d865237c74fbf2f => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:14.734854 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb397cdb-2785-427e-acf8-795251e3216b None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:14.750010 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253731b-863e-45d4-ab8c-0626c0b1e902 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:14.765160 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:14.786204 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4e719-af2b-41a3-a980-b1241919d770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:14.786881 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4e719-af2b-41a3-a980-b1241919d770 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:14.787186 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4e719-af2b-41a3-a980-b1241919d770 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:14.787441 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4e719-af2b-41a3-a980-b1241919d770 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:14.788237 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e4e719-af2b-41a3-a980-b1241919d770 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:14.788542 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e4e719-af2b-41a3-a980-b1241919d770 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:14.789943 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e4e719-af2b-41a3-a980-b1241919d770 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:14.798137 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 37/77] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:14.799776 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0daf46-0618-4824-9d11-c6828c360091 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:14.800117 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0daf46-0618-4824-9d11-c6828c360091 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:14.800395 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0daf46-0618-4824-9d11-c6828c360091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:14.817552 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-2a0daf46-0618-4824-9d11-c6828c360091 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:14.818768 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2a0daf46-0618-4824-9d11-c6828c360091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:14.832460 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb397cdb-2785-427e-acf8-795251e3216b None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:14.866107 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0673e14-199c-4d6f-8972-14961bb10468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:14.867010 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0673e14-199c-4d6f-8972-14961bb10468 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:14.867304 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0673e14-199c-4d6f-8972-14961bb10468 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:14.867568 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0673e14-199c-4d6f-8972-14961bb10468 None admin] PATH_INFO: `/v3/users/1b2adb9bc22345fcbdd8189b5378b491` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:14.880986 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0673e14-199c-4d6f-8972-14961bb10468 None admin] RBAC: Authorizing `identity:get_user(user_id=1b2adb9bc22345fcbdd8189b5378b491)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:14.882461 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0673e14-199c-4d6f-8972-14961bb10468 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:14.884210 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 41/78] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:14 2022] GET /identity/v3/users/1b2adb9bc22345fcbdd8189b5378b491 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:14.884958 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0673e14-199c-4d6f-8972-14961bb10468 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:14.888876 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 38/79] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:14.889941 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0daf46-0618-4824-9d11-c6828c360091 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:14.900248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:14.986884 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0673e14-199c-4d6f-8972-14961bb10468 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:15.005888 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0daf46-0618-4824-9d11-c6828c360091 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:15.013191 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:15.022206 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf3e64-10ec-44f0-9b6a-021be44ae918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:15.023036 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf3e64-10ec-44f0-9b6a-021be44ae918 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:15.023340 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf3e64-10ec-44f0-9b6a-021be44ae918 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:15.023610 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf3e64-10ec-44f0-9b6a-021be44ae918 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:15.034344 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf3e64-10ec-44f0-9b6a-021be44ae918 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:15.040288 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ae879-1f54-4f1f-8150-4518c256e4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:15.040941 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ae879-1f54-4f1f-8150-4518c256e4e8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:15.041224 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ae879-1f54-4f1f-8150-4518c256e4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:15.041498 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ae879-1f54-4f1f-8150-4518c256e4e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:15.042184 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-a3bf3e64-10ec-44f0-9b6a-021be44ae918 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:42:15.042184 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:15.042184 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:15.042184 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:15.042184 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:15.042184 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:15.042184 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:15.042184 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:15.042184 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:15.042184 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:15.042184 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:15.042184 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:15.042184 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:15.042184 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:15.042184 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:15.042184 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:15.043293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:15.043293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:15.043293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:15.043293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:15.043293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:15.043293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:15.043293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:15.043293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:15.043293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:15.043293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:15.043293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:15.043293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:15.043293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:15.043293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:15.043293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:15.043293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:15.044082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:15.044082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:15.044082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:15.044082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:15.044082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:15.044082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:15.044082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:15.044082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:15.044082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:15.044082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:15.044082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:42:15.044082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:42:15.044082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 42/80] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:15.049392 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf3e64-10ec-44f0-9b6a-021be44ae918 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:15.114803 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ae879-1f54-4f1f-8150-4518c256e4e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:15.116336 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ae879-1f54-4f1f-8150-4518c256e4e8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:15.122783 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:15.148143 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf3e64-10ec-44f0-9b6a-021be44ae918 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:15.183691 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da99181-5be4-4430-977a-19302b019e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:15.184608 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da99181-5be4-4430-977a-19302b019e7c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:15.184894 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da99181-5be4-4430-977a-19302b019e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:15.185179 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da99181-5be4-4430-977a-19302b019e7c None admin] PATH_INFO: `/v3/users/1b2adb9bc22345fcbdd8189b5378b491` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:15.186451 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da99181-5be4-4430-977a-19302b019e7c None admin] RBAC: Authorizing `identity:get_user(user_id=1b2adb9bc22345fcbdd8189b5378b491)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:15.187957 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da99181-5be4-4430-977a-19302b019e7c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:15.189629 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 43/81] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:15 2022] GET /identity/v3/users/1b2adb9bc22345fcbdd8189b5378b491 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:15.190404 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da99181-5be4-4430-977a-19302b019e7c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:15.218519 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 39/82] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:15.219423 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ae879-1f54-4f1f-8150-4518c256e4e8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:15.229590 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:15.291708 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da99181-5be4-4430-977a-19302b019e7c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:15.319652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ae879-1f54-4f1f-8150-4518c256e4e8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:15.326842 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b81455-d487-47c1-aae9-960b4cdb20e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:15.327501 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b81455-d487-47c1-aae9-960b4cdb20e6 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:15.327785 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b81455-d487-47c1-aae9-960b4cdb20e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:15.328082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b81455-d487-47c1-aae9-960b4cdb20e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:15.340609 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:15.355077 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0622f58d-6610-4ae6-8ce8-55bd01b70676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:15.355985 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622f58d-6610-4ae6-8ce8-55bd01b70676 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:15.356279 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622f58d-6610-4ae6-8ce8-55bd01b70676 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:15.356554 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622f58d-6610-4ae6-8ce8-55bd01b70676 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:15.357743 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0622f58d-6610-4ae6-8ce8-55bd01b70676 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:15.359223 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0622f58d-6610-4ae6-8ce8-55bd01b70676 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:15.360911 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 40/83] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:15.362862 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0622f58d-6610-4ae6-8ce8-55bd01b70676 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:15.396326 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b81455-d487-47c1-aae9-960b4cdb20e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:15.397823 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b81455-d487-47c1-aae9-960b4cdb20e6 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:15.438158 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:15.463227 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0622f58d-6610-4ae6-8ce8-55bd01b70676 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:15.498087 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 44/84] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:15.498966 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b81455-d487-47c1-aae9-960b4cdb20e6 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:15.500486 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c1332-1f62-43a8-828e-96c16691179a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:15.501228 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c1332-1f62-43a8-828e-96c16691179a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:15.501510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c1332-1f62-43a8-828e-96c16691179a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:15.501774 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c1332-1f62-43a8-828e-96c16691179a None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:15.502565 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c1332-1f62-43a8-828e-96c16691179a None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:15.502832 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c1332-1f62-43a8-828e-96c16691179a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:15.504263 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c1332-1f62-43a8-828e-96c16691179a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:15.513551 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 41/85] 10.222.0.85 () {56 vars in 1101 bytes} [Thu Jun 16 14:42:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:15.514212 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c1332-1f62-43a8-828e-96c16691179a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:15.549917 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:15.610366 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b81455-d487-47c1-aae9-960b4cdb20e6 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:15.620002 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c1332-1f62-43a8-828e-96c16691179a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:15.644862 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118c0e2-a0f4-4285-b253-f0a8907301ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:15.645523 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118c0e2-a0f4-4285-b253-f0a8907301ed None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:15.645813 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118c0e2-a0f4-4285-b253-f0a8907301ed None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:15.646094 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118c0e2-a0f4-4285-b253-f0a8907301ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:15.653679 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80faf60f-9342-48d1-a577-e71ffe936512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:15.654544 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80faf60f-9342-48d1-a577-e71ffe936512 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:15.654828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80faf60f-9342-48d1-a577-e71ffe936512 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:15.655113 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80faf60f-9342-48d1-a577-e71ffe936512 None admin] PATH_INFO: `/v3/projects/379430b83a8643be9d1e7d6fee22017d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:15.656339 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80faf60f-9342-48d1-a577-e71ffe936512 None admin] RBAC: Authorizing `identity:get_project(project_id=379430b83a8643be9d1e7d6fee22017d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:15.657817 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80faf60f-9342-48d1-a577-e71ffe936512 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:15.659538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 42/86] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:15 2022] GET /identity/v3/projects/379430b83a8643be9d1e7d6fee22017d => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:15.664650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80faf60f-9342-48d1-a577-e71ffe936512 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:15.666187 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:15.715949 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7118c0e2-a0f4-4285-b253-f0a8907301ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:15.717457 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7118c0e2-a0f4-4285-b253-f0a8907301ed None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:15.759829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:15.764304 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80faf60f-9342-48d1-a577-e71ffe936512 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:15.797507 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf48812-42eb-44a0-80e8-e71c4dfbf7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:15.798197 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf48812-42eb-44a0-80e8-e71c4dfbf7c2 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:15.798840 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf48812-42eb-44a0-80e8-e71c4dfbf7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:15.799123 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf48812-42eb-44a0-80e8-e71c4dfbf7c2 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:15.800018 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf48812-42eb-44a0-80e8-e71c4dfbf7c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:15.801435 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf48812-42eb-44a0-80e8-e71c4dfbf7c2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:15.818658 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 45/87] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:15.819529 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118c0e2-a0f4-4285-b253-f0a8907301ed None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:15.821606 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 43/88] 10.222.0.85 () {60 vars in 1132 bytes} [Thu Jun 16 14:42:15 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:42:15.829719 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf48812-42eb-44a0-80e8-e71c4dfbf7c2 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:15.906216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:15.939335 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118c0e2-a0f4-4285-b253-f0a8907301ed None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:15.962722 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf48812-42eb-44a0-80e8-e71c4dfbf7c2 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:15.979087 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288dbcf-c249-4d73-8864-3a44d8de418f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:15.980596 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288dbcf-c249-4d73-8864-3a44d8de418f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:15.980885 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288dbcf-c249-4d73-8864-3a44d8de418f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:15.981441 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288dbcf-c249-4d73-8864-3a44d8de418f None admin] PATH_INFO: `/v3/projects/379430b83a8643be9d1e7d6fee22017d` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:15.983019 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288dbcf-c249-4d73-8864-3a44d8de418f None admin] RBAC: Authorizing `identity:get_project(project_id=379430b83a8643be9d1e7d6fee22017d)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:15.984990 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288dbcf-c249-4d73-8864-3a44d8de418f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:15.992350 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 46/89] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:15 2022] GET /identity/v3/projects/379430b83a8643be9d1e7d6fee22017d => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:15.992350 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288dbcf-c249-4d73-8864-3a44d8de418f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:16.004702 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe6905-699c-44a7-920a-d00d3bbeb287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:16.005645 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe6905-699c-44a7-920a-d00d3bbeb287 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:16.005939 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe6905-699c-44a7-920a-d00d3bbeb287 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:16.006227 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe6905-699c-44a7-920a-d00d3bbeb287 None admin] PATH_INFO: `/v3/users/1b2adb9bc22345fcbdd8189b5378b491` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:16.006551 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:16.007582 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe6905-699c-44a7-920a-d00d3bbeb287 None admin] RBAC: Authorizing `identity:get_user(user_id=1b2adb9bc22345fcbdd8189b5378b491)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:16.009430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe6905-699c-44a7-920a-d00d3bbeb287 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:16.016560 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 44/90] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:15 2022] GET /identity/v3/users/1b2adb9bc22345fcbdd8189b5378b491 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:16.016560 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe6905-699c-44a7-920a-d00d3bbeb287 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:16.115074 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288dbcf-c249-4d73-8864-3a44d8de418f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:16.142225 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe6905-699c-44a7-920a-d00d3bbeb287 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:16.163691 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4360ea7-267c-4d86-8f09-c238a8c5b90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:16.164396 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4360ea7-267c-4d86-8f09-c238a8c5b90d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:16.164683 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4360ea7-267c-4d86-8f09-c238a8c5b90d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:16.164960 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4360ea7-267c-4d86-8f09-c238a8c5b90d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:16.165841 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4360ea7-267c-4d86-8f09-c238a8c5b90d None admin] RBAC: Adding query filter params (role.id=95dcfa6c726a4d01a41d2642554fd338, scope.project.id=379430b83a8643be9d1e7d6fee22017d, user.id=d15ddf8d03bc44188d865237c74fbf2f) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:16.166154 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4360ea7-267c-4d86-8f09-c238a8c5b90d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:16.168163 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4360ea7-267c-4d86-8f09-c238a8c5b90d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:16.176105 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 47/91] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:42:15 2022] GET /identity/v3/role_assignments?user.id=d15ddf8d03bc44188d865237c74fbf2f&scope.project.id=379430b83a8643be9d1e7d6fee22017d&role.id=95dcfa6c726a4d01a41d2642554fd338 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:16.176925 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4360ea7-267c-4d86-8f09-c238a8c5b90d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:16.177144 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:16.186701 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff12c15-3f69-4d44-9d74-e894ca181efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:16.187619 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff12c15-3f69-4d44-9d74-e894ca181efe None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:16.187939 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff12c15-3f69-4d44-9d74-e894ca181efe None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:16.188227 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff12c15-3f69-4d44-9d74-e894ca181efe None admin] PATH_INFO: `/v3/projects/379430b83a8643be9d1e7d6fee22017d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:16.190207 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff12c15-3f69-4d44-9d74-e894ca181efe None admin] RBAC: Authorizing `identity:get_project(project_id=379430b83a8643be9d1e7d6fee22017d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:16.191723 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff12c15-3f69-4d44-9d74-e894ca181efe None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:16.194855 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 45/92] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:16 2022] GET /identity/v3/projects/379430b83a8643be9d1e7d6fee22017d => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:16.195805 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff12c15-3f69-4d44-9d74-e894ca181efe None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:16.303295 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4360ea7-267c-4d86-8f09-c238a8c5b90d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:16.312701 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:16.339647 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff12c15-3f69-4d44-9d74-e894ca181efe None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:16.344048 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894585c1-3d54-49c4-8763-007a7d68ff3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:16.345159 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894585c1-3d54-49c4-8763-007a7d68ff3f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:16.345682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894585c1-3d54-49c4-8763-007a7d68ff3f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:16.346160 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894585c1-3d54-49c4-8763-007a7d68ff3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:16.347218 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894585c1-3d54-49c4-8763-007a7d68ff3f None admin] RBAC: Adding query filter params (role.id=26e7e900cf574eaabe4fcf886acb0c46, scope.project.id=379430b83a8643be9d1e7d6fee22017d, user.id=1b2adb9bc22345fcbdd8189b5378b491) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:16.347752 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894585c1-3d54-49c4-8763-007a7d68ff3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:16.349932 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894585c1-3d54-49c4-8763-007a7d68ff3f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:16.356608 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 48/93] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:42:16 2022] GET /identity/v3/role_assignments?user.id=1b2adb9bc22345fcbdd8189b5378b491&scope.project.id=379430b83a8643be9d1e7d6fee22017d&role.id=26e7e900cf574eaabe4fcf886acb0c46 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:16.357807 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894585c1-3d54-49c4-8763-007a7d68ff3f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:16.382294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d5b67-2541-4989-ae7f-2e14674a3313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:16.383369 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d5b67-2541-4989-ae7f-2e14674a3313 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:16.383369 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d5b67-2541-4989-ae7f-2e14674a3313 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:16.383529 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d5b67-2541-4989-ae7f-2e14674a3313 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:16.468112 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:16.483908 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d5b67-2541-4989-ae7f-2e14674a3313 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:16.483908 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d5b67-2541-4989-ae7f-2e14674a3313 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:16.489452 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894585c1-3d54-49c4-8763-007a7d68ff3f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:16.610083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b80e1-834c-4ae7-9d9d-04c5fdd498bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:16.611300 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b80e1-834c-4ae7-9d9d-04c5fdd498bf None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:16.611829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b80e1-834c-4ae7-9d9d-04c5fdd498bf None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:16.612334 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b80e1-834c-4ae7-9d9d-04c5fdd498bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:16.613415 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b80e1-834c-4ae7-9d9d-04c5fdd498bf None admin] RBAC: Adding query filter params (role.id=2f7fa8924ea9447aab26981f0329ad43, scope.project.id=379430b83a8643be9d1e7d6fee22017d, user.id=1b2adb9bc22345fcbdd8189b5378b491) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:16.613948 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b80e1-834c-4ae7-9d9d-04c5fdd498bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:16.614568 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 46/94] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:16.620731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b80e1-834c-4ae7-9d9d-04c5fdd498bf None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:16.620902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d5b67-2541-4989-ae7f-2e14674a3313 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:16.635265 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 49/95] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:42:16 2022] GET /identity/v3/role_assignments?user.id=1b2adb9bc22345fcbdd8189b5378b491&scope.project.id=379430b83a8643be9d1e7d6fee22017d&role.id=2f7fa8924ea9447aab26981f0329ad43 => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:16.730574 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:16.736743 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d5b67-2541-4989-ae7f-2e14674a3313 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:16.775792 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a119da-9e0c-44a9-a2f7-fe9067ab4aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:16.776828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a119da-9e0c-44a9-a2f7-fe9067ab4aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:16.777114 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a119da-9e0c-44a9-a2f7-fe9067ab4aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:16.777548 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a119da-9e0c-44a9-a2f7-fe9067ab4aa2 None admin] PATH_INFO: `/v3/projects/40c5d95c76bd4f41bdbf33896179fa47` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:16.778854 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a119da-9e0c-44a9-a2f7-fe9067ab4aa2 None admin] RBAC: Authorizing `identity:get_project(project_id=40c5d95c76bd4f41bdbf33896179fa47)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:16.780389 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a119da-9e0c-44a9-a2f7-fe9067ab4aa2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:16.787179 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 47/96] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:16 2022] GET /identity/v3/projects/40c5d95c76bd4f41bdbf33896179fa47 => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:16.788647 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b80e1-834c-4ae7-9d9d-04c5fdd498bf None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:16.816608 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:16.897883 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b80e1-834c-4ae7-9d9d-04c5fdd498bf None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:16.943035 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0724d-5b67-4b40-a27b-62a6f306e6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:16.943690 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0724d-5b67-4b40-a27b-62a6f306e6f7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:16.944006 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0724d-5b67-4b40-a27b-62a6f306e6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:16.944287 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0724d-5b67-4b40-a27b-62a6f306e6f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:16.945138 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0724d-5b67-4b40-a27b-62a6f306e6f7 None admin] RBAC: Adding query filter params (role.id=26e7e900cf574eaabe4fcf886acb0c46, scope.project.id=40c5d95c76bd4f41bdbf33896179fa47, user.id=1b2adb9bc22345fcbdd8189b5378b491) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:16.945451 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0724d-5b67-4b40-a27b-62a6f306e6f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:16.946936 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0724d-5b67-4b40-a27b-62a6f306e6f7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:16.956279 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 50/97] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:42:16 2022] GET /identity/v3/role_assignments?user.id=1b2adb9bc22345fcbdd8189b5378b491&scope.project.id=40c5d95c76bd4f41bdbf33896179fa47&role.id=26e7e900cf574eaabe4fcf886acb0c46 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:19.034293 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702bfb8-5ad6-47d1-9392-669deb1d439b None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:19.035010 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702bfb8-5ad6-47d1-9392-669deb1d439b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:19.035010 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702bfb8-5ad6-47d1-9392-669deb1d439b None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:19.036659 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 48/98] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:19.042948 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa3704-3b21-480d-814c-09dbf13f7c27 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:19.043559 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa3704-3b21-480d-814c-09dbf13f7c27 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:19.043559 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa3704-3b21-480d-814c-09dbf13f7c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:19.062355 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-56aa3704-3b21-480d-814c-09dbf13f7c27 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:19.063743 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-56aa3704-3b21-480d-814c-09dbf13f7c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:19.102683 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752f9cf-bd54-416b-b445-1a191cf710a6 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:19.102988 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752f9cf-bd54-416b-b445-1a191cf710a6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:19.103238 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752f9cf-bd54-416b-b445-1a191cf710a6 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:19.104840 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 49/99] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:42:19.122492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477843e-f9c6-4e89-98cd-4350d89bddc3 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:19.122798 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477843e-f9c6-4e89-98cd-4350d89bddc3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:19.123059 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477843e-f9c6-4e89-98cd-4350d89bddc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:19.153638 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b477843e-f9c6-4e89-98cd-4350d89bddc3 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:19.154944 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b477843e-f9c6-4e89-98cd-4350d89bddc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:19.197709 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:19.208530 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 51/100] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:42:19.238849 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02005e17-26dd-4252-88d0-4dc5c94bef00 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:19.239165 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02005e17-26dd-4252-88d0-4dc5c94bef00 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:19.239426 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02005e17-26dd-4252-88d0-4dc5c94bef00 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:19.240883 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 52/101] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:42:19.244462 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02005e17-26dd-4252-88d0-4dc5c94bef00 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:19.277378 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 50/102] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 16 14:42:19.279109 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42beb23-9a1b-44b2-bdc6-53d4db71988d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:19.279612 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42beb23-9a1b-44b2-bdc6-53d4db71988d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:19.280184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42beb23-9a1b-44b2-bdc6-53d4db71988d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:19.311991 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a42beb23-9a1b-44b2-bdc6-53d4db71988d None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:19.311991 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a42beb23-9a1b-44b2-bdc6-53d4db71988d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:19.381084 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 51/103] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:19.382659 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a48fd4-97c2-4f4f-9794-3db1d50fe70b None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:19.382954 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a48fd4-97c2-4f4f-9794-3db1d50fe70b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:19.383237 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a48fd4-97c2-4f4f-9794-3db1d50fe70b None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:19.389110 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 52/104] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:19.389110 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a48fd4-97c2-4f4f-9794-3db1d50fe70b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:19.409482 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02005e17-26dd-4252-88d0-4dc5c94bef00 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:19.416751 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:19.453814 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563a7d0-dd6a-410c-8252-dc841f37ccbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:19.455697 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563a7d0-dd6a-410c-8252-dc841f37ccbc None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:19.456379 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563a7d0-dd6a-410c-8252-dc841f37ccbc None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:19.456946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563a7d0-dd6a-410c-8252-dc841f37ccbc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:19.473006 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563a7d0-dd6a-410c-8252-dc841f37ccbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:19.483998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-d563a7d0-dd6a-410c-8252-dc841f37ccbc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:19.483998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:19.483998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:19.483998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:19.483998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:19.483998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:19.483998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:19.483998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:19.483998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:19.483998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:19.483998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:19.483998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:19.483998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:19.483998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:19.483998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:19.483998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:19.484898 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:19.484898 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:19.484898 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:19.484898 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:19.484898 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:19.484898 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:19.484898 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:19.484898 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:19.484898 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:19.484898 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:19.484898 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:19.484898 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:19.484898 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:19.484898 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:19.484898 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:19.484898 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:19.485672 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:19.485672 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:19.485672 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:19.485672 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:19.485672 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:19.485672 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:19.485672 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:19.485672 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:19.485672 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:19.485672 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:19.485672 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:19.485672 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:42:19.488616 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 53/105] 10.222.0.85 () {56 vars in 1096 bytes} [Thu Jun 16 14:42:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:19.490127 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13eb01-b644-4ed9-b4a1-3fa06a789227 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:19.490566 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13eb01-b644-4ed9-b4a1-3fa06a789227 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:19.490974 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13eb01-b644-4ed9-b4a1-3fa06a789227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:19.512225 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a48fd4-97c2-4f4f-9794-3db1d50fe70b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:19.515344 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-1e13eb01-b644-4ed9-b4a1-3fa06a789227 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:19.516870 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1e13eb01-b644-4ed9-b4a1-3fa06a789227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:19.567138 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e8adc-eefb-4563-877e-7f83cd991317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:19.568323 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e8adc-eefb-4563-877e-7f83cd991317 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:19.568810 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e8adc-eefb-4563-877e-7f83cd991317 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:19.569454 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e8adc-eefb-4563-877e-7f83cd991317 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:19.573180 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e8adc-eefb-4563-877e-7f83cd991317 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:19.574948 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e8adc-eefb-4563-877e-7f83cd991317 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:19.576946 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 53/106] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:19.582381 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e8adc-eefb-4563-877e-7f83cd991317 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:19.596447 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:19.623897 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 54/107] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:19.623897 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13eb01-b644-4ed9-b4a1-3fa06a789227 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:19.719408 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:19.731613 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e8adc-eefb-4563-877e-7f83cd991317 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:19.754968 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13eb01-b644-4ed9-b4a1-3fa06a789227 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:19.783260 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7de838-c103-4591-8a66-2f0c8900f4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:19.784972 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7de838-c103-4591-8a66-2f0c8900f4b5 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:19.786122 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7de838-c103-4591-8a66-2f0c8900f4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:19.786917 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7de838-c103-4591-8a66-2f0c8900f4b5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:19.799711 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9b95f-9307-407a-a8b3-9e2bf408aa2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:19.800344 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9b95f-9307-407a-a8b3-9e2bf408aa2d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:19.800634 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9b95f-9307-407a-a8b3-9e2bf408aa2d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:19.800918 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9b95f-9307-407a-a8b3-9e2bf408aa2d None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:19.801704 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9b95f-9307-407a-a8b3-9e2bf408aa2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:19.802020 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9b95f-9307-407a-a8b3-9e2bf408aa2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:19.803498 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9b95f-9307-407a-a8b3-9e2bf408aa2d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:19.804760 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7de838-c103-4591-8a66-2f0c8900f4b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:19.814617 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 55/108] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:19.815407 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9b95f-9307-407a-a8b3-9e2bf408aa2d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:19.815516 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-ad7de838-c103-4591-8a66-2f0c8900f4b5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:42:19.815516 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:19.815516 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:19.815516 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:19.815516 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:19.815516 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:19.815516 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:19.815516 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:19.815516 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:19.815516 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:19.815516 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:19.815516 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:19.815516 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:19.815516 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:19.815516 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:19.815516 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:19.816401 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:19.816401 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:19.816401 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:19.816401 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:19.816401 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:19.816401 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:19.816401 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:19.816401 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:19.816401 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:19.816401 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:19.816401 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:19.816401 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:19.816401 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:19.816401 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:19.816401 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:19.816401 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:19.817163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:19.817163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:19.817163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:19.817163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:19.817163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:19.817163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:19.817163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:19.817163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:19.817163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:19.817163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:19.817163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:42:19.817163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:42:19.820809 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 54/109] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:19.821592 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7de838-c103-4591-8a66-2f0c8900f4b5 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:19.889530 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:19.943350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7de838-c103-4591-8a66-2f0c8900f4b5 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:19.961887 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9b95f-9307-407a-a8b3-9e2bf408aa2d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:19.980795 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ecaae-9165-47b8-bccd-0003e82db47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:19.981729 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ecaae-9165-47b8-bccd-0003e82db47a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:19.982024 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ecaae-9165-47b8-bccd-0003e82db47a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:19.982309 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ecaae-9165-47b8-bccd-0003e82db47a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:19.997093 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21ecaae-9165-47b8-bccd-0003e82db47a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:20.002797 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcadd4-b3a1-4cf9-914f-02cb9b9372b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:20.003710 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcadd4-b3a1-4cf9-914f-02cb9b9372b8 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:20.004223 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcadd4-b3a1-4cf9-914f-02cb9b9372b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:20.004699 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcadd4-b3a1-4cf9-914f-02cb9b9372b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:20.005593 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebcadd4-b3a1-4cf9-914f-02cb9b9372b8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:20.005710 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-d21ecaae-9165-47b8-bccd-0003e82db47a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:42:20.005710 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:20.005710 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:20.005710 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:20.005710 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:20.005710 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:20.005710 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:20.005710 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:20.005710 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:20.005710 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:20.005710 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:20.005710 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:20.005710 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:20.005710 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:20.005710 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:20.005710 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:20.006468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:20.006468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:20.006468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:20.006468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:20.006468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:20.006468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:20.006468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:20.006468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:20.006468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:20.006468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:20.006468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:20.006468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:20.006468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:20.006468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:20.006468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:20.006468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:20.007300 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:20.007300 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:20.007300 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:20.007300 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:20.007300 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:20.007300 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:20.007300 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:20.007300 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:20.007300 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:20.007300 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:20.007300 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:42:20.007300 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:42:20.007300 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 55/110] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:20.007967 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ecaae-9165-47b8-bccd-0003e82db47a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:20.013709 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebcadd4-b3a1-4cf9-914f-02cb9b9372b8 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:20.030791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:20.059921 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 56/111] 10.222.0.85 () {60 vars in 1141 bytes} [Thu Jun 16 14:42:19 2022] POST /identity/v3/projects => generated 302 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:42:20.059921 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcadd4-b3a1-4cf9-914f-02cb9b9372b8 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:20.156508 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ecaae-9165-47b8-bccd-0003e82db47a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:20.180706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:20.188225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcadd4-b3a1-4cf9-914f-02cb9b9372b8 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:20.195768 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3eb12d-30d1-4e3a-976e-f74d7c5e5636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:20.196735 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3eb12d-30d1-4e3a-976e-f74d7c5e5636 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:20.197020 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3eb12d-30d1-4e3a-976e-f74d7c5e5636 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:20.197298 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3eb12d-30d1-4e3a-976e-f74d7c5e5636 None admin] PATH_INFO: `/v3/users/d15ddf8d03bc44188d865237c74fbf2f` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:20.198664 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3eb12d-30d1-4e3a-976e-f74d7c5e5636 None admin] RBAC: Authorizing `identity:get_user(user_id=d15ddf8d03bc44188d865237c74fbf2f)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:20.200217 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3eb12d-30d1-4e3a-976e-f74d7c5e5636 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:20.206781 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 56/112] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:20 2022] GET /identity/v3/users/d15ddf8d03bc44188d865237c74fbf2f => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:20.207784 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3eb12d-30d1-4e3a-976e-f74d7c5e5636 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:20.235434 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667f4ba-a5f4-4b6c-ab07-986b382feafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:20.236178 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667f4ba-a5f4-4b6c-ab07-986b382feafb None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:20.236600 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667f4ba-a5f4-4b6c-ab07-986b382feafb None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:20.236951 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667f4ba-a5f4-4b6c-ab07-986b382feafb None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:20.237897 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667f4ba-a5f4-4b6c-ab07-986b382feafb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:20.238263 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667f4ba-a5f4-4b6c-ab07-986b382feafb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:20.239970 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667f4ba-a5f4-4b6c-ab07-986b382feafb None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:20.250890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 57/113] 10.222.0.85 () {56 vars in 1101 bytes} [Thu Jun 16 14:42:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:20.257431 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e65fc-f037-4a7e-b9af-4a4e3d6b6b46 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:20.257723 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e65fc-f037-4a7e-b9af-4a4e3d6b6b46 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:20.258116 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e65fc-f037-4a7e-b9af-4a4e3d6b6b46 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:20.259937 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 58/114] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:20.260957 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e65fc-f037-4a7e-b9af-4a4e3d6b6b46 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:20.317691 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:20.358157 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3eb12d-30d1-4e3a-976e-f74d7c5e5636 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:20.405721 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e65fc-f037-4a7e-b9af-4a4e3d6b6b46 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:20.408719 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95fca9b-fab6-4a1a-a731-92d70f3a4d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:20.409348 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fca9b-fab6-4a1a-a731-92d70f3a4d87 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:20.409635 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fca9b-fab6-4a1a-a731-92d70f3a4d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:20.409910 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fca9b-fab6-4a1a-a731-92d70f3a4d87 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:20.410671 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95fca9b-fab6-4a1a-a731-92d70f3a4d87 None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:20.410977 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95fca9b-fab6-4a1a-a731-92d70f3a4d87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:20.412406 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95fca9b-fab6-4a1a-a731-92d70f3a4d87 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:20.422030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 57/115] 10.222.0.85 () {56 vars in 1101 bytes} [Thu Jun 16 14:42:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:20.422875 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95fca9b-fab6-4a1a-a731-92d70f3a4d87 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:20.446005 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbd738-6579-4fcb-8711-f01a039e2d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:20.446886 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbd738-6579-4fcb-8711-f01a039e2d17 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:20.447818 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbd738-6579-4fcb-8711-f01a039e2d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:20.448161 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbd738-6579-4fcb-8711-f01a039e2d17 None admin] PATH_INFO: `/v3/projects/379430b83a8643be9d1e7d6fee22017d` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:20.449715 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cbd738-6579-4fcb-8711-f01a039e2d17 None admin] RBAC: Authorizing `identity:get_project(project_id=379430b83a8643be9d1e7d6fee22017d)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:20.451204 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cbd738-6579-4fcb-8711-f01a039e2d17 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:20.452991 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 59/116] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:20 2022] GET /identity/v3/projects/379430b83a8643be9d1e7d6fee22017d => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:20.454162 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a6509-f5fc-4e4f-8650-29d805d04722 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:20.454457 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a6509-f5fc-4e4f-8650-29d805d04722 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:20.454721 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a6509-f5fc-4e4f-8650-29d805d04722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:20.472229 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-c50a6509-f5fc-4e4f-8650-29d805d04722 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:20.473439 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c50a6509-f5fc-4e4f-8650-29d805d04722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:20.502275 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:20.540749 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95fca9b-fab6-4a1a-a731-92d70f3a4d87 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:20.551125 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 60/117] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:20.552535 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a303cce-ad95-45d3-8faf-1d83e019e1c4 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:20.552824 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a303cce-ad95-45d3-8faf-1d83e019e1c4 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:20.553072 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a303cce-ad95-45d3-8faf-1d83e019e1c4 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:20.554372 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 61/118] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:20.560325 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a303cce-ad95-45d3-8faf-1d83e019e1c4 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:20.594463 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23783af4-b895-4430-8933-85c95fec23fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:20.595388 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23783af4-b895-4430-8933-85c95fec23fc None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:20.595678 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23783af4-b895-4430-8933-85c95fec23fc None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:20.596030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23783af4-b895-4430-8933-85c95fec23fc None admin] PATH_INFO: `/v3/users/567aaa801cbd42ee9f0e33012955d7e0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:20.611454 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:20.614476 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23783af4-b895-4430-8933-85c95fec23fc None admin] RBAC: Authorizing `identity:get_user(user_id=567aaa801cbd42ee9f0e33012955d7e0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:20.616104 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23783af4-b895-4430-8933-85c95fec23fc None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:20.618279 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 58/119] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:20 2022] GET /identity/v3/users/567aaa801cbd42ee9f0e33012955d7e0 => generated 289 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:20.619442 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23783af4-b895-4430-8933-85c95fec23fc None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:20.699366 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a303cce-ad95-45d3-8faf-1d83e019e1c4 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:20.729840 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23783af4-b895-4430-8933-85c95fec23fc None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:20.742313 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079b924-7710-4fc7-b032-95255d272021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:20.743224 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079b924-7710-4fc7-b032-95255d272021 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:20.743515 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079b924-7710-4fc7-b032-95255d272021 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:20.743797 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079b924-7710-4fc7-b032-95255d272021 None admin] PATH_INFO: `/v3/users/1b2adb9bc22345fcbdd8189b5378b491` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:20.745153 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079b924-7710-4fc7-b032-95255d272021 None admin] RBAC: Authorizing `identity:get_user(user_id=1b2adb9bc22345fcbdd8189b5378b491)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:20.746745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079b924-7710-4fc7-b032-95255d272021 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:20.753072 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 62/120] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:20 2022] GET /identity/v3/users/1b2adb9bc22345fcbdd8189b5378b491 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:20.753072 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf483f9d-f847-4c10-96ef-9555add40e55 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:20.753072 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf483f9d-f847-4c10-96ef-9555add40e55 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:20.753072 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf483f9d-f847-4c10-96ef-9555add40e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:20.770758 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-bf483f9d-f847-4c10-96ef-9555add40e55 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:20.772032 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-bf483f9d-f847-4c10-96ef-9555add40e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:20.777971 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c746cf-e480-45cf-887f-f4472845f99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:20.778891 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c746cf-e480-45cf-887f-f4472845f99e None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:20.779175 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c746cf-e480-45cf-887f-f4472845f99e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:20.779451 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c746cf-e480-45cf-887f-f4472845f99e None admin] PATH_INFO: `/v3/projects/379430b83a8643be9d1e7d6fee22017d/users/d15ddf8d03bc44188d865237c74fbf2f/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:20.782374 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c746cf-e480-45cf-887f-f4472845f99e None admin] RBAC: Authorizing `identity:create_grant(project_id=379430b83a8643be9d1e7d6fee22017d, user_id=d15ddf8d03bc44188d865237c74fbf2f, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:20.784254 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c746cf-e480-45cf-887f-f4472845f99e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:20.796986 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:20.803565 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 59/121] 10.222.0.85 () {58 vars in 1439 bytes} [Thu Jun 16 14:42:20 2022] PUT /identity/v3/projects/379430b83a8643be9d1e7d6fee22017d/users/d15ddf8d03bc44188d865237c74fbf2f/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:42:20.804899 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c746cf-e480-45cf-887f-f4472845f99e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:20.870461 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 63/122] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:20.871801 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf483f9d-f847-4c10-96ef-9555add40e55 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:20.883423 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:20.946822 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c746cf-e480-45cf-887f-f4472845f99e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:20.992856 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bb3af-02b6-4451-83ac-705de4f5a555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:20.993711 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bb3af-02b6-4451-83ac-705de4f5a555 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:20.994415 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bb3af-02b6-4451-83ac-705de4f5a555 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:20.994415 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bb3af-02b6-4451-83ac-705de4f5a555 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:21.008092 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847bb3af-02b6-4451-83ac-705de4f5a555 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:21.017528 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-847bb3af-02b6-4451-83ac-705de4f5a555 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:42:21.017528 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:21.017528 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:21.017528 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:21.017528 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:21.017528 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:21.017528 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:21.017528 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:21.017528 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:21.017528 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:21.017528 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:21.017528 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:21.017528 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:21.017528 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:21.017528 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:21.017528 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:21.018462 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:21.018462 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:21.018462 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:21.018462 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:21.018462 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:21.018462 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:21.018462 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:21.018462 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:21.018462 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:21.018462 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:21.018462 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:21.018462 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:21.018462 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:21.018462 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:21.018462 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:21.018462 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:21.019216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:21.019216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:21.019216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:21.019216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:21.019216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:21.019216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:21.019216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:21.019216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:21.019216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:21.019216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:21.019216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:42:21.019216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:42:21.020332 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 60/123] 10.222.0.85 () {56 vars in 1114 bytes} [Thu Jun 16 14:42:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:21.021182 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bb3af-02b6-4451-83ac-705de4f5a555 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:21.026540 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf483f9d-f847-4c10-96ef-9555add40e55 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:21.072061 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c0078-4349-431c-bd50-80b4a37249e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:21.072889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c0078-4349-431c-bd50-80b4a37249e7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:21.073328 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c0078-4349-431c-bd50-80b4a37249e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:21.073685 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c0078-4349-431c-bd50-80b4a37249e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:21.104256 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:21.155202 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c0078-4349-431c-bd50-80b4a37249e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:21.157149 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c0078-4349-431c-bd50-80b4a37249e7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:21.167419 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bb3af-02b6-4451-83ac-705de4f5a555 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:21.191443 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:21.209325 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37590367-6325-449a-a226-7f456199f93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:21.210231 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37590367-6325-449a-a226-7f456199f93c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:21.210519 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37590367-6325-449a-a226-7f456199f93c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:21.210933 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37590367-6325-449a-a226-7f456199f93c None admin] PATH_INFO: `/v3/projects/379430b83a8643be9d1e7d6fee22017d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:21.212224 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37590367-6325-449a-a226-7f456199f93c None admin] RBAC: Authorizing `identity:get_project(project_id=379430b83a8643be9d1e7d6fee22017d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:21.214426 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37590367-6325-449a-a226-7f456199f93c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:21.216847 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 61/124] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:21 2022] GET /identity/v3/projects/379430b83a8643be9d1e7d6fee22017d => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:21.220172 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37590367-6325-449a-a226-7f456199f93c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:21.287692 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 64/125] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:21.288574 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c0078-4349-431c-bd50-80b4a37249e7 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:21.361046 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:21.367028 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37590367-6325-449a-a226-7f456199f93c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:21.409893 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e587c-a872-4afa-a2a2-f34f0e652474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:21.410990 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e587c-a872-4afa-a2a2-f34f0e652474 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:21.411280 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e587c-a872-4afa-a2a2-f34f0e652474 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:21.411558 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e587c-a872-4afa-a2a2-f34f0e652474 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:21.420298 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c0078-4349-431c-bd50-80b4a37249e7 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:21.426898 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e587c-a872-4afa-a2a2-f34f0e652474 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:21.437596 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-6e4e587c-a872-4afa-a2a2-f34f0e652474 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:42:21.437596 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:21.437596 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:21.437596 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:21.437596 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:21.437596 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:21.437596 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:21.437596 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:21.437596 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:21.437596 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:21.437596 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:21.437596 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:21.437596 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:21.437596 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:21.437596 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:21.437596 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:21.439322 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:21.439322 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:21.439322 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:21.439322 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:21.439322 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:21.439322 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:21.439322 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:21.439322 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:21.439322 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:21.439322 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:21.439322 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:21.439322 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:21.439322 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:21.439322 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:21.439322 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:21.439322 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:21.440738 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:21.440738 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:21.440738 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:21.440738 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:21.440738 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:21.440738 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:21.440738 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:21.440738 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:21.440738 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:21.440738 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:21.440738 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:42:21.440738 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:42:21.440738 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 62/126] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:21.444144 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e587c-a872-4afa-a2a2-f34f0e652474 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:21.470777 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a357cd-ed77-4d71-ae5d-4d08e77c9b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:21.471635 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a357cd-ed77-4d71-ae5d-4d08e77c9b38 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:21.471965 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a357cd-ed77-4d71-ae5d-4d08e77c9b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:21.472257 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a357cd-ed77-4d71-ae5d-4d08e77c9b38 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:21.473559 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a357cd-ed77-4d71-ae5d-4d08e77c9b38 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:21.474184 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a357cd-ed77-4d71-ae5d-4d08e77c9b38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:21.476315 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a357cd-ed77-4d71-ae5d-4d08e77c9b38 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:21.488232 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 65/127] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:21.489968 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a357cd-ed77-4d71-ae5d-4d08e77c9b38 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:21.509582 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:21.572784 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e587c-a872-4afa-a2a2-f34f0e652474 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:21.612947 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13efc2-132f-485c-bce4-7472a78c8b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:21.614131 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13efc2-132f-485c-bce4-7472a78c8b24 None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:21.614650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13efc2-132f-485c-bce4-7472a78c8b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:21.615141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13efc2-132f-485c-bce4-7472a78c8b24 None admin] PATH_INFO: `/v3/projects/379430b83a8643be9d1e7d6fee22017d/users/1b2adb9bc22345fcbdd8189b5378b491/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:21.617517 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a13efc2-132f-485c-bce4-7472a78c8b24 None admin] RBAC: Authorizing `identity:create_grant(project_id=379430b83a8643be9d1e7d6fee22017d, user_id=1b2adb9bc22345fcbdd8189b5378b491, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:21.619270 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a13efc2-132f-485c-bce4-7472a78c8b24 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:21.632574 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a357cd-ed77-4d71-ae5d-4d08e77c9b38 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:21.638238 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 63/128] 10.222.0.85 () {58 vars in 1439 bytes} [Thu Jun 16 14:42:21 2022] PUT /identity/v3/projects/379430b83a8643be9d1e7d6fee22017d/users/1b2adb9bc22345fcbdd8189b5378b491/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:42:21.639538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13efc2-132f-485c-bce4-7472a78c8b24 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:21.657246 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:21.676313 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bbd0a-5972-4452-99d9-846cab49d03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:21.677107 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bbd0a-5972-4452-99d9-846cab49d03a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:21.677404 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bbd0a-5972-4452-99d9-846cab49d03a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:21.677733 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bbd0a-5972-4452-99d9-846cab49d03a None admin] PATH_INFO: `/v3/projects/379430b83a8643be9d1e7d6fee22017d` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:21.679455 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0bbd0a-5972-4452-99d9-846cab49d03a None admin] RBAC: Authorizing `identity:get_project(project_id=379430b83a8643be9d1e7d6fee22017d)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:21.681166 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0bbd0a-5972-4452-99d9-846cab49d03a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:21.684142 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 66/129] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:21 2022] GET /identity/v3/projects/379430b83a8643be9d1e7d6fee22017d => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:21.689541 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bbd0a-5972-4452-99d9-846cab49d03a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:21.780670 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13efc2-132f-485c-bce4-7472a78c8b24 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:21.792717 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:21.805282 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bbd0a-5972-4452-99d9-846cab49d03a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:21.828666 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128f1f6-7ca6-4ea3-acb7-06a4f2833e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:21.829738 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128f1f6-7ca6-4ea3-acb7-06a4f2833e32 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:21.830266 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128f1f6-7ca6-4ea3-acb7-06a4f2833e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:21.830752 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128f1f6-7ca6-4ea3-acb7-06a4f2833e32 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:21.831866 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128f1f6-7ca6-4ea3-acb7-06a4f2833e32 None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:21.832452 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128f1f6-7ca6-4ea3-acb7-06a4f2833e32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:21.834673 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128f1f6-7ca6-4ea3-acb7-06a4f2833e32 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:21.845826 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 64/130] 10.222.0.85 () {56 vars in 1101 bytes} [Thu Jun 16 14:42:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:21.846030 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712a189-3383-4e69-b563-17475f034c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:21.846820 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712a189-3383-4e69-b563-17475f034c60 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:21.847112 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712a189-3383-4e69-b563-17475f034c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:21.847401 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712a189-3383-4e69-b563-17475f034c60 None admin] PATH_INFO: `/v3/users/1b2adb9bc22345fcbdd8189b5378b491` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:21.851935 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128f1f6-7ca6-4ea3-acb7-06a4f2833e32 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:21.852070 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712a189-3383-4e69-b563-17475f034c60 None admin] RBAC: Authorizing `identity:get_user(user_id=1b2adb9bc22345fcbdd8189b5378b491)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:21.852070 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712a189-3383-4e69-b563-17475f034c60 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:21.852363 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 67/131] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:21 2022] GET /identity/v3/users/1b2adb9bc22345fcbdd8189b5378b491 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:21.854775 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712a189-3383-4e69-b563-17475f034c60 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:21.968242 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:22.038155 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128f1f6-7ca6-4ea3-acb7-06a4f2833e32 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:22.052085 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712a189-3383-4e69-b563-17475f034c60 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:22.093598 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a395f-7b16-488a-be63-4bfba6236fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:22.095831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a395f-7b16-488a-be63-4bfba6236fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:22.096922 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a395f-7b16-488a-be63-4bfba6236fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:22.098174 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a395f-7b16-488a-be63-4bfba6236fe7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:22.099254 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a395f-7b16-488a-be63-4bfba6236fe7 None admin] RBAC: Adding query filter params (role.id=d7118e244cb94310a267cf9a9b5bbfd4, scope.project.id=379430b83a8643be9d1e7d6fee22017d, user.id=567aaa801cbd42ee9f0e33012955d7e0) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:22.100631 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a395f-7b16-488a-be63-4bfba6236fe7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:22.102768 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a395f-7b16-488a-be63-4bfba6236fe7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:22.111475 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42518069-23d2-4f50-8b39-b097aeb05525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:22.113127 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42518069-23d2-4f50-8b39-b097aeb05525 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:22.113622 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42518069-23d2-4f50-8b39-b097aeb05525 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:22.114111 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42518069-23d2-4f50-8b39-b097aeb05525 None admin] PATH_INFO: `/v3/users/1b2adb9bc22345fcbdd8189b5378b491` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:22.116057 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42518069-23d2-4f50-8b39-b097aeb05525 None admin] RBAC: Authorizing `identity:get_user(user_id=1b2adb9bc22345fcbdd8189b5378b491)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:22.118110 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 65/132] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:42:21 2022] GET /identity/v3/role_assignments?user.id=567aaa801cbd42ee9f0e33012955d7e0&scope.project.id=379430b83a8643be9d1e7d6fee22017d&role.id=d7118e244cb94310a267cf9a9b5bbfd4 => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:22.120241 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42518069-23d2-4f50-8b39-b097aeb05525 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:22.122759 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 68/133] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:21 2022] GET /identity/v3/users/1b2adb9bc22345fcbdd8189b5378b491 => generated 275 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:22.127112 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a395f-7b16-488a-be63-4bfba6236fe7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:22.130159 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42518069-23d2-4f50-8b39-b097aeb05525 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:22.251607 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:22.263312 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42518069-23d2-4f50-8b39-b097aeb05525 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:22.293551 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:22.319569 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c80d8f-fcbd-4ea3-a9a7-797a8cab0ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:22.321019 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c80d8f-fcbd-4ea3-a9a7-797a8cab0ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:22.321538 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c80d8f-fcbd-4ea3-a9a7-797a8cab0ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:22.322294 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c80d8f-fcbd-4ea3-a9a7-797a8cab0ae8 None admin] PATH_INFO: `/v3/projects/40c5d95c76bd4f41bdbf33896179fa47` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:22.324457 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c80d8f-fcbd-4ea3-a9a7-797a8cab0ae8 None admin] RBAC: Authorizing `identity:get_project(project_id=40c5d95c76bd4f41bdbf33896179fa47)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:22.327645 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c80d8f-fcbd-4ea3-a9a7-797a8cab0ae8 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:22.337120 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 69/134] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:22 2022] GET /identity/v3/projects/40c5d95c76bd4f41bdbf33896179fa47 => generated 312 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:22.339118 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c80d8f-fcbd-4ea3-a9a7-797a8cab0ae8 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:22.472894 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c80d8f-fcbd-4ea3-a9a7-797a8cab0ae8 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:22.495378 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a395f-7b16-488a-be63-4bfba6236fe7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:22.515930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef784c3-2489-42c3-b0be-ed2489e45348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:22.517972 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef784c3-2489-42c3-b0be-ed2489e45348 None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:22.518251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef784c3-2489-42c3-b0be-ed2489e45348 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:22.518530 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef784c3-2489-42c3-b0be-ed2489e45348 None admin] PATH_INFO: `/v3/projects/40c5d95c76bd4f41bdbf33896179fa47/users/1b2adb9bc22345fcbdd8189b5378b491/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:22.527358 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef784c3-2489-42c3-b0be-ed2489e45348 None admin] RBAC: Authorizing `identity:create_grant(project_id=40c5d95c76bd4f41bdbf33896179fa47, user_id=1b2adb9bc22345fcbdd8189b5378b491, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:22.528895 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef784c3-2489-42c3-b0be-ed2489e45348 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:22.554147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 70/135] 10.222.0.85 () {58 vars in 1439 bytes} [Thu Jun 16 14:42:22 2022] PUT /identity/v3/projects/40c5d95c76bd4f41bdbf33896179fa47/users/1b2adb9bc22345fcbdd8189b5378b491/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:42:22.562152 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc672a87-ddab-4b61-89a7-b75f1476c3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:22.568036 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc672a87-ddab-4b61-89a7-b75f1476c3c9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:22.568036 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc672a87-ddab-4b61-89a7-b75f1476c3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:22.568036 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc672a87-ddab-4b61-89a7-b75f1476c3c9 None admin] PATH_INFO: `/v3/projects/379430b83a8643be9d1e7d6fee22017d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:22.568960 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc672a87-ddab-4b61-89a7-b75f1476c3c9 None admin] RBAC: Authorizing `identity:get_project(project_id=379430b83a8643be9d1e7d6fee22017d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:22.570564 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc672a87-ddab-4b61-89a7-b75f1476c3c9 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:22.572530 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 66/136] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:22 2022] GET /identity/v3/projects/379430b83a8643be9d1e7d6fee22017d => generated 298 bytes in 449 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:22.578773 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef784c3-2489-42c3-b0be-ed2489e45348 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:22.597623 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27158e-9fe3-4d10-a8cd-7df2c5f838c3 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:22.597951 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27158e-9fe3-4d10-a8cd-7df2c5f838c3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:22.598228 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27158e-9fe3-4d10-a8cd-7df2c5f838c3 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:22.599766 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 67/137] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:42:22.605875 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba27c85-53b4-4e3c-bf47-1d01a9b45186 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:22.606203 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba27c85-53b4-4e3c-bf47-1d01a9b45186 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:22.606486 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba27c85-53b4-4e3c-bf47-1d01a9b45186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:22.633951 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-aba27c85-53b4-4e3c-bf47-1d01a9b45186 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:22.635174 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-aba27c85-53b4-4e3c-bf47-1d01a9b45186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:22.686301 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:22.779195 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 68/138] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:22.826992 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef784c3-2489-42c3-b0be-ed2489e45348 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:22.844002 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba27c85-53b4-4e3c-bf47-1d01a9b45186 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:22.884318 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:22.888336 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ac2b8-6012-454d-bac8-533b35670fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:22.889257 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ac2b8-6012-454d-bac8-533b35670fc6 None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:22.889544 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ac2b8-6012-454d-bac8-533b35670fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:22.889824 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ac2b8-6012-454d-bac8-533b35670fc6 None admin] PATH_INFO: `/v3/projects/379430b83a8643be9d1e7d6fee22017d/users/1b2adb9bc22345fcbdd8189b5378b491/roles/2f7fa8924ea9447aab26981f0329ad43` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:22.892159 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ac2b8-6012-454d-bac8-533b35670fc6 None admin] RBAC: Authorizing `identity:create_grant(project_id=379430b83a8643be9d1e7d6fee22017d, user_id=1b2adb9bc22345fcbdd8189b5378b491, role_id=2f7fa8924ea9447aab26981f0329ad43)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:22.893628 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ac2b8-6012-454d-bac8-533b35670fc6 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:22.929867 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 71/139] 10.222.0.85 () {58 vars in 1439 bytes} [Thu Jun 16 14:42:22 2022] PUT /identity/v3/projects/379430b83a8643be9d1e7d6fee22017d/users/1b2adb9bc22345fcbdd8189b5378b491/roles/2f7fa8924ea9447aab26981f0329ad43 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:42:22.982807 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba27c85-53b4-4e3c-bf47-1d01a9b45186 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:23.038536 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ed80b-375b-45c3-9d39-008b6efb298c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:23.039638 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ed80b-375b-45c3-9d39-008b6efb298c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:23.040085 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ed80b-375b-45c3-9d39-008b6efb298c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:23.040495 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ed80b-375b-45c3-9d39-008b6efb298c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:23.042902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ed80b-375b-45c3-9d39-008b6efb298c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:23.044628 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ed80b-375b-45c3-9d39-008b6efb298c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:23.046886 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 69/140] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:23.052535 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ac2b8-6012-454d-bac8-533b35670fc6 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:23.205011 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ac2b8-6012-454d-bac8-533b35670fc6 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:23.228176 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:23.257072 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18046e-2253-4020-9b88-c9184afa4762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:23.257779 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18046e-2253-4020-9b88-c9184afa4762 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:23.258070 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18046e-2253-4020-9b88-c9184afa4762 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:23.258353 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18046e-2253-4020-9b88-c9184afa4762 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:23.259108 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c18046e-2253-4020-9b88-c9184afa4762 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:23.260795 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c18046e-2253-4020-9b88-c9184afa4762 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:23.301440 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 72/141] 10.222.0.85 () {60 vars in 1132 bytes} [Thu Jun 16 14:42:23 2022] POST /identity/v3/users => generated 283 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:42:23.906836 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b7626-308d-4f58-bcb7-854718bcec4f None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:23.907819 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b7626-308d-4f58-bcb7-854718bcec4f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:23.908303 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b7626-308d-4f58-bcb7-854718bcec4f None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:23.909855 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 70/142] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:23.915771 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963fc3d-78d2-4317-a11e-9de63fbc31ea None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:23.916244 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963fc3d-78d2-4317-a11e-9de63fbc31ea None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:23.916664 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963fc3d-78d2-4317-a11e-9de63fbc31ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:23.935375 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d963fc3d-78d2-4317-a11e-9de63fbc31ea None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:23.936864 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d963fc3d-78d2-4317-a11e-9de63fbc31ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:24.020628 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 73/143] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:24.064228 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b7626-308d-4f58-bcb7-854718bcec4f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:24.206424 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:24.212103 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b7626-308d-4f58-bcb7-854718bcec4f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:24.256426 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854f21f-eda1-46d6-a0ad-3b622844770f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:24.257611 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854f21f-eda1-46d6-a0ad-3b622844770f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:24.258082 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854f21f-eda1-46d6-a0ad-3b622844770f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:24.258538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854f21f-eda1-46d6-a0ad-3b622844770f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:24.277065 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854f21f-eda1-46d6-a0ad-3b622844770f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:24.285183 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-6854f21f-eda1-46d6-a0ad-3b622844770f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:24.285183 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:24.285183 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:24.285183 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:24.285183 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:24.285183 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:24.285183 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:24.285183 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:24.285183 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:24.285183 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:24.285183 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:24.285183 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:24.285183 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:24.285183 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:24.285183 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:24.285183 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:24.286004 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:24.286004 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:24.286004 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:24.286004 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:24.286004 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:24.286004 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:24.286004 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:24.286004 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:24.286004 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:24.286004 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:24.286004 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:24.286004 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:24.286004 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:24.286004 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:24.286004 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:24.286004 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:24.286831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:24.286831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:24.286831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:24.286831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:24.286831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:24.286831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:24.286831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:24.286831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:24.286831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:24.286831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:24.286831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:24.286831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:42:24.289195 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 71/144] 10.222.0.85 () {56 vars in 1096 bytes} [Thu Jun 16 14:42:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:24.295499 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963fc3d-78d2-4317-a11e-9de63fbc31ea None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:24.439408 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:24.443580 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963fc3d-78d2-4317-a11e-9de63fbc31ea None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:24.483594 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e47f8-b297-4aa0-8881-3ef2b3e99e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:24.484238 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e47f8-b297-4aa0-8881-3ef2b3e99e44 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:24.484522 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e47f8-b297-4aa0-8881-3ef2b3e99e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:24.484798 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e47f8-b297-4aa0-8881-3ef2b3e99e44 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:24.485559 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e47f8-b297-4aa0-8881-3ef2b3e99e44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:24.485866 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e47f8-b297-4aa0-8881-3ef2b3e99e44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:24.487294 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e47f8-b297-4aa0-8881-3ef2b3e99e44 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:24.498147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 74/145] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:24.503385 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854f21f-eda1-46d6-a0ad-3b622844770f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:24.530539 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bb687-088a-41ce-b894-2abd22c91bb8 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:24.530861 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bb687-088a-41ce-b894-2abd22c91bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:24.531102 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bb687-088a-41ce-b894-2abd22c91bb8 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:24.532596 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 75/146] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:42:24.552852 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d781f9d-1855-4980-b3ee-ea70f45a9842 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:24.553151 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d781f9d-1855-4980-b3ee-ea70f45a9842 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:24.553421 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d781f9d-1855-4980-b3ee-ea70f45a9842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:24.577186 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-0d781f9d-1855-4980-b3ee-ea70f45a9842 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:24.578396 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-0d781f9d-1855-4980-b3ee-ea70f45a9842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:24.694208 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854f21f-eda1-46d6-a0ad-3b622844770f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:24.714035 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 76/147] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 16 14:42:24.747532 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774a639-1155-471a-9ea3-0acda3d99a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:24.748483 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774a639-1155-471a-9ea3-0acda3d99a18 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:24.748768 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774a639-1155-471a-9ea3-0acda3d99a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:24.749046 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774a639-1155-471a-9ea3-0acda3d99a18 None admin] PATH_INFO: `/v3/users/d15ddf8d03bc44188d865237c74fbf2f` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:24.752302 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d781f9d-1855-4980-b3ee-ea70f45a9842 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:24.755647 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774a639-1155-471a-9ea3-0acda3d99a18 None admin] RBAC: Authorizing `identity:get_user(user_id=d15ddf8d03bc44188d865237c74fbf2f)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:24.762190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774a639-1155-471a-9ea3-0acda3d99a18 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:24.764276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 72/148] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:24 2022] GET /identity/v3/users/d15ddf8d03bc44188d865237c74fbf2f => generated 247 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:24.770198 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774a639-1155-471a-9ea3-0acda3d99a18 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:24.832261 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:24.948762 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:24.960288 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774a639-1155-471a-9ea3-0acda3d99a18 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:24.967459 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d781f9d-1855-4980-b3ee-ea70f45a9842 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:25.027450 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d2c8b-a9f2-453b-9d6b-c3aa89e916be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:25.028073 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d2c8b-a9f2-453b-9d6b-c3aa89e916be None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:25.029433 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d2c8b-a9f2-453b-9d6b-c3aa89e916be None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:25.029433 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d2c8b-a9f2-453b-9d6b-c3aa89e916be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:25.041149 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009aeeaa-88dd-43b0-92ec-058766ac1ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:25.042186 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009aeeaa-88dd-43b0-92ec-058766ac1ddc None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:25.042476 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009aeeaa-88dd-43b0-92ec-058766ac1ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:25.042762 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009aeeaa-88dd-43b0-92ec-058766ac1ddc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:25.074061 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009aeeaa-88dd-43b0-92ec-058766ac1ddc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:25.082073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-009aeeaa-88dd-43b0-92ec-058766ac1ddc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:42:25.082073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:25.082073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:25.082073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:25.082073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:25.082073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:25.082073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:25.082073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:25.082073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:25.082073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:25.082073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:25.082073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:25.082073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:25.082073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:25.082073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:25.082073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:25.082922 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:25.082922 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:25.082922 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:25.082922 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:25.082922 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:25.082922 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:25.082922 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:25.082922 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:25.082922 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:25.082922 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:25.082922 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:25.082922 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:25.082922 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:25.082922 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:25.082922 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:25.082922 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:25.083704 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:25.083704 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:25.083704 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:25.083704 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:25.083704 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:25.083704 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:25.083704 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:25.083704 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:25.083704 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:25.083704 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:25.083704 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:42:25.083704 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:42:25.084838 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 77/149] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:25.091670 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009aeeaa-88dd-43b0-92ec-058766ac1ddc None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:25.177628 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d2c8b-a9f2-453b-9d6b-c3aa89e916be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:25.179156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d2c8b-a9f2-453b-9d6b-c3aa89e916be None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:25.240042 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:25.300836 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009aeeaa-88dd-43b0-92ec-058766ac1ddc None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:25.403249 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 73/150] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:25.408453 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d2c8b-a9f2-453b-9d6b-c3aa89e916be None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:25.422671 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d6319-4c14-4887-8ca2-4beab9c17f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:25.425514 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d6319-4c14-4887-8ca2-4beab9c17f9e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:25.425514 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d6319-4c14-4887-8ca2-4beab9c17f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:25.425514 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d6319-4c14-4887-8ca2-4beab9c17f9e None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:25.425514 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d6319-4c14-4887-8ca2-4beab9c17f9e None admin] RBAC: Adding query filter params (name=member) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:25.425514 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d6319-4c14-4887-8ca2-4beab9c17f9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:25.426907 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d6319-4c14-4887-8ca2-4beab9c17f9e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:25.457980 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 78/151] 10.222.0.85 () {56 vars in 1101 bytes} [Thu Jun 16 14:42:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:25.468980 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d6319-4c14-4887-8ca2-4beab9c17f9e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:25.512258 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:25.539909 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d2c8b-a9f2-453b-9d6b-c3aa89e916be None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:25.569322 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:25.577475 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815b5ff-4549-46aa-a8b3-69be680a46a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:25.578366 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815b5ff-4549-46aa-a8b3-69be680a46a5 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:25.578718 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815b5ff-4549-46aa-a8b3-69be680a46a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:25.579000 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815b5ff-4549-46aa-a8b3-69be680a46a5 None admin] PATH_INFO: `/v3/projects/379430b83a8643be9d1e7d6fee22017d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:25.580298 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c815b5ff-4549-46aa-a8b3-69be680a46a5 None admin] RBAC: Authorizing `identity:get_project(project_id=379430b83a8643be9d1e7d6fee22017d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:25.581804 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c815b5ff-4549-46aa-a8b3-69be680a46a5 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:25.584180 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 74/152] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:25 2022] GET /identity/v3/projects/379430b83a8643be9d1e7d6fee22017d => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:25.594375 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815b5ff-4549-46aa-a8b3-69be680a46a5 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:25.639917 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d6319-4c14-4887-8ca2-4beab9c17f9e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:25.687914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951da5a-6470-4a29-815b-a0453aa0278a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:25.688907 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951da5a-6470-4a29-815b-a0453aa0278a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:25.689294 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951da5a-6470-4a29-815b-a0453aa0278a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:25.689582 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951da5a-6470-4a29-815b-a0453aa0278a None admin] PATH_INFO: `/v3/users/1b2adb9bc22345fcbdd8189b5378b491` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:25.692900 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951da5a-6470-4a29-815b-a0453aa0278a None admin] RBAC: Authorizing `identity:get_user(user_id=1b2adb9bc22345fcbdd8189b5378b491)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:25.694419 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951da5a-6470-4a29-815b-a0453aa0278a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:25.696413 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 79/153] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:25 2022] GET /identity/v3/users/1b2adb9bc22345fcbdd8189b5378b491 => generated 275 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:25.709218 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815b5ff-4549-46aa-a8b3-69be680a46a5 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:25.722444 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951da5a-6470-4a29-815b-a0453aa0278a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:25.748632 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eaeda7-1159-42cf-b3cd-649d971ab009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:25.749321 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eaeda7-1159-42cf-b3cd-649d971ab009 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:25.749604 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eaeda7-1159-42cf-b3cd-649d971ab009 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:25.749874 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eaeda7-1159-42cf-b3cd-649d971ab009 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:25.750888 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eaeda7-1159-42cf-b3cd-649d971ab009 None admin] RBAC: Adding query filter params (role.id=95dcfa6c726a4d01a41d2642554fd338, scope.project.id=379430b83a8643be9d1e7d6fee22017d, user.id=d15ddf8d03bc44188d865237c74fbf2f) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:25.751205 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eaeda7-1159-42cf-b3cd-649d971ab009 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:25.752928 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eaeda7-1159-42cf-b3cd-649d971ab009 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:25.760456 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 75/154] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:42:25 2022] GET /identity/v3/role_assignments?user.id=d15ddf8d03bc44188d865237c74fbf2f&scope.project.id=379430b83a8643be9d1e7d6fee22017d&role.id=95dcfa6c726a4d01a41d2642554fd338 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:25.778909 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fcf2d-b973-4261-8488-766d2913f385 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:25.779240 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fcf2d-b973-4261-8488-766d2913f385 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:25.779473 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fcf2d-b973-4261-8488-766d2913f385 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:25.781067 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 76/155] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:42:25.787113 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92d6df-ec81-43be-9f15-3947ef0bed40 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:25.787486 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92d6df-ec81-43be-9f15-3947ef0bed40 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:25.787769 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92d6df-ec81-43be-9f15-3947ef0bed40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:25.810181 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3a92d6df-ec81-43be-9f15-3947ef0bed40 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:25.811385 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3a92d6df-ec81-43be-9f15-3947ef0bed40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:25.848023 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:25.911247 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 77/156] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:42:25.913359 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:25.926007 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951da5a-6470-4a29-815b-a0453aa0278a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:25.975395 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92d6df-ec81-43be-9f15-3947ef0bed40 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:25.998106 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095cd7ec-dcd7-402d-bca6-6bbbfe0ce49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:25.999120 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cd7ec-dcd7-402d-bca6-6bbbfe0ce49a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:25.999607 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cd7ec-dcd7-402d-bca6-6bbbfe0ce49a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:26.000121 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cd7ec-dcd7-402d-bca6-6bbbfe0ce49a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:26.127413 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92d6df-ec81-43be-9f15-3947ef0bed40 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:26.176205 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47948589-8c6d-4ab0-aa0e-bc970ec1d254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:26.177084 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47948589-8c6d-4ab0-aa0e-bc970ec1d254 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:26.177369 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47948589-8c6d-4ab0-aa0e-bc970ec1d254 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:26.177642 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47948589-8c6d-4ab0-aa0e-bc970ec1d254 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:26.194049 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095cd7ec-dcd7-402d-bca6-6bbbfe0ce49a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:26.195549 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095cd7ec-dcd7-402d-bca6-6bbbfe0ce49a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:26.204420 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47948589-8c6d-4ab0-aa0e-bc970ec1d254 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:26.212508 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-47948589-8c6d-4ab0-aa0e-bc970ec1d254 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:42:26.212508 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:26.212508 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:26.212508 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:26.212508 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:26.212508 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:26.212508 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:26.212508 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:26.212508 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:26.212508 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:26.212508 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:26.212508 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:26.212508 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:26.212508 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:26.212508 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:26.212508 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:26.213492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:26.213492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:26.213492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:26.213492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:26.213492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:26.213492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:26.213492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:26.213492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:26.213492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:26.213492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:26.213492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:26.213492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:26.213492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:26.213492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:26.213492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:26.213492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:26.214716 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:26.214716 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:26.214716 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:26.214716 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:26.214716 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:26.214716 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:26.214716 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:26.214716 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:26.214716 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:26.214716 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:26.214716 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:42:26.214716 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:42:26.214716 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 78/157] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:26.219738 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47948589-8c6d-4ab0-aa0e-bc970ec1d254 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:26.316276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:26.425908 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:26.438613 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47948589-8c6d-4ab0-aa0e-bc970ec1d254 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:26.482769 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 80/158] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 762 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:26.488723 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88af14c-01fb-4217-9290-52279989e266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:26.489476 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88af14c-01fb-4217-9290-52279989e266 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:26.489764 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88af14c-01fb-4217-9290-52279989e266 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:26.490101 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88af14c-01fb-4217-9290-52279989e266 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:26.490844 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88af14c-01fb-4217-9290-52279989e266 None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:26.491149 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88af14c-01fb-4217-9290-52279989e266 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:26.492580 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88af14c-01fb-4217-9290-52279989e266 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:26.501022 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095cd7ec-dcd7-402d-bca6-6bbbfe0ce49a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:26.507643 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 79/159] 10.222.0.85 () {56 vars in 1101 bytes} [Thu Jun 16 14:42:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:26.513887 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88af14c-01fb-4217-9290-52279989e266 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:26.684430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88af14c-01fb-4217-9290-52279989e266 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:26.710153 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:26.742319 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095cd7ec-dcd7-402d-bca6-6bbbfe0ce49a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:26.753773 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d163f63-f8bd-4f69-94a8-1928d06ca4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:26.755335 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d163f63-f8bd-4f69-94a8-1928d06ca4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:26.756130 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d163f63-f8bd-4f69-94a8-1928d06ca4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:26.756618 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d163f63-f8bd-4f69-94a8-1928d06ca4b4 None admin] PATH_INFO: `/v3/users/1b2adb9bc22345fcbdd8189b5378b491` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:26.758131 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d163f63-f8bd-4f69-94a8-1928d06ca4b4 None admin] RBAC: Authorizing `identity:get_user(user_id=1b2adb9bc22345fcbdd8189b5378b491)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:26.759819 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d163f63-f8bd-4f69-94a8-1928d06ca4b4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:26.762054 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 80/160] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:26 2022] GET /identity/v3/users/1b2adb9bc22345fcbdd8189b5378b491 => generated 275 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:26.763640 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45324dd-b09b-4ed9-8df2-243d4502579d None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:26.764138 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45324dd-b09b-4ed9-8df2-243d4502579d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:26.764620 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45324dd-b09b-4ed9-8df2-243d4502579d None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:26.766050 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 81/161] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:26.767728 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45324dd-b09b-4ed9-8df2-243d4502579d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:26.823697 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ec67d-f45d-42a1-8967-73bad91832be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:26.825031 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ec67d-f45d-42a1-8967-73bad91832be None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:26.825514 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ec67d-f45d-42a1-8967-73bad91832be None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:26.826016 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ec67d-f45d-42a1-8967-73bad91832be None admin] PATH_INFO: `/v3/projects/379430b83a8643be9d1e7d6fee22017d` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:26.828575 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ec67d-f45d-42a1-8967-73bad91832be None admin] RBAC: Authorizing `identity:get_project(project_id=379430b83a8643be9d1e7d6fee22017d)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:26.830377 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ec67d-f45d-42a1-8967-73bad91832be None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:26.832820 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 81/162] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:26 2022] GET /identity/v3/projects/379430b83a8643be9d1e7d6fee22017d => generated 298 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:26.836372 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6922bf9-88c2-4b7c-bcf3-041678cb1622 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:26.837980 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6922bf9-88c2-4b7c-bcf3-041678cb1622 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:26.838492 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6922bf9-88c2-4b7c-bcf3-041678cb1622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:26.872143 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-c6922bf9-88c2-4b7c-bcf3-041678cb1622 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:26.874422 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c6922bf9-88c2-4b7c-bcf3-041678cb1622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:26.946291 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45324dd-b09b-4ed9-8df2-243d4502579d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:26.968867 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:27.017860 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 82/163] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:27.018754 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6922bf9-88c2-4b7c-bcf3-041678cb1622 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:27.019087 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17f664-4f88-4379-975e-1fb241f5d912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:27.020419 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17f664-4f88-4379-975e-1fb241f5d912 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:27.021188 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17f664-4f88-4379-975e-1fb241f5d912 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:27.021674 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17f664-4f88-4379-975e-1fb241f5d912 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:27.180463 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:27.210784 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6922bf9-88c2-4b7c-bcf3-041678cb1622 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:27.231511 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b17f664-4f88-4379-975e-1fb241f5d912 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:27.233041 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b17f664-4f88-4379-975e-1fb241f5d912 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:27.263139 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628fb455-76f6-4dca-80b8-a9b9f2f68293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:27.263812 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fb455-76f6-4dca-80b8-a9b9f2f68293 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:27.264113 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fb455-76f6-4dca-80b8-a9b9f2f68293 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:27.264390 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fb455-76f6-4dca-80b8-a9b9f2f68293 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:27.265226 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628fb455-76f6-4dca-80b8-a9b9f2f68293 None admin] RBAC: Adding query filter params (role.id=26e7e900cf574eaabe4fcf886acb0c46, scope.project.id=379430b83a8643be9d1e7d6fee22017d, user.id=1b2adb9bc22345fcbdd8189b5378b491) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:27.265537 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628fb455-76f6-4dca-80b8-a9b9f2f68293 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:27.267006 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628fb455-76f6-4dca-80b8-a9b9f2f68293 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:27.273921 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 83/164] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:42:27 2022] GET /identity/v3/role_assignments?user.id=1b2adb9bc22345fcbdd8189b5378b491&scope.project.id=379430b83a8643be9d1e7d6fee22017d&role.id=26e7e900cf574eaabe4fcf886acb0c46 => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:27.274753 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628fb455-76f6-4dca-80b8-a9b9f2f68293 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:27.348542 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:27.482447 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628fb455-76f6-4dca-80b8-a9b9f2f68293 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:27.509439 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 82/165] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 742 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:27.511195 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fe735-a5f1-4a2e-9aa4-0260f4db4c55 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:27.511498 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fe735-a5f1-4a2e-9aa4-0260f4db4c55 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:27.513535 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fe735-a5f1-4a2e-9aa4-0260f4db4c55 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:27.513535 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 83/166] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:27.523926 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869f478-867f-493d-bc86-2852a390fa43 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:27.523926 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869f478-867f-493d-bc86-2852a390fa43 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:27.523926 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869f478-867f-493d-bc86-2852a390fa43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:27.562904 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d869f478-867f-493d-bc86-2852a390fa43 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:27.562904 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d869f478-867f-493d-bc86-2852a390fa43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:27.589933 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76613207-5ae4-4bd4-b163-1dfbff6c0a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:27.590771 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76613207-5ae4-4bd4-b163-1dfbff6c0a2b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:27.591055 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76613207-5ae4-4bd4-b163-1dfbff6c0a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:27.591323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76613207-5ae4-4bd4-b163-1dfbff6c0a2b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:27.618069 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76613207-5ae4-4bd4-b163-1dfbff6c0a2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:27.626689 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-76613207-5ae4-4bd4-b163-1dfbff6c0a2b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:42:27.626689 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:27.626689 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:27.626689 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:27.626689 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:27.626689 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:27.626689 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:27.626689 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:27.626689 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:27.626689 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:27.626689 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:27.626689 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:27.626689 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:27.626689 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:27.626689 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:27.626689 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:27.627976 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:27.627976 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:27.627976 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:27.627976 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:27.627976 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:27.627976 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:27.627976 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:27.627976 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:27.627976 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:27.627976 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:27.627976 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:27.627976 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:27.627976 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:27.627976 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:27.627976 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:27.627976 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:27.629501 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:27.629501 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:27.629501 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:27.629501 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:27.629501 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:27.629501 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:27.629501 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:27.629501 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:27.629501 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:27.629501 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:27.629501 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:42:27.629501 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:42:27.629501 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 84/167] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:27.639071 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76613207-5ae4-4bd4-b163-1dfbff6c0a2b None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:27.687710 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 84/168] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:27.688645 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869f478-867f-493d-bc86-2852a390fa43 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:27.703059 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:27.818118 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869f478-867f-493d-bc86-2852a390fa43 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:27.876650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f2671-30cd-440e-b2d4-475394631e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:27.877367 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f2671-30cd-440e-b2d4-475394631e4a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:27.877651 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f2671-30cd-440e-b2d4-475394631e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:27.877935 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f2671-30cd-440e-b2d4-475394631e4a None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:27.883582 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f2671-30cd-440e-b2d4-475394631e4a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:27.884128 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f2671-30cd-440e-b2d4-475394631e4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:27.885946 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f2671-30cd-440e-b2d4-475394631e4a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:27.906203 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 85/169] 10.222.0.85 () {56 vars in 1101 bytes} [Thu Jun 16 14:42:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:27.907103 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f2671-30cd-440e-b2d4-475394631e4a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:27.958358 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76613207-5ae4-4bd4-b163-1dfbff6c0a2b None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:27.960103 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:27.990766 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:28.006286 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7425e2-f576-49c2-8e34-a71bcfc7dfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:28.007314 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7425e2-f576-49c2-8e34-a71bcfc7dfa5 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:28.007736 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7425e2-f576-49c2-8e34-a71bcfc7dfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:28.008134 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7425e2-f576-49c2-8e34-a71bcfc7dfa5 None admin] PATH_INFO: `/v3/projects/40c5d95c76bd4f41bdbf33896179fa47` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:28.009505 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7425e2-f576-49c2-8e34-a71bcfc7dfa5 None admin] RBAC: Authorizing `identity:get_project(project_id=40c5d95c76bd4f41bdbf33896179fa47)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:28.011253 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7425e2-f576-49c2-8e34-a71bcfc7dfa5 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:28.013344 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 85/170] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:27 2022] GET /identity/v3/projects/40c5d95c76bd4f41bdbf33896179fa47 => generated 312 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:28.016687 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7425e2-f576-49c2-8e34-a71bcfc7dfa5 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:28.030598 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f2671-30cd-440e-b2d4-475394631e4a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:28.074955 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4f624-98a1-4302-8e8d-e7ba35a93e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:28.075714 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4f624-98a1-4302-8e8d-e7ba35a93e76 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:28.076030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4f624-98a1-4302-8e8d-e7ba35a93e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:28.076311 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4f624-98a1-4302-8e8d-e7ba35a93e76 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:28.092569 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4f624-98a1-4302-8e8d-e7ba35a93e76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:28.103201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-bed4f624-98a1-4302-8e8d-e7ba35a93e76 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:42:28.103201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:28.103201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:28.103201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:28.103201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:28.103201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:28.103201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:28.103201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:28.103201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:28.103201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:28.103201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:28.103201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:28.103201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:28.103201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:28.103201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:28.103201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:28.105753 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:28.105753 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:28.105753 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:28.105753 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:28.105753 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:28.105753 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:28.105753 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:28.105753 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:28.105753 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:28.105753 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:28.105753 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:28.105753 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:28.105753 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:28.105753 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:28.105753 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:28.105753 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:28.107941 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:28.107941 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:28.107941 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:28.107941 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:28.107941 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:28.107941 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:28.107941 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:28.107941 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:28.107941 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:28.107941 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:28.107941 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:42:28.107941 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:42:28.107941 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 86/171] 10.222.0.85 () {56 vars in 1114 bytes} [Thu Jun 16 14:42:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:28.107941 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a3e28-9561-435c-94f6-c862bb982a28 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:28.109942 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a3e28-9561-435c-94f6-c862bb982a28 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:28.109942 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a3e28-9561-435c-94f6-c862bb982a28 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:28.109942 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 87/172] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:28.109942 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a3e28-9561-435c-94f6-c862bb982a28 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:28.139267 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7425e2-f576-49c2-8e34-a71bcfc7dfa5 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:28.177754 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8629bb3-c33f-4b6d-b0e9-f13eba0e47b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:28.178648 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8629bb3-c33f-4b6d-b0e9-f13eba0e47b0 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:28.178934 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8629bb3-c33f-4b6d-b0e9-f13eba0e47b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:28.179213 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8629bb3-c33f-4b6d-b0e9-f13eba0e47b0 None admin] PATH_INFO: `/v3/users/567aaa801cbd42ee9f0e33012955d7e0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:28.180468 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8629bb3-c33f-4b6d-b0e9-f13eba0e47b0 None admin] RBAC: Authorizing `identity:get_user(user_id=567aaa801cbd42ee9f0e33012955d7e0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:28.181944 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8629bb3-c33f-4b6d-b0e9-f13eba0e47b0 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:28.183843 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 86/173] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:28 2022] GET /identity/v3/users/567aaa801cbd42ee9f0e33012955d7e0 => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:28.184479 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8629bb3-c33f-4b6d-b0e9-f13eba0e47b0 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:28.226158 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:28.230165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a3e28-9561-435c-94f6-c862bb982a28 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:28.273545 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:28.281300 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d88229-99ff-406b-a195-5d72e57847a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:28.282375 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d88229-99ff-406b-a195-5d72e57847a4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:28.282673 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d88229-99ff-406b-a195-5d72e57847a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:28.282936 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d88229-99ff-406b-a195-5d72e57847a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:28.283786 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d88229-99ff-406b-a195-5d72e57847a4 None admin] RBAC: Adding query filter params (role.id=26e7e900cf574eaabe4fcf886acb0c46, scope.project.id=40c5d95c76bd4f41bdbf33896179fa47, user.id=1b2adb9bc22345fcbdd8189b5378b491) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:28.284133 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d88229-99ff-406b-a195-5d72e57847a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:28.285618 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d88229-99ff-406b-a195-5d72e57847a4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:28.292941 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 88/174] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:42:28 2022] GET /identity/v3/role_assignments?user.id=1b2adb9bc22345fcbdd8189b5378b491&scope.project.id=40c5d95c76bd4f41bdbf33896179fa47&role.id=26e7e900cf574eaabe4fcf886acb0c46 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:28.303935 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8629bb3-c33f-4b6d-b0e9-f13eba0e47b0 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:28.306116 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45302775-a99f-4496-9916-c41ddf8f1b25 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:28.307656 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45302775-a99f-4496-9916-c41ddf8f1b25 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:28.308189 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45302775-a99f-4496-9916-c41ddf8f1b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:28.328243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-45302775-a99f-4496-9916-c41ddf8f1b25 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:28.329394 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-45302775-a99f-4496-9916-c41ddf8f1b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:28.347017 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92340aa0-d32d-442c-870d-ce9417a2ea56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:28.347830 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92340aa0-d32d-442c-870d-ce9417a2ea56 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:28.348152 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92340aa0-d32d-442c-870d-ce9417a2ea56 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:28.348674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92340aa0-d32d-442c-870d-ce9417a2ea56 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:28.349913 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92340aa0-d32d-442c-870d-ce9417a2ea56 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:28.350237 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92340aa0-d32d-442c-870d-ce9417a2ea56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:28.351706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92340aa0-d32d-442c-870d-ce9417a2ea56 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:28.370204 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 87/175] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:28.370204 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b9af6-068f-4a16-ae05-d8532057a997 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:28.370204 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b9af6-068f-4a16-ae05-d8532057a997 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:28.370204 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b9af6-068f-4a16-ae05-d8532057a997 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:28.370204 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 88/176] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:28.370204 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b9af6-068f-4a16-ae05-d8532057a997 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:28.418521 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 89/177] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:28.424342 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa973df2-b33b-4fce-91a3-53199e6acff3 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:28.424342 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa973df2-b33b-4fce-91a3-53199e6acff3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:28.424342 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa973df2-b33b-4fce-91a3-53199e6acff3 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:28.424342 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 90/178] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:28.424342 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa973df2-b33b-4fce-91a3-53199e6acff3 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:28.492956 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:28.498650 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b9af6-068f-4a16-ae05-d8532057a997 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:28.539901 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ea546-7d92-41ac-9039-0121d08f23ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:28.543908 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ea546-7d92-41ac-9039-0121d08f23ea None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:28.543908 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ea546-7d92-41ac-9039-0121d08f23ea None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:28.543908 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ea546-7d92-41ac-9039-0121d08f23ea None admin] PATH_INFO: `/v3/projects/379430b83a8643be9d1e7d6fee22017d` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:28.544188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ea546-7d92-41ac-9039-0121d08f23ea None admin] RBAC: Authorizing `identity:get_project(project_id=379430b83a8643be9d1e7d6fee22017d)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:28.545615 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ea546-7d92-41ac-9039-0121d08f23ea None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:28.547631 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 89/179] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:28 2022] GET /identity/v3/projects/379430b83a8643be9d1e7d6fee22017d => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:28.549050 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1621017-3eb3-4aef-ab6a-6e5b927fb0b2 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:28.549325 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1621017-3eb3-4aef-ab6a-6e5b927fb0b2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:28.549600 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1621017-3eb3-4aef-ab6a-6e5b927fb0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:28.569546 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b1621017-3eb3-4aef-ab6a-6e5b927fb0b2 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:28.570811 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b1621017-3eb3-4aef-ab6a-6e5b927fb0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:28.587165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa973df2-b33b-4fce-91a3-53199e6acff3 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:28.614325 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:28.625740 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5a71f-5827-44d7-8818-4492b35ba218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:28.626644 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5a71f-5827-44d7-8818-4492b35ba218 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:28.626925 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5a71f-5827-44d7-8818-4492b35ba218 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:28.627202 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5a71f-5827-44d7-8818-4492b35ba218 None admin] PATH_INFO: `/v3/users/1b2adb9bc22345fcbdd8189b5378b491` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:28.628503 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5a71f-5827-44d7-8818-4492b35ba218 None admin] RBAC: Authorizing `identity:get_user(user_id=1b2adb9bc22345fcbdd8189b5378b491)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:28.629957 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5a71f-5827-44d7-8818-4492b35ba218 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:28.631635 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 91/180] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:28 2022] GET /identity/v3/users/1b2adb9bc22345fcbdd8189b5378b491 => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:28.632940 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5467b-e69a-487b-8e58-98da250e9b0f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:28.633230 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5467b-e69a-487b-8e58-98da250e9b0f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:28.633513 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5467b-e69a-487b-8e58-98da250e9b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:28.649433 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 90/181] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:28.650379 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1621017-3eb3-4aef-ab6a-6e5b927fb0b2 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:28.651730 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-46e5467b-e69a-487b-8e58-98da250e9b0f None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:28.652972 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-46e5467b-e69a-487b-8e58-98da250e9b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:28.723925 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 92/182] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:28.724895 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5467b-e69a-487b-8e58-98da250e9b0f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:28.765528 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:28.769383 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1621017-3eb3-4aef-ab6a-6e5b927fb0b2 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:28.804602 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4aae6e-3fce-43f0-840e-c8660166814c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:28.805407 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4aae6e-3fce-43f0-840e-c8660166814c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:28.805687 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4aae6e-3fce-43f0-840e-c8660166814c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:28.805962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4aae6e-3fce-43f0-840e-c8660166814c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:28.816347 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4aae6e-3fce-43f0-840e-c8660166814c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:28.824101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-ad4aae6e-3fce-43f0-840e-c8660166814c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:28.824101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:28.824101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:28.824101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:28.824101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:28.824101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:28.824101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:28.824101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:28.824101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:28.824101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:28.824101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:28.824101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:28.824101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:28.824101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:28.824101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:28.824101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:28.825090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:28.825090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:28.825090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:28.825090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:28.825090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:28.825090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:28.825090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:28.825090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:28.825090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:28.825090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:28.825090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:28.825090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:28.825090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:28.825090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:28.825090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:28.825090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:28.825884 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:28.825884 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:28.825884 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:28.825884 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:28.825884 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:28.825884 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:28.825884 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:28.825884 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:28.825884 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:28.825884 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:28.825884 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:28.825884 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:42:28.825884 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 91/183] 10.222.0.85 () {56 vars in 1096 bytes} [Thu Jun 16 14:42:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:28.826918 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5467b-e69a-487b-8e58-98da250e9b0f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:28.826993 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4aae6e-3fce-43f0-840e-c8660166814c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:28.850717 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:28.862372 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0b42f-5001-4650-b1ee-02f8e4c3ab0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:28.863386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0b42f-5001-4650-b1ee-02f8e4c3ab0b None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:28.863733 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0b42f-5001-4650-b1ee-02f8e4c3ab0b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:28.864113 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0b42f-5001-4650-b1ee-02f8e4c3ab0b None admin] PATH_INFO: `/v3/projects/379430b83a8643be9d1e7d6fee22017d/users/567aaa801cbd42ee9f0e33012955d7e0/roles/d7118e244cb94310a267cf9a9b5bbfd4` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:28.866231 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a0b42f-5001-4650-b1ee-02f8e4c3ab0b None admin] RBAC: Authorizing `identity:create_grant(project_id=379430b83a8643be9d1e7d6fee22017d, user_id=567aaa801cbd42ee9f0e33012955d7e0, role_id=d7118e244cb94310a267cf9a9b5bbfd4)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:28.867698 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a0b42f-5001-4650-b1ee-02f8e4c3ab0b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:28.881338 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 93/184] 10.222.0.85 () {58 vars in 1439 bytes} [Thu Jun 16 14:42:28 2022] PUT /identity/v3/projects/379430b83a8643be9d1e7d6fee22017d/users/567aaa801cbd42ee9f0e33012955d7e0/roles/d7118e244cb94310a267cf9a9b5bbfd4 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:42:28.881897 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0b42f-5001-4650-b1ee-02f8e4c3ab0b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:28.939112 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4aae6e-3fce-43f0-840e-c8660166814c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:28.978197 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a0751-c4f3-4b45-a60d-281634c29d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:28.978871 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a0751-c4f3-4b45-a60d-281634c29d26 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:28.979154 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a0751-c4f3-4b45-a60d-281634c29d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:28.979603 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a0751-c4f3-4b45-a60d-281634c29d26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:29.001165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0b42f-5001-4650-b1ee-02f8e4c3ab0b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:29.009621 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:29.041065 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ec41b-49f2-447a-8230-512989d45ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:29.042126 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ec41b-49f2-447a-8230-512989d45ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:29.042519 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ec41b-49f2-447a-8230-512989d45ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:29.043004 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ec41b-49f2-447a-8230-512989d45ff9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:29.057993 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ec41b-49f2-447a-8230-512989d45ff9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:29.063653 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a0751-c4f3-4b45-a60d-281634c29d26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:29.065189 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a0751-c4f3-4b45-a60d-281634c29d26 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:29.066294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-ab4ec41b-49f2-447a-8230-512989d45ff9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:42:29.066294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:29.066294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:29.066294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:29.066294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:29.066294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:29.066294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:29.066294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:29.066294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:29.066294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:29.066294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:29.066294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:29.066294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:29.066294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:29.066294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:29.066294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:29.067158 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:29.067158 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:29.067158 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:29.067158 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:29.067158 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:29.067158 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:29.067158 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:29.067158 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:29.067158 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:29.067158 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:29.067158 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:29.067158 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:29.067158 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:29.067158 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:29.067158 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:29.067158 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:29.068142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:29.068142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:29.068142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:29.068142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:29.068142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:29.068142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:29.068142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:29.068142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:29.068142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:29.068142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:29.068142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:42:29.068142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:42:29.068142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 94/185] 10.222.0.85 () {56 vars in 1114 bytes} [Thu Jun 16 14:42:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:29.068801 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ec41b-49f2-447a-8230-512989d45ff9 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:29.116158 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:29.176342 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ec41b-49f2-447a-8230-512989d45ff9 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:29.183910 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 92/186] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:29.185152 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a0751-c4f3-4b45-a60d-281634c29d26 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:29.214765 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58653f-b8e3-4c7d-801e-23f89e17e8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:29.215484 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58653f-b8e3-4c7d-801e-23f89e17e8d4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:29.215887 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58653f-b8e3-4c7d-801e-23f89e17e8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:29.216158 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58653f-b8e3-4c7d-801e-23f89e17e8d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:29.217358 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58653f-b8e3-4c7d-801e-23f89e17e8d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:29.218823 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58653f-b8e3-4c7d-801e-23f89e17e8d4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:29.220701 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 95/187] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:29.221271 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58653f-b8e3-4c7d-801e-23f89e17e8d4 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:29.251987 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:29.296928 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a0751-c4f3-4b45-a60d-281634c29d26 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:29.334361 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58653f-b8e3-4c7d-801e-23f89e17e8d4 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:29.336500 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0cf47-63cd-45f1-9071-ec456e012518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:29.337053 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0cf47-63cd-45f1-9071-ec456e012518 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:29.337401 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0cf47-63cd-45f1-9071-ec456e012518 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:29.337751 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0cf47-63cd-45f1-9071-ec456e012518 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:29.338509 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0cf47-63cd-45f1-9071-ec456e012518 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:29.339142 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0cf47-63cd-45f1-9071-ec456e012518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:29.340594 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0cf47-63cd-45f1-9071-ec456e012518 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:29.358300 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 93/188] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:29.358488 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:29.358567 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0cf47-63cd-45f1-9071-ec456e012518 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:29.382536 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f53ba-ccb2-44d9-b696-a1a6669f2137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:29.383522 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f53ba-ccb2-44d9-b696-a1a6669f2137 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:29.384019 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f53ba-ccb2-44d9-b696-a1a6669f2137 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:29.384374 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f53ba-ccb2-44d9-b696-a1a6669f2137 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:29.385139 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f53ba-ccb2-44d9-b696-a1a6669f2137 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:29.385553 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f53ba-ccb2-44d9-b696-a1a6669f2137 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:29.387032 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f53ba-ccb2-44d9-b696-a1a6669f2137 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:29.395490 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 96/189] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:29.396339 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f53ba-ccb2-44d9-b696-a1a6669f2137 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:29.464298 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0cf47-63cd-45f1-9071-ec456e012518 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:29.484844 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:29.503451 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8671a89-45d0-4fd2-b243-63cac0701774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:29.504371 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8671a89-45d0-4fd2-b243-63cac0701774 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:29.504654 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8671a89-45d0-4fd2-b243-63cac0701774 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:29.505051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8671a89-45d0-4fd2-b243-63cac0701774 None admin] PATH_INFO: `/v3/projects/379430b83a8643be9d1e7d6fee22017d` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:29.505470 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f53ba-ccb2-44d9-b696-a1a6669f2137 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:29.506312 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8671a89-45d0-4fd2-b243-63cac0701774 None admin] RBAC: Authorizing `identity:get_project(project_id=379430b83a8643be9d1e7d6fee22017d)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:29.508793 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8671a89-45d0-4fd2-b243-63cac0701774 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:29.515738 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 94/190] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:29 2022] GET /identity/v3/projects/379430b83a8643be9d1e7d6fee22017d => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:29.515738 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8671a89-45d0-4fd2-b243-63cac0701774 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:29.544557 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe67ef0-2bc7-4d39-8d24-e2fd4c8a0650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:29.545264 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe67ef0-2bc7-4d39-8d24-e2fd4c8a0650 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:29.545853 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe67ef0-2bc7-4d39-8d24-e2fd4c8a0650 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:29.546137 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe67ef0-2bc7-4d39-8d24-e2fd4c8a0650 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:29.547017 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe67ef0-2bc7-4d39-8d24-e2fd4c8a0650 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:29.549463 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe67ef0-2bc7-4d39-8d24-e2fd4c8a0650 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:29.574873 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 97/191] 10.222.0.85 () {60 vars in 1132 bytes} [Thu Jun 16 14:42:29 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:42:29.575531 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe67ef0-2bc7-4d39-8d24-e2fd4c8a0650 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:29.617770 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:29.657150 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8671a89-45d0-4fd2-b243-63cac0701774 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:29.697191 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe67ef0-2bc7-4d39-8d24-e2fd4c8a0650 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:29.698871 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43665089-66ab-4341-bf59-1c87487bf451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:29.700069 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43665089-66ab-4341-bf59-1c87487bf451 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:29.700567 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43665089-66ab-4341-bf59-1c87487bf451 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:29.701041 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43665089-66ab-4341-bf59-1c87487bf451 None admin] PATH_INFO: `/v3/users/42d4912ed3ee499b87ee17a6c4d89820` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:29.719063 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43665089-66ab-4341-bf59-1c87487bf451 None admin] RBAC: Authorizing `identity:get_user(user_id=42d4912ed3ee499b87ee17a6c4d89820)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:29.721184 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43665089-66ab-4341-bf59-1c87487bf451 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:29.723662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 95/192] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:29 2022] GET /identity/v3/users/42d4912ed3ee499b87ee17a6c4d89820 => generated 283 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:29.725012 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43665089-66ab-4341-bf59-1c87487bf451 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:29.742969 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77195877-9dce-45ca-8402-b1951ced18c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:29.744017 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77195877-9dce-45ca-8402-b1951ced18c7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:29.744314 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77195877-9dce-45ca-8402-b1951ced18c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:29.744592 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77195877-9dce-45ca-8402-b1951ced18c7 None admin] PATH_INFO: `/v3/users/42d4912ed3ee499b87ee17a6c4d89820` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:29.746217 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77195877-9dce-45ca-8402-b1951ced18c7 None admin] RBAC: Authorizing `identity:get_user(user_id=42d4912ed3ee499b87ee17a6c4d89820)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:29.748899 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77195877-9dce-45ca-8402-b1951ced18c7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:29.752276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 98/193] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:29 2022] GET /identity/v3/users/42d4912ed3ee499b87ee17a6c4d89820 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:29.753347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77195877-9dce-45ca-8402-b1951ced18c7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:29.785886 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:29.872539 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43665089-66ab-4341-bf59-1c87487bf451 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:29.896300 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:29.900519 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77195877-9dce-45ca-8402-b1951ced18c7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:29.926160 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b71deb-215b-43cf-a579-40cffbbd89bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:29.927078 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b71deb-215b-43cf-a579-40cffbbd89bb None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:29.927606 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b71deb-215b-43cf-a579-40cffbbd89bb None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:29.928091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b71deb-215b-43cf-a579-40cffbbd89bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:29.929097 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b71deb-215b-43cf-a579-40cffbbd89bb None admin] RBAC: Adding query filter params (role.id=2f7fa8924ea9447aab26981f0329ad43, scope.project.id=379430b83a8643be9d1e7d6fee22017d, user.id=1b2adb9bc22345fcbdd8189b5378b491) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:29.929556 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b71deb-215b-43cf-a579-40cffbbd89bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:29.933664 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b71deb-215b-43cf-a579-40cffbbd89bb None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:29.941748 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 96/194] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:42:29 2022] GET /identity/v3/role_assignments?user.id=1b2adb9bc22345fcbdd8189b5378b491&scope.project.id=379430b83a8643be9d1e7d6fee22017d&role.id=2f7fa8924ea9447aab26981f0329ad43 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:29.942900 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b71deb-215b-43cf-a579-40cffbbd89bb None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:29.951935 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea3f73-eeb6-4c4b-9bf9-f195e5f26561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:29.952687 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea3f73-eeb6-4c4b-9bf9-f195e5f26561 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:29.953020 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea3f73-eeb6-4c4b-9bf9-f195e5f26561 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:29.953304 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea3f73-eeb6-4c4b-9bf9-f195e5f26561 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:30.085867 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea3f73-eeb6-4c4b-9bf9-f195e5f26561 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:30.087426 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea3f73-eeb6-4c4b-9bf9-f195e5f26561 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:30.134318 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b71deb-215b-43cf-a579-40cffbbd89bb None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:30.162091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:30.214155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c096f-c937-4d0d-9866-b831c497a73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:30.214499 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c096f-c937-4d0d-9866-b831c497a73e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:30.214738 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c096f-c937-4d0d-9866-b831c497a73e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:30.215010 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c096f-c937-4d0d-9866-b831c497a73e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:30.223143 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:30.228060 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 99/195] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:30.236838 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea3f73-eeb6-4c4b-9bf9-f195e5f26561 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:30.362933 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c096f-c937-4d0d-9866-b831c497a73e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:30.365211 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c096f-c937-4d0d-9866-b831c497a73e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:30.378626 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea3f73-eeb6-4c4b-9bf9-f195e5f26561 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:30.484180 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781dc44d-7092-423d-b309-4d93f0fd0d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:30.485225 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781dc44d-7092-423d-b309-4d93f0fd0d65 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:30.485645 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781dc44d-7092-423d-b309-4d93f0fd0d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:30.488141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781dc44d-7092-423d-b309-4d93f0fd0d65 None admin] PATH_INFO: `/v3/projects/2626df1e7e3e430790b7db426c06948f` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:30.488780 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781dc44d-7092-423d-b309-4d93f0fd0d65 None admin] RBAC: Authorizing `identity:get_project(project_id=2626df1e7e3e430790b7db426c06948f)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:30.490287 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781dc44d-7092-423d-b309-4d93f0fd0d65 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:30.492103 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 100/196] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:30 2022] GET /identity/v3/projects/2626df1e7e3e430790b7db426c06948f => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:30.501589 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781dc44d-7092-423d-b309-4d93f0fd0d65 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:30.575277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 97/197] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:30.580966 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c096f-c937-4d0d-9866-b831c497a73e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:30.604351 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:30.623637 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:30.662646 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781dc44d-7092-423d-b309-4d93f0fd0d65 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:30.700173 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad8fd0-0f13-43f5-b303-72af5052e74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:30.700851 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad8fd0-0f13-43f5-b303-72af5052e74a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:30.701137 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad8fd0-0f13-43f5-b303-72af5052e74a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:30.701413 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad8fd0-0f13-43f5-b303-72af5052e74a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:30.702256 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad8fd0-0f13-43f5-b303-72af5052e74a None admin] RBAC: Adding query filter params (role.id=95dcfa6c726a4d01a41d2642554fd338, scope.project.id=2626df1e7e3e430790b7db426c06948f, user.id=42d4912ed3ee499b87ee17a6c4d89820) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:30.702574 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad8fd0-0f13-43f5-b303-72af5052e74a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:30.704082 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad8fd0-0f13-43f5-b303-72af5052e74a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:30.710720 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 101/198] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:42:30 2022] GET /identity/v3/role_assignments?user.id=42d4912ed3ee499b87ee17a6c4d89820&scope.project.id=2626df1e7e3e430790b7db426c06948f&role.id=95dcfa6c726a4d01a41d2642554fd338 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:30.753462 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c096f-c937-4d0d-9866-b831c497a73e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:30.815968 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32e922-1f9b-4507-8863-c1f0b5dac48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:30.816873 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32e922-1f9b-4507-8863-c1f0b5dac48f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:30.817141 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32e922-1f9b-4507-8863-c1f0b5dac48f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:30.817410 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32e922-1f9b-4507-8863-c1f0b5dac48f None admin] PATH_INFO: `/v3/projects/2626df1e7e3e430790b7db426c06948f` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:30.825002 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32e922-1f9b-4507-8863-c1f0b5dac48f None admin] RBAC: Authorizing `identity:get_project(project_id=2626df1e7e3e430790b7db426c06948f)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:30.826510 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32e922-1f9b-4507-8863-c1f0b5dac48f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:30.829169 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 98/199] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:30 2022] GET /identity/v3/projects/2626df1e7e3e430790b7db426c06948f => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:30.836311 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad8fd0-0f13-43f5-b303-72af5052e74a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:30.967896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad8fd0-0f13-43f5-b303-72af5052e74a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:31.001023 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:31.007897 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1551be-118c-4035-a581-cad459bc3338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:31.008517 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1551be-118c-4035-a581-cad459bc3338 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:31.008799 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1551be-118c-4035-a581-cad459bc3338 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:31.009075 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1551be-118c-4035-a581-cad459bc3338 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:31.009959 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1551be-118c-4035-a581-cad459bc3338 None admin] RBAC: Adding query filter params (role.id=2f7fa8924ea9447aab26981f0329ad43, scope.project.id=2626df1e7e3e430790b7db426c06948f, user.id=42d4912ed3ee499b87ee17a6c4d89820) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:31.010269 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1551be-118c-4035-a581-cad459bc3338 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:31.012124 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1551be-118c-4035-a581-cad459bc3338 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:31.018912 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 102/200] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:42:30 2022] GET /identity/v3/role_assignments?user.id=42d4912ed3ee499b87ee17a6c4d89820&scope.project.id=2626df1e7e3e430790b7db426c06948f&role.id=2f7fa8924ea9447aab26981f0329ad43 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:31.438384 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cafe7-0d9f-429b-9cc7-422032f5a77c None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:31.439054 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cafe7-0d9f-429b-9cc7-422032f5a77c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:31.439528 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cafe7-0d9f-429b-9cc7-422032f5a77c None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:31.441444 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 99/201] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:31.446393 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49d0f6-9264-4289-add5-7adc4a702461 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:31.447473 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49d0f6-9264-4289-add5-7adc4a702461 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:31.447995 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49d0f6-9264-4289-add5-7adc4a702461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:31.471790 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ee49d0f6-9264-4289-add5-7adc4a702461 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:31.473037 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ee49d0f6-9264-4289-add5-7adc4a702461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:31.566308 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 103/202] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:31.603625 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cafe7-0d9f-429b-9cc7-422032f5a77c None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:31.717711 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:31.749453 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cafe7-0d9f-429b-9cc7-422032f5a77c None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:31.796718 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87b889-e408-4ddd-b053-2a55323a7e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:31.797537 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87b889-e408-4ddd-b053-2a55323a7e26 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:31.797816 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87b889-e408-4ddd-b053-2a55323a7e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:31.798091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87b889-e408-4ddd-b053-2a55323a7e26 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:31.816781 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87b889-e408-4ddd-b053-2a55323a7e26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:31.824784 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-0d87b889-e408-4ddd-b053-2a55323a7e26 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:42:31.824784 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:31.824784 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:31.824784 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:31.824784 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:31.824784 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:31.824784 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:31.824784 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:31.824784 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:31.824784 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:31.824784 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:31.824784 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:31.824784 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:31.824784 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:31.824784 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:31.824784 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:31.825649 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:31.825649 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:31.825649 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:31.825649 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:31.825649 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:31.825649 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:31.825649 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:31.825649 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:31.825649 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:31.825649 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:31.825649 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:31.825649 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:31.825649 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:31.825649 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:31.825649 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:31.825649 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:31.826885 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:31.826885 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:31.826885 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:31.826885 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:31.826885 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:31.826885 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:31.826885 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:31.826885 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:31.826885 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:31.826885 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:31.826885 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:42:31.826885 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:42:31.826885 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 100/203] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:31.831902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49d0f6-9264-4289-add5-7adc4a702461 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:31.943744 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49d0f6-9264-4289-add5-7adc4a702461 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:31.977791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:31.995919 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97428d-394d-431d-bafd-144f38473da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:31.996607 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97428d-394d-431d-bafd-144f38473da3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:31.996890 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97428d-394d-431d-bafd-144f38473da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:31.997164 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97428d-394d-431d-bafd-144f38473da3 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:31.997925 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97428d-394d-431d-bafd-144f38473da3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:31.998229 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97428d-394d-431d-bafd-144f38473da3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:31.999617 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97428d-394d-431d-bafd-144f38473da3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:32.008932 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 104/204] 10.222.0.85 () {56 vars in 1101 bytes} [Thu Jun 16 14:42:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:32.014760 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87b889-e408-4ddd-b053-2a55323a7e26 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:32.143584 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87b889-e408-4ddd-b053-2a55323a7e26 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:32.183448 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36455e4b-72bf-4191-8d35-01596e994a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:32.184373 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36455e4b-72bf-4191-8d35-01596e994a5e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:32.184659 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36455e4b-72bf-4191-8d35-01596e994a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:32.184937 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36455e4b-72bf-4191-8d35-01596e994a5e None admin] PATH_INFO: `/v3/users/567aaa801cbd42ee9f0e33012955d7e0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:32.186156 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36455e4b-72bf-4191-8d35-01596e994a5e None admin] RBAC: Authorizing `identity:get_user(user_id=567aaa801cbd42ee9f0e33012955d7e0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:32.187642 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36455e4b-72bf-4191-8d35-01596e994a5e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:32.189336 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 101/205] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:32 2022] GET /identity/v3/users/567aaa801cbd42ee9f0e33012955d7e0 => generated 289 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:32.195006 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97428d-394d-431d-bafd-144f38473da3 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:32.346442 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97428d-394d-431d-bafd-144f38473da3 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:32.397679 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b52a4a-12a0-49f6-9900-2d030024cfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:32.398344 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b52a4a-12a0-49f6-9900-2d030024cfdb None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:32.398619 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b52a4a-12a0-49f6-9900-2d030024cfdb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:32.398894 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b52a4a-12a0-49f6-9900-2d030024cfdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:32.483010 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:32.499830 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b52a4a-12a0-49f6-9900-2d030024cfdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:32.501510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b52a4a-12a0-49f6-9900-2d030024cfdb None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:32.653475 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 105/206] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:32.659451 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36455e4b-72bf-4191-8d35-01596e994a5e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:32.678981 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:32.815641 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36455e4b-72bf-4191-8d35-01596e994a5e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:32.823501 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba88db8-efee-4f66-a78c-4a5259d87ef8 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:32.824393 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba88db8-efee-4f66-a78c-4a5259d87ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:32.824871 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba88db8-efee-4f66-a78c-4a5259d87ef8 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:32.830277 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 106/207] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:32.832028 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415afc1-a17e-4739-9ee3-f302e15e62a5 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:32.832509 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415afc1-a17e-4739-9ee3-f302e15e62a5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:32.833082 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415afc1-a17e-4739-9ee3-f302e15e62a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:32.864804 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-7415afc1-a17e-4739-9ee3-f302e15e62a5 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:32.867063 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7415afc1-a17e-4739-9ee3-f302e15e62a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:32.868457 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e23db-d845-411d-b980-be6308f294ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:32.869584 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e23db-d845-411d-b980-be6308f294ca None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:32.870081 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e23db-d845-411d-b980-be6308f294ca None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:32.870864 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e23db-d845-411d-b980-be6308f294ca None admin] PATH_INFO: `/v3/projects/379430b83a8643be9d1e7d6fee22017d` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:32.872775 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e23db-d845-411d-b980-be6308f294ca None admin] RBAC: Authorizing `identity:get_project(project_id=379430b83a8643be9d1e7d6fee22017d)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:32.877184 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e23db-d845-411d-b980-be6308f294ca None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:32.879312 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 102/208] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:32 2022] GET /identity/v3/projects/379430b83a8643be9d1e7d6fee22017d => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:32.886033 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e23db-d845-411d-b980-be6308f294ca None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:33.001070 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 107/209] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:33.003365 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0da6e-c5b1-4783-aaee-1bfe408248e3 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:33.003656 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0da6e-c5b1-4783-aaee-1bfe408248e3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:33.003953 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0da6e-c5b1-4783-aaee-1bfe408248e3 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:33.005553 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 108/210] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:33.011587 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f36dc-92a7-44a5-9374-8a41a7e70b46 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:33.011929 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f36dc-92a7-44a5-9374-8a41a7e70b46 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:33.012187 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f36dc-92a7-44a5-9374-8a41a7e70b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:33.015425 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:33.032663 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-455f36dc-92a7-44a5-9374-8a41a7e70b46 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:33.034522 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-455f36dc-92a7-44a5-9374-8a41a7e70b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:33.047361 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e23db-d845-411d-b980-be6308f294ca None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:33.051774 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:33.087545 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263e1fd-8abb-401a-9827-98191110a4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:33.088726 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263e1fd-8abb-401a-9827-98191110a4cf None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:33.089261 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263e1fd-8abb-401a-9827-98191110a4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:33.089869 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263e1fd-8abb-401a-9827-98191110a4cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:33.090829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263e1fd-8abb-401a-9827-98191110a4cf None admin] RBAC: Adding query filter params (role.id=d7118e244cb94310a267cf9a9b5bbfd4, scope.project.id=379430b83a8643be9d1e7d6fee22017d, user.id=567aaa801cbd42ee9f0e33012955d7e0) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:33.091242 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263e1fd-8abb-401a-9827-98191110a4cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:33.092823 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263e1fd-8abb-401a-9827-98191110a4cf None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:33.099468 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 103/211] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:42:32 2022] GET /identity/v3/role_assignments?user.id=567aaa801cbd42ee9f0e33012955d7e0&scope.project.id=379430b83a8643be9d1e7d6fee22017d&role.id=d7118e244cb94310a267cf9a9b5bbfd4 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:33.100519 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263e1fd-8abb-401a-9827-98191110a4cf None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:33.150764 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 109/212] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:42:33.230739 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f36dc-92a7-44a5-9374-8a41a7e70b46 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:33.250027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263e1fd-8abb-401a-9827-98191110a4cf None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:33.289375 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512b8a7-6f1f-472e-91b9-d91a737f2e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:33.290421 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512b8a7-6f1f-472e-91b9-d91a737f2e8f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:33.290853 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512b8a7-6f1f-472e-91b9-d91a737f2e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:33.291275 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512b8a7-6f1f-472e-91b9-d91a737f2e8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:33.293039 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3512b8a7-6f1f-472e-91b9-d91a737f2e8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:33.294726 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3512b8a7-6f1f-472e-91b9-d91a737f2e8f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:33.296977 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 104/213] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:33.302457 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512b8a7-6f1f-472e-91b9-d91a737f2e8f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:33.312662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:33.394154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f36dc-92a7-44a5-9374-8a41a7e70b46 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:33.412598 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512b8a7-6f1f-472e-91b9-d91a737f2e8f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:33.448984 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e4470-d367-4a09-bed6-440773503574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:33.452681 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e4470-d367-4a09-bed6-440773503574 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:33.453374 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e4470-d367-4a09-bed6-440773503574 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:33.453998 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e4470-d367-4a09-bed6-440773503574 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:33.459134 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ef512-7ee6-4c14-a8bb-bcf83f393ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:33.461072 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ef512-7ee6-4c14-a8bb-bcf83f393ae9 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:33.461852 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ef512-7ee6-4c14-a8bb-bcf83f393ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:33.462393 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ef512-7ee6-4c14-a8bb-bcf83f393ae9 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:33.465338 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ef512-7ee6-4c14-a8bb-bcf83f393ae9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:33.466958 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ef512-7ee6-4c14-a8bb-bcf83f393ae9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:33.485219 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e4470-d367-4a09-bed6-440773503574 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:33.508133 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-7d7e4470-d367-4a09-bed6-440773503574 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:42:33.508133 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:33.508133 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:33.508133 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:33.508133 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:33.508133 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:33.508133 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:33.508133 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:33.508133 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:33.508133 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:33.508133 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:33.508133 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:33.508133 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:33.508133 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:33.508133 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:33.508133 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:33.509440 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:33.509440 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:33.509440 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:33.509440 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:33.509440 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:33.509440 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:33.509440 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:33.509440 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:33.509440 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:33.509440 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:33.509440 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:33.509440 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:33.509440 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:33.509440 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:33.509440 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:33.509440 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:33.510448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:33.510448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:33.510448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:33.510448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:33.510448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:33.510448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:33.510448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:33.510448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:33.510448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:33.510448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:33.510448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:42:33.510448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:42:33.514697 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 110/214] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:33.524674 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e4470-d367-4a09-bed6-440773503574 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:33.526702 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 105/215] 10.222.0.85 () {60 vars in 1132 bytes} [Thu Jun 16 14:42:33 2022] POST /identity/v3/users => generated 297 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:42:33.546358 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:33.606742 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69aade3-f008-4da6-8a86-0f9df8d10186 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:33.607032 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69aade3-f008-4da6-8a86-0f9df8d10186 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:33.607367 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69aade3-f008-4da6-8a86-0f9df8d10186 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:33.609079 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 106/216] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:33.614951 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1a04d-a977-4e27-9cdc-30cebc305cb7 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:33.615295 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1a04d-a977-4e27-9cdc-30cebc305cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:33.615524 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1a04d-a977-4e27-9cdc-30cebc305cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:33.637386 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-79e1a04d-a977-4e27-9cdc-30cebc305cb7 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:33.638688 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-79e1a04d-a977-4e27-9cdc-30cebc305cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:33.718811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e4470-d367-4a09-bed6-440773503574 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:33.730314 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:33.749606 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 107/217] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:33.772421 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1a04d-a977-4e27-9cdc-30cebc305cb7 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:33.779718 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc0296-8f62-4704-8622-17650a24f588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:33.780470 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc0296-8f62-4704-8622-17650a24f588 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:33.780752 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc0296-8f62-4704-8622-17650a24f588 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:33.781028 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc0296-8f62-4704-8622-17650a24f588 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:33.781820 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc0296-8f62-4704-8622-17650a24f588 None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:33.782128 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc0296-8f62-4704-8622-17650a24f588 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:33.783593 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc0296-8f62-4704-8622-17650a24f588 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:33.799994 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 111/218] 10.222.0.85 () {56 vars in 1101 bytes} [Thu Jun 16 14:42:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:33.803423 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc0296-8f62-4704-8622-17650a24f588 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:33.903859 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:33.925122 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1a04d-a977-4e27-9cdc-30cebc305cb7 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:33.970928 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc0296-8f62-4704-8622-17650a24f588 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:33.978037 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a11c7-7421-461a-b240-e29a6f6611fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:33.979226 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a11c7-7421-461a-b240-e29a6f6611fa None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:33.979651 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a11c7-7421-461a-b240-e29a6f6611fa None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:33.980150 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a11c7-7421-461a-b240-e29a6f6611fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:33.999938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a11c7-7421-461a-b240-e29a6f6611fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:34.012194 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-8d1a11c7-7421-461a-b240-e29a6f6611fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:34.012194 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:34.012194 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:34.012194 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:34.012194 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:34.012194 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:34.012194 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:34.012194 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:34.012194 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:34.012194 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:34.012194 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:34.012194 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:34.012194 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:34.012194 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:34.012194 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:34.012194 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:34.013185 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:34.013185 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:34.013185 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:34.013185 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:34.013185 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:34.013185 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:34.013185 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:34.013185 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:34.013185 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:34.013185 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:34.013185 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:34.013185 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:34.013185 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:34.013185 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:34.013185 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:34.013185 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:34.013962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:34.013962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:34.013962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:34.013962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:34.013962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:34.013962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:34.013962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:34.013962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:34.013962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:34.013962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:34.013962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:34.013962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:42:34.013962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 108/219] 10.222.0.85 () {56 vars in 1096 bytes} [Thu Jun 16 14:42:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:34.015379 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b729c2-0736-4a57-9da2-8da01c936480 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:34.015379 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b729c2-0736-4a57-9da2-8da01c936480 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:34.015537 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b729c2-0736-4a57-9da2-8da01c936480 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:34.016893 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 109/220] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:34.021337 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b729c2-0736-4a57-9da2-8da01c936480 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:34.022563 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6b98e-830f-434c-91a6-9a4f26d17079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:34.023486 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6b98e-830f-434c-91a6-9a4f26d17079 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:34.023773 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6b98e-830f-434c-91a6-9a4f26d17079 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:34.024082 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6b98e-830f-434c-91a6-9a4f26d17079 None admin] PATH_INFO: `/v3/users/292294d346c24ce785aecbcc9a27fd6c` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:34.042379 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6b98e-830f-434c-91a6-9a4f26d17079 None admin] RBAC: Authorizing `identity:get_user(user_id=292294d346c24ce785aecbcc9a27fd6c)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:34.044124 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6b98e-830f-434c-91a6-9a4f26d17079 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:34.046129 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 112/221] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:33 2022] GET /identity/v3/users/292294d346c24ce785aecbcc9a27fd6c => generated 297 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:34.047215 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731996ca-cd01-4f65-9e0f-b0efef8b1fe2 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:34.047548 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731996ca-cd01-4f65-9e0f-b0efef8b1fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:34.047828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731996ca-cd01-4f65-9e0f-b0efef8b1fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:34.066468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-731996ca-cd01-4f65-9e0f-b0efef8b1fe2 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:34.067671 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-731996ca-cd01-4f65-9e0f-b0efef8b1fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:34.121401 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:34.163332 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 113/222] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:34.164599 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731996ca-cd01-4f65-9e0f-b0efef8b1fe2 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:34.208924 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b729c2-0736-4a57-9da2-8da01c936480 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:34.234473 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:34.270509 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab005dc-e915-4f6c-aa2e-d04aab138a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:34.271260 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab005dc-e915-4f6c-aa2e-d04aab138a8c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:34.271775 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab005dc-e915-4f6c-aa2e-d04aab138a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:34.272188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab005dc-e915-4f6c-aa2e-d04aab138a8c None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:34.273075 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab005dc-e915-4f6c-aa2e-d04aab138a8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:34.273396 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab005dc-e915-4f6c-aa2e-d04aab138a8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:34.274882 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab005dc-e915-4f6c-aa2e-d04aab138a8c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:34.293970 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 110/223] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:34.295165 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab005dc-e915-4f6c-aa2e-d04aab138a8c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:34.299824 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731996ca-cd01-4f65-9e0f-b0efef8b1fe2 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:34.353981 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc0624-abec-488e-b3ed-051da76bc562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:34.354901 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc0624-abec-488e-b3ed-051da76bc562 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:34.355287 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc0624-abec-488e-b3ed-051da76bc562 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:34.355567 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc0624-abec-488e-b3ed-051da76bc562 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:34.418890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab005dc-e915-4f6c-aa2e-d04aab138a8c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:34.429835 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc0624-abec-488e-b3ed-051da76bc562 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:34.431324 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc0624-abec-488e-b3ed-051da76bc562 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:34.448657 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:34.457146 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb761a-ab35-431b-a302-12ed81b93c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:34.458096 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb761a-ab35-431b-a302-12ed81b93c83 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:34.458482 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb761a-ab35-431b-a302-12ed81b93c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:34.458834 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb761a-ab35-431b-a302-12ed81b93c83 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:34.475761 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cb761a-ab35-431b-a302-12ed81b93c83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:34.486323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-93cb761a-ab35-431b-a302-12ed81b93c83 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:42:34.486323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:34.486323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:34.486323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:34.486323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:34.486323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:34.486323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:34.486323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:34.486323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:34.486323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:34.486323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:34.486323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:34.486323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:34.486323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:34.486323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:34.486323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:34.487237 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:34.487237 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:34.487237 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:34.487237 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:34.487237 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:34.487237 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:34.487237 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:34.487237 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:34.487237 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:34.487237 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:34.487237 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:34.487237 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:34.487237 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:34.487237 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:34.487237 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:34.487237 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:34.488066 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:34.488066 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:34.488066 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:34.488066 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:34.488066 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:34.488066 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:34.488066 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:34.488066 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:34.488066 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:34.488066 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:34.488066 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:42:34.488066 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:42:34.488660 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 111/224] 10.222.0.85 () {56 vars in 1114 bytes} [Thu Jun 16 14:42:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:34.489509 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb761a-ab35-431b-a302-12ed81b93c83 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:34.492244 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:34.542461 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 114/225] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:34.549980 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc0624-abec-488e-b3ed-051da76bc562 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:34.618685 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb761a-ab35-431b-a302-12ed81b93c83 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:34.661417 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc0624-abec-488e-b3ed-051da76bc562 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:34.662390 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844153f-1383-4bfe-9b7d-aae6c44b0ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:34.663398 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844153f-1383-4bfe-9b7d-aae6c44b0ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:34.663664 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844153f-1383-4bfe-9b7d-aae6c44b0ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:34.663970 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844153f-1383-4bfe-9b7d-aae6c44b0ba7 None admin] PATH_INFO: `/v3/users/42d4912ed3ee499b87ee17a6c4d89820` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:34.665553 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844153f-1383-4bfe-9b7d-aae6c44b0ba7 None admin] RBAC: Authorizing `identity:get_user(user_id=42d4912ed3ee499b87ee17a6c4d89820)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:34.667140 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844153f-1383-4bfe-9b7d-aae6c44b0ba7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:34.669590 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 112/226] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:34 2022] GET /identity/v3/users/42d4912ed3ee499b87ee17a6c4d89820 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:34.670492 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844153f-1383-4bfe-9b7d-aae6c44b0ba7 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:34.702710 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beccc80-3966-40c7-a7fb-d8cf4eb7c52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:34.703959 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beccc80-3966-40c7-a7fb-d8cf4eb7c52e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:34.704701 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beccc80-3966-40c7-a7fb-d8cf4eb7c52e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:34.705405 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beccc80-3966-40c7-a7fb-d8cf4eb7c52e None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:34.706545 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beccc80-3966-40c7-a7fb-d8cf4eb7c52e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:34.707059 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beccc80-3966-40c7-a7fb-d8cf4eb7c52e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:34.709240 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beccc80-3966-40c7-a7fb-d8cf4eb7c52e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:34.725182 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 115/227] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:34.725182 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beccc80-3966-40c7-a7fb-d8cf4eb7c52e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:34.725476 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:34.750271 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:34.822164 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844153f-1383-4bfe-9b7d-aae6c44b0ba7 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:34.857154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beccc80-3966-40c7-a7fb-d8cf4eb7c52e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:34.860624 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c44280-c833-451f-800f-1f3b7e9784c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:34.861642 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c44280-c833-451f-800f-1f3b7e9784c5 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:34.862016 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c44280-c833-451f-800f-1f3b7e9784c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:34.862387 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c44280-c833-451f-800f-1f3b7e9784c5 None admin] PATH_INFO: `/v3/projects/2626df1e7e3e430790b7db426c06948f` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:34.863793 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c44280-c833-451f-800f-1f3b7e9784c5 None admin] RBAC: Authorizing `identity:get_project(project_id=2626df1e7e3e430790b7db426c06948f)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:34.865374 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c44280-c833-451f-800f-1f3b7e9784c5 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:34.873342 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 113/228] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:34 2022] GET /identity/v3/projects/2626df1e7e3e430790b7db426c06948f => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:34.874529 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c44280-c833-451f-800f-1f3b7e9784c5 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:34.899091 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18a785-1540-45d1-9b9c-d862c94849ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:34.900833 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18a785-1540-45d1-9b9c-d862c94849ab None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:34.901410 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18a785-1540-45d1-9b9c-d862c94849ab None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:34.902148 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18a785-1540-45d1-9b9c-d862c94849ab None admin] PATH_INFO: `/v3/projects/2626df1e7e3e430790b7db426c06948f` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:34.904048 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18a785-1540-45d1-9b9c-d862c94849ab None admin] RBAC: Authorizing `identity:get_project(project_id=2626df1e7e3e430790b7db426c06948f)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:34.906338 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18a785-1540-45d1-9b9c-d862c94849ab None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:34.909185 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 116/229] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:34 2022] GET /identity/v3/projects/2626df1e7e3e430790b7db426c06948f => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:34.910859 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18a785-1540-45d1-9b9c-d862c94849ab None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:35.013207 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c44280-c833-451f-800f-1f3b7e9784c5 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:35.020968 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:35.028773 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:35.045289 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18a785-1540-45d1-9b9c-d862c94849ab None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:35.060271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79010f9-27fa-48bb-bf21-27dc710cff0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:35.061200 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79010f9-27fa-48bb-bf21-27dc710cff0b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:35.061474 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79010f9-27fa-48bb-bf21-27dc710cff0b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:35.061745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79010f9-27fa-48bb-bf21-27dc710cff0b None admin] PATH_INFO: `/v3/users/42d4912ed3ee499b87ee17a6c4d89820` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:35.063571 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79010f9-27fa-48bb-bf21-27dc710cff0b None admin] RBAC: Authorizing `identity:get_user(user_id=42d4912ed3ee499b87ee17a6c4d89820)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:35.065376 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79010f9-27fa-48bb-bf21-27dc710cff0b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:35.072871 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 114/230] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:34 2022] GET /identity/v3/users/42d4912ed3ee499b87ee17a6c4d89820 => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:35.074274 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79010f9-27fa-48bb-bf21-27dc710cff0b None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:35.101070 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d89d1-edff-4b87-acb5-6d338b823bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:35.101773 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d89d1-edff-4b87-acb5-6d338b823bba None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:35.102051 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d89d1-edff-4b87-acb5-6d338b823bba None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:35.102325 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d89d1-edff-4b87-acb5-6d338b823bba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:35.103164 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d89d1-edff-4b87-acb5-6d338b823bba None admin] RBAC: Adding query filter params (role.id=26e7e900cf574eaabe4fcf886acb0c46, scope.project.id=2626df1e7e3e430790b7db426c06948f, user.id=292294d346c24ce785aecbcc9a27fd6c) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:35.103472 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d89d1-edff-4b87-acb5-6d338b823bba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:35.106280 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d89d1-edff-4b87-acb5-6d338b823bba None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:35.116038 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 117/231] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:42:34 2022] GET /identity/v3/role_assignments?user.id=292294d346c24ce785aecbcc9a27fd6c&scope.project.id=2626df1e7e3e430790b7db426c06948f&role.id=26e7e900cf574eaabe4fcf886acb0c46 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:35.125451 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d89d1-edff-4b87-acb5-6d338b823bba None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:35.207715 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79010f9-27fa-48bb-bf21-27dc710cff0b None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:35.257437 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eccfeb-6ec4-4fd6-a2c6-90b5a91f99d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:35.258372 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eccfeb-6ec4-4fd6-a2c6-90b5a91f99d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:35.258643 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eccfeb-6ec4-4fd6-a2c6-90b5a91f99d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:35.258916 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eccfeb-6ec4-4fd6-a2c6-90b5a91f99d3 None admin] PATH_INFO: `/v3/projects/2626df1e7e3e430790b7db426c06948f/users/42d4912ed3ee499b87ee17a6c4d89820/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:35.263413 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eccfeb-6ec4-4fd6-a2c6-90b5a91f99d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=2626df1e7e3e430790b7db426c06948f, user_id=42d4912ed3ee499b87ee17a6c4d89820, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:35.265007 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eccfeb-6ec4-4fd6-a2c6-90b5a91f99d3 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:35.293170 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 115/232] 10.222.0.85 () {58 vars in 1439 bytes} [Thu Jun 16 14:42:35 2022] PUT /identity/v3/projects/2626df1e7e3e430790b7db426c06948f/users/42d4912ed3ee499b87ee17a6c4d89820/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:42:35.334918 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d89d1-edff-4b87-acb5-6d338b823bba None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:35.376057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5417d57-e3b3-403c-a490-af93eb7963c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:35.376934 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5417d57-e3b3-403c-a490-af93eb7963c6 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:35.377265 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5417d57-e3b3-403c-a490-af93eb7963c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:35.377546 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5417d57-e3b3-403c-a490-af93eb7963c6 None admin] PATH_INFO: `/v3/projects/2626df1e7e3e430790b7db426c06948f` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:35.378834 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5417d57-e3b3-403c-a490-af93eb7963c6 None admin] RBAC: Authorizing `identity:get_project(project_id=2626df1e7e3e430790b7db426c06948f)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:35.380482 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5417d57-e3b3-403c-a490-af93eb7963c6 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:35.386266 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 118/233] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:35 2022] GET /identity/v3/projects/2626df1e7e3e430790b7db426c06948f => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:35.389396 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eccfeb-6ec4-4fd6-a2c6-90b5a91f99d3 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:35.445094 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:35.535072 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eccfeb-6ec4-4fd6-a2c6-90b5a91f99d3 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:35.574639 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e4c3c4-52fe-49ed-aa90-860e8f303a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:35.575550 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4c3c4-52fe-49ed-aa90-860e8f303a0a None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:35.575831 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4c3c4-52fe-49ed-aa90-860e8f303a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:35.576135 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4c3c4-52fe-49ed-aa90-860e8f303a0a None admin] PATH_INFO: `/v3/projects/2626df1e7e3e430790b7db426c06948f/users/42d4912ed3ee499b87ee17a6c4d89820/roles/2f7fa8924ea9447aab26981f0329ad43` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:35.578488 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e4c3c4-52fe-49ed-aa90-860e8f303a0a None admin] RBAC: Authorizing `identity:create_grant(project_id=2626df1e7e3e430790b7db426c06948f, user_id=42d4912ed3ee499b87ee17a6c4d89820, role_id=2f7fa8924ea9447aab26981f0329ad43)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:35.580041 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e4c3c4-52fe-49ed-aa90-860e8f303a0a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:35.600707 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 116/234] 10.222.0.85 () {58 vars in 1439 bytes} [Thu Jun 16 14:42:35 2022] PUT /identity/v3/projects/2626df1e7e3e430790b7db426c06948f/users/42d4912ed3ee499b87ee17a6c4d89820/roles/2f7fa8924ea9447aab26981f0329ad43 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:42:36.073204 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9e814-040d-41a0-b00c-f3e50ed4acec None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:36.073827 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9e814-040d-41a0-b00c-f3e50ed4acec None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:36.073827 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9e814-040d-41a0-b00c-f3e50ed4acec None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:36.075124 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 119/235] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:36.080660 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89c767-f22a-472f-a032-8fc746a8129f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:36.081096 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89c767-f22a-472f-a032-8fc746a8129f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:36.081272 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89c767-f22a-472f-a032-8fc746a8129f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:36.102180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-eb89c767-f22a-472f-a032-8fc746a8129f None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:36.103649 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-eb89c767-f22a-472f-a032-8fc746a8129f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:36.208998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 117/236] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:42:36.246751 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9e814-040d-41a0-b00c-f3e50ed4acec None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:36.268662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf86be-7e7a-45f0-be98-2a1438d652db None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:36.268974 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf86be-7e7a-45f0-be98-2a1438d652db None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:36.270522 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf86be-7e7a-45f0-be98-2a1438d652db None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:36.270631 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 118/237] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:36.277652 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a745b82-cfa5-4b75-b419-fb296444e20f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:36.279061 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a745b82-cfa5-4b75-b419-fb296444e20f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:36.279744 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a745b82-cfa5-4b75-b419-fb296444e20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:36.284239 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:36.306046 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-0a745b82-cfa5-4b75-b419-fb296444e20f None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:36.307792 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-0a745b82-cfa5-4b75-b419-fb296444e20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:36.362682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:36.466706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 119/238] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:42:36.497082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a745b82-cfa5-4b75-b419-fb296444e20f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:36.513303 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9e814-040d-41a0-b00c-f3e50ed4acec None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:36.605519 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39068e6e-3e68-41b4-81a5-2a7d7f063826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:36.606381 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39068e6e-3e68-41b4-81a5-2a7d7f063826 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:36.606664 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39068e6e-3e68-41b4-81a5-2a7d7f063826 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:36.607759 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39068e6e-3e68-41b4-81a5-2a7d7f063826 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:36.625173 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39068e6e-3e68-41b4-81a5-2a7d7f063826 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:36.642216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-39068e6e-3e68-41b4-81a5-2a7d7f063826 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:42:36.642216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:36.642216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:36.642216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:36.642216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:36.642216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:36.642216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:36.642216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:36.642216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:36.642216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:36.642216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:36.642216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:36.642216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:36.642216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:36.642216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:36.642216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:36.643184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:36.643184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:36.643184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:36.643184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:36.643184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:36.643184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:36.643184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:36.643184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:36.643184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:36.643184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:36.643184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:36.643184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:36.643184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:36.643184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:36.643184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:36.643184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:36.644816 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:36.644816 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:36.644816 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:36.644816 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:36.644816 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:36.644816 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:36.644816 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:36.644816 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:36.644816 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:36.644816 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:36.644816 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:42:36.644816 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:42:36.644816 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 120/239] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:36.653046 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39068e6e-3e68-41b4-81a5-2a7d7f063826 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:36.708838 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a745b82-cfa5-4b75-b419-fb296444e20f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:36.796454 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2286374-051d-496e-8492-2a2f57331ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:36.799182 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2286374-051d-496e-8492-2a2f57331ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:36.799467 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2286374-051d-496e-8492-2a2f57331ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:36.799743 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2286374-051d-496e-8492-2a2f57331ba1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:36.802029 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2286374-051d-496e-8492-2a2f57331ba1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:36.803565 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2286374-051d-496e-8492-2a2f57331ba1 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:36.809228 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 120/240] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:36.817536 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2286374-051d-496e-8492-2a2f57331ba1 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:36.842395 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:36.885043 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:36.891842 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39068e6e-3e68-41b4-81a5-2a7d7f063826 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:36.972988 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cb6b7-c84e-4e9f-a9fb-ec0067d82785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:36.973686 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cb6b7-c84e-4e9f-a9fb-ec0067d82785 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:36.973968 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cb6b7-c84e-4e9f-a9fb-ec0067d82785 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:36.974240 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cb6b7-c84e-4e9f-a9fb-ec0067d82785 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:36.974997 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1cb6b7-c84e-4e9f-a9fb-ec0067d82785 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:36.975304 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1cb6b7-c84e-4e9f-a9fb-ec0067d82785 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:36.976836 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1cb6b7-c84e-4e9f-a9fb-ec0067d82785 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:36.993462 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 121/241] 10.222.0.85 () {56 vars in 1101 bytes} [Thu Jun 16 14:42:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:37.000184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cb6b7-c84e-4e9f-a9fb-ec0067d82785 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:37.028797 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2286374-051d-496e-8492-2a2f57331ba1 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:37.112059 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1540109-8612-4b00-b339-c6345604bf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:37.112845 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1540109-8612-4b00-b339-c6345604bf39 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:37.115055 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1540109-8612-4b00-b339-c6345604bf39 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:37.115341 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1540109-8612-4b00-b339-c6345604bf39 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:37.117292 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1540109-8612-4b00-b339-c6345604bf39 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:37.118791 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1540109-8612-4b00-b339-c6345604bf39 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:37.161458 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 121/242] 10.222.0.85 () {60 vars in 1132 bytes} [Thu Jun 16 14:42:36 2022] POST /identity/v3/users => generated 293 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:42:37.199590 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cb6b7-c84e-4e9f-a9fb-ec0067d82785 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:37.270074 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073abb17-2455-4d59-b100-07681ba63562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:37.270990 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073abb17-2455-4d59-b100-07681ba63562 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:37.271283 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073abb17-2455-4d59-b100-07681ba63562 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:37.271629 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073abb17-2455-4d59-b100-07681ba63562 None admin] PATH_INFO: `/v3/users/4710a673597e4e8b834c6ee483fdb303` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:37.288785 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:37.299960 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073abb17-2455-4d59-b100-07681ba63562 None admin] RBAC: Authorizing `identity:get_user(user_id=4710a673597e4e8b834c6ee483fdb303)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:37.301478 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073abb17-2455-4d59-b100-07681ba63562 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:37.303634 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 122/243] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:36 2022] GET /identity/v3/users/4710a673597e4e8b834c6ee483fdb303 => generated 297 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:37.312387 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1540109-8612-4b00-b339-c6345604bf39 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:37.448758 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:37.477848 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1540109-8612-4b00-b339-c6345604bf39 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:37.537649 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d2c9f-8b45-4b8f-9128-a430c8977408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:37.538704 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d2c9f-8b45-4b8f-9128-a430c8977408 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:37.539185 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d2c9f-8b45-4b8f-9128-a430c8977408 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:37.539673 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d2c9f-8b45-4b8f-9128-a430c8977408 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:37.634631 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d2c9f-8b45-4b8f-9128-a430c8977408 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:37.636206 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d2c9f-8b45-4b8f-9128-a430c8977408 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:37.730009 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:37.757382 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 122/244] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:37.763652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073abb17-2455-4d59-b100-07681ba63562 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:37.811356 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80dde3b-e745-4f08-9f93-339635c4e63e None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:37.812039 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80dde3b-e745-4f08-9f93-339635c4e63e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:37.812533 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80dde3b-e745-4f08-9f93-339635c4e63e None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:37.814180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 123/245] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:42:37.822053 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b344238-a063-4c5e-8eaa-173209e0b0d4 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:37.822705 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b344238-a063-4c5e-8eaa-173209e0b0d4 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:37.823348 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b344238-a063-4c5e-8eaa-173209e0b0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:37.843623 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-3b344238-a063-4c5e-8eaa-173209e0b0d4 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:37.845226 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3b344238-a063-4c5e-8eaa-173209e0b0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:37.900603 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073abb17-2455-4d59-b100-07681ba63562 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:37.940459 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fb290-8c6a-4219-8713-bb626eaa9dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:37.942898 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fb290-8c6a-4219-8713-bb626eaa9dcc None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:37.943526 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fb290-8c6a-4219-8713-bb626eaa9dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:37.944813 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fb290-8c6a-4219-8713-bb626eaa9dcc None admin] PATH_INFO: `/v3/projects/2626df1e7e3e430790b7db426c06948f` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:37.947315 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1fb290-8c6a-4219-8713-bb626eaa9dcc None admin] RBAC: Authorizing `identity:get_project(project_id=2626df1e7e3e430790b7db426c06948f)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:37.949938 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1fb290-8c6a-4219-8713-bb626eaa9dcc None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:37.954933 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 123/246] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:37 2022] GET /identity/v3/projects/2626df1e7e3e430790b7db426c06948f => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:37.956884 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 124/247] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:37.966329 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fb290-8c6a-4219-8713-bb626eaa9dcc None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:37.983185 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b344238-a063-4c5e-8eaa-173209e0b0d4 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:38.058891 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:38.105808 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fb290-8c6a-4219-8713-bb626eaa9dcc None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:38.131130 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b344238-a063-4c5e-8eaa-173209e0b0d4 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:38.146641 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:38.160993 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09d1a6-cb55-4a28-8bfe-e830a3a52429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:38.161928 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09d1a6-cb55-4a28-8bfe-e830a3a52429 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:38.162214 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09d1a6-cb55-4a28-8bfe-e830a3a52429 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:38.162980 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09d1a6-cb55-4a28-8bfe-e830a3a52429 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:38.164005 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09d1a6-cb55-4a28-8bfe-e830a3a52429 None admin] RBAC: Adding query filter params (role.id=d7118e244cb94310a267cf9a9b5bbfd4, scope.project.id=2626df1e7e3e430790b7db426c06948f, user.id=4710a673597e4e8b834c6ee483fdb303) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:38.164454 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09d1a6-cb55-4a28-8bfe-e830a3a52429 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:38.166305 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09d1a6-cb55-4a28-8bfe-e830a3a52429 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:38.174805 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 124/248] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:42:37 2022] GET /identity/v3/role_assignments?user.id=4710a673597e4e8b834c6ee483fdb303&scope.project.id=2626df1e7e3e430790b7db426c06948f&role.id=d7118e244cb94310a267cf9a9b5bbfd4 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:38.176237 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172329d-318e-4748-b67e-ac76a7ccd6bb None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:38.176526 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172329d-318e-4748-b67e-ac76a7ccd6bb None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:38.176802 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172329d-318e-4748-b67e-ac76a7ccd6bb None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:38.178271 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 125/249] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:38.178483 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e614e-19f6-4233-aba6-5d53578d4441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:38.180080 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e614e-19f6-4233-aba6-5d53578d4441 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:38.180552 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e614e-19f6-4233-aba6-5d53578d4441 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:38.181001 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e614e-19f6-4233-aba6-5d53578d4441 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:38.184313 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41300df5-b663-469a-b8d3-d4fedf4fdd9b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:38.184624 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41300df5-b663-469a-b8d3-d4fedf4fdd9b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:38.185402 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41300df5-b663-469a-b8d3-d4fedf4fdd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:38.194746 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e614e-19f6-4233-aba6-5d53578d4441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:38.205874 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-41300df5-b663-469a-b8d3-d4fedf4fdd9b None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:38.207165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-41300df5-b663-469a-b8d3-d4fedf4fdd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:38.207293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-2c1e614e-19f6-4233-aba6-5d53578d4441 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:42:38.207293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:38.207293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:38.207293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:38.207293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:38.207293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:38.207293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:38.207293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:38.207293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:38.207293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:38.207293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:38.207293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:38.207293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:38.207293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:38.207293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:38.207293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:38.208170 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:38.208170 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:38.208170 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:38.208170 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:38.208170 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:38.208170 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:38.208170 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:38.208170 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:38.208170 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:38.208170 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:38.208170 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:38.208170 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:38.208170 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:38.208170 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:38.208170 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:38.208170 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:38.209051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:38.209051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:38.209051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:38.209051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:38.209051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:38.209051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:38.209051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:38.209051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:38.209051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:38.209051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:38.209051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:42:38.209051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:42:38.209051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 125/250] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:38.216155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e614e-19f6-4233-aba6-5d53578d4441 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:38.294784 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 126/251] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:38.335164 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41300df5-b663-469a-b8d3-d4fedf4fdd9b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:38.418335 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:38.460527 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e614e-19f6-4233-aba6-5d53578d4441 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:38.471338 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41300df5-b663-469a-b8d3-d4fedf4fdd9b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:38.514100 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143c04a-f25f-4d4f-b447-e6422f826191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:38.514921 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143c04a-f25f-4d4f-b447-e6422f826191 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:38.515194 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143c04a-f25f-4d4f-b447-e6422f826191 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:38.515471 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143c04a-f25f-4d4f-b447-e6422f826191 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:38.516871 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027eb49d-188a-4a85-9784-0f3a641bd693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:38.517488 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027eb49d-188a-4a85-9784-0f3a641bd693 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:38.517761 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027eb49d-188a-4a85-9784-0f3a641bd693 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:38.518032 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027eb49d-188a-4a85-9784-0f3a641bd693 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:38.518789 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027eb49d-188a-4a85-9784-0f3a641bd693 None admin] RBAC: Adding query filter params (name=member) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:38.519095 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027eb49d-188a-4a85-9784-0f3a641bd693 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:38.520565 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027eb49d-188a-4a85-9784-0f3a641bd693 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:38.541647 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143c04a-f25f-4d4f-b447-e6422f826191 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:38.543311 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 126/252] 10.222.0.85 () {56 vars in 1101 bytes} [Thu Jun 16 14:42:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:38.555979 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027eb49d-188a-4a85-9784-0f3a641bd693 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:38.557204 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-b143c04a-f25f-4d4f-b447-e6422f826191 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:38.557204 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:38.557204 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:38.557204 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:38.557204 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:38.557204 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:38.557204 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:38.557204 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:38.557204 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:38.557204 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:38.557204 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:38.557204 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:38.557204 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:38.557204 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:38.557204 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:38.557204 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:38.558307 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:38.558307 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:38.558307 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:38.558307 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:38.558307 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:38.558307 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:38.558307 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:38.558307 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:38.558307 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:38.558307 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:38.558307 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:38.558307 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:38.558307 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:38.558307 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:38.558307 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:38.558307 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:38.559156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:38.559156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:38.559156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:38.559156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:38.559156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:38.559156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:38.559156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:38.559156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:38.559156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:38.559156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:38.559156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:38.559156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:42:38.561893 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 127/253] 10.222.0.85 () {56 vars in 1096 bytes} [Thu Jun 16 14:42:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:38.574173 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143c04a-f25f-4d4f-b447-e6422f826191 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:38.654724 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:38.740794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143c04a-f25f-4d4f-b447-e6422f826191 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:38.776873 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c071b1-c965-4f28-85a5-4619a53e1a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:38.777561 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c071b1-c965-4f28-85a5-4619a53e1a52 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:38.777842 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c071b1-c965-4f28-85a5-4619a53e1a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:38.778117 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c071b1-c965-4f28-85a5-4619a53e1a52 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:38.778868 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c071b1-c965-4f28-85a5-4619a53e1a52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:38.779173 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c071b1-c965-4f28-85a5-4619a53e1a52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:38.780618 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c071b1-c965-4f28-85a5-4619a53e1a52 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:38.789777 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 128/254] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:38.790907 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2000b94-e6e6-46e7-bd25-efbb6ea5708d None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:38.791189 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2000b94-e6e6-46e7-bd25-efbb6ea5708d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:38.791475 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2000b94-e6e6-46e7-bd25-efbb6ea5708d None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:38.798520 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 129/255] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:38.799341 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2000b94-e6e6-46e7-bd25-efbb6ea5708d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:38.800200 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:38.819383 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027eb49d-188a-4a85-9784-0f3a641bd693 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:38.875372 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76fdcba-d088-4c08-8b7e-fc2a2df6b755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:38.876755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76fdcba-d088-4c08-8b7e-fc2a2df6b755 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:38.877329 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76fdcba-d088-4c08-8b7e-fc2a2df6b755 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:38.877802 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76fdcba-d088-4c08-8b7e-fc2a2df6b755 None admin] PATH_INFO: `/v3/users/292294d346c24ce785aecbcc9a27fd6c` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:38.879231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76fdcba-d088-4c08-8b7e-fc2a2df6b755 None admin] RBAC: Authorizing `identity:get_user(user_id=292294d346c24ce785aecbcc9a27fd6c)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:38.881203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76fdcba-d088-4c08-8b7e-fc2a2df6b755 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:38.883209 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 127/256] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:38 2022] GET /identity/v3/users/292294d346c24ce785aecbcc9a27fd6c => generated 297 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:38.884735 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f7b06-71b8-4806-a764-42fbf08510c7 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:38.885431 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f7b06-71b8-4806-a764-42fbf08510c7 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:38.885947 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f7b06-71b8-4806-a764-42fbf08510c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:38.916308 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-342f7b06-71b8-4806-a764-42fbf08510c7 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:38.918199 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-342f7b06-71b8-4806-a764-42fbf08510c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:38.941096 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2000b94-e6e6-46e7-bd25-efbb6ea5708d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:38.976877 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b308f42-8f3e-4e27-893f-a2c4a58d94e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:38.977786 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b308f42-8f3e-4e27-893f-a2c4a58d94e4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:38.978060 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b308f42-8f3e-4e27-893f-a2c4a58d94e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:38.978335 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b308f42-8f3e-4e27-893f-a2c4a58d94e4 None admin] PATH_INFO: `/v3/users/42d4912ed3ee499b87ee17a6c4d89820` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:38.981585 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b308f42-8f3e-4e27-893f-a2c4a58d94e4 None admin] RBAC: Authorizing `identity:get_user(user_id=42d4912ed3ee499b87ee17a6c4d89820)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:38.984897 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b308f42-8f3e-4e27-893f-a2c4a58d94e4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:38.987973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 130/257] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:38 2022] GET /identity/v3/users/42d4912ed3ee499b87ee17a6c4d89820 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:38.988758 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b308f42-8f3e-4e27-893f-a2c4a58d94e4 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:39.034227 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 128/258] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:39.035334 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f7b06-71b8-4806-a764-42fbf08510c7 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:39.098644 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:39.132241 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:39.191200 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f7b06-71b8-4806-a764-42fbf08510c7 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:39.230670 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc334c6-ed70-425d-af3e-d6f1120e826a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:39.231328 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc334c6-ed70-425d-af3e-d6f1120e826a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:39.231611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc334c6-ed70-425d-af3e-d6f1120e826a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:39.231902 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc334c6-ed70-425d-af3e-d6f1120e826a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:39.270003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b308f42-8f3e-4e27-893f-a2c4a58d94e4 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:39.310067 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc334c6-ed70-425d-af3e-d6f1120e826a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:39.311694 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc334c6-ed70-425d-af3e-d6f1120e826a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:39.346609 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:39.361611 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bde510-8180-4f4a-b7c6-3badb54d0d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:39.362568 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bde510-8180-4f4a-b7c6-3badb54d0d72 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:39.362954 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bde510-8180-4f4a-b7c6-3badb54d0d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:39.363331 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bde510-8180-4f4a-b7c6-3badb54d0d72 None admin] PATH_INFO: `/v3/projects/2626df1e7e3e430790b7db426c06948f` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:39.364694 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bde510-8180-4f4a-b7c6-3badb54d0d72 None admin] RBAC: Authorizing `identity:get_project(project_id=2626df1e7e3e430790b7db426c06948f)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:39.366258 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bde510-8180-4f4a-b7c6-3badb54d0d72 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:39.376207 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 131/259] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:38 2022] GET /identity/v3/projects/2626df1e7e3e430790b7db426c06948f => generated 302 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:39.377193 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bde510-8180-4f4a-b7c6-3badb54d0d72 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:39.431387 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 129/260] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:39.432827 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc334c6-ed70-425d-af3e-d6f1120e826a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:39.545726 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc334c6-ed70-425d-af3e-d6f1120e826a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:39.580478 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:39.588608 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b2db7-926b-4064-bdf3-f9e3a0d3e228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:39.589881 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b2db7-926b-4064-bdf3-f9e3a0d3e228 None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:39.590830 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b2db7-926b-4064-bdf3-f9e3a0d3e228 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:39.591304 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b2db7-926b-4064-bdf3-f9e3a0d3e228 None admin] PATH_INFO: `/v3/projects/2626df1e7e3e430790b7db426c06948f/users/292294d346c24ce785aecbcc9a27fd6c/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:39.593600 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b2db7-926b-4064-bdf3-f9e3a0d3e228 None admin] RBAC: Authorizing `identity:create_grant(project_id=2626df1e7e3e430790b7db426c06948f, user_id=292294d346c24ce785aecbcc9a27fd6c, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:39.595291 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b2db7-926b-4064-bdf3-f9e3a0d3e228 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:39.612880 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 130/261] 10.222.0.85 () {58 vars in 1439 bytes} [Thu Jun 16 14:42:39 2022] PUT /identity/v3/projects/2626df1e7e3e430790b7db426c06948f/users/292294d346c24ce785aecbcc9a27fd6c/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:42:39.614307 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b2db7-926b-4064-bdf3-f9e3a0d3e228 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:39.658530 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bde510-8180-4f4a-b7c6-3badb54d0d72 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:39.700051 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:39.759922 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b2db7-926b-4064-bdf3-f9e3a0d3e228 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:39.777529 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cb162-e088-404c-be82-b6dde5ed4e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:39.778396 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cb162-e088-404c-be82-b6dde5ed4e29 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:39.779113 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cb162-e088-404c-be82-b6dde5ed4e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:39.779113 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cb162-e088-404c-be82-b6dde5ed4e29 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:39.809123 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6cb162-e088-404c-be82-b6dde5ed4e29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:39.817827 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-4e6cb162-e088-404c-be82-b6dde5ed4e29 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:42:39.817827 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:39.817827 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:39.817827 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:39.817827 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:39.817827 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:39.817827 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:39.817827 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:39.817827 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:39.817827 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:39.817827 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:39.817827 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:39.817827 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:39.817827 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:39.817827 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:39.817827 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:39.818806 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:39.818806 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:39.818806 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:39.818806 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:39.818806 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:39.818806 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:39.818806 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:39.818806 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:39.818806 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:39.818806 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:39.818806 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:39.818806 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:39.818806 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:39.818806 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:39.818806 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:39.818806 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:39.819600 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:39.819600 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:39.819600 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:39.819600 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:39.819600 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:39.819600 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:39.819600 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:39.819600 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:39.819600 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:39.819600 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:39.819600 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:42:39.819600 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:42:39.828386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 132/262] 10.222.0.85 () {56 vars in 1114 bytes} [Thu Jun 16 14:42:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 451 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:39.834946 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cb162-e088-404c-be82-b6dde5ed4e29 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:39.865355 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df83bc8-483b-4b11-805e-06f2d5ad881a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:39.866181 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df83bc8-483b-4b11-805e-06f2d5ad881a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:39.866456 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df83bc8-483b-4b11-805e-06f2d5ad881a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:39.866729 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df83bc8-483b-4b11-805e-06f2d5ad881a None admin] PATH_INFO: `/v3/projects/2626df1e7e3e430790b7db426c06948f` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:39.872890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df83bc8-483b-4b11-805e-06f2d5ad881a None admin] RBAC: Authorizing `identity:get_project(project_id=2626df1e7e3e430790b7db426c06948f)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:39.874409 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df83bc8-483b-4b11-805e-06f2d5ad881a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:39.876296 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 131/263] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:39 2022] GET /identity/v3/projects/2626df1e7e3e430790b7db426c06948f => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:39.882443 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df83bc8-483b-4b11-805e-06f2d5ad881a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:40.017531 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:40.062024 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cb162-e088-404c-be82-b6dde5ed4e29 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:40.078218 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df83bc8-483b-4b11-805e-06f2d5ad881a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:40.127130 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e007c590-5e1c-4d2b-bc7a-c2eba3745e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:40.127714 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007c590-5e1c-4d2b-bc7a-c2eba3745e46 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:40.128049 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007c590-5e1c-4d2b-bc7a-c2eba3745e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:40.128334 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007c590-5e1c-4d2b-bc7a-c2eba3745e46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:40.129286 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e007c590-5e1c-4d2b-bc7a-c2eba3745e46 None admin] RBAC: Adding query filter params (role.id=95dcfa6c726a4d01a41d2642554fd338, scope.project.id=2626df1e7e3e430790b7db426c06948f, user.id=42d4912ed3ee499b87ee17a6c4d89820) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:40.129594 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e007c590-5e1c-4d2b-bc7a-c2eba3745e46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:40.131108 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e007c590-5e1c-4d2b-bc7a-c2eba3745e46 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:40.144269 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 132/264] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:42:39 2022] GET /identity/v3/role_assignments?user.id=42d4912ed3ee499b87ee17a6c4d89820&scope.project.id=2626df1e7e3e430790b7db426c06948f&role.id=95dcfa6c726a4d01a41d2642554fd338 => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:40.154502 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe334a-80b3-4f77-8b8c-15cc57c65548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:40.155218 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe334a-80b3-4f77-8b8c-15cc57c65548 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:40.155502 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe334a-80b3-4f77-8b8c-15cc57c65548 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:40.155781 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe334a-80b3-4f77-8b8c-15cc57c65548 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:40.156591 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe334a-80b3-4f77-8b8c-15cc57c65548 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:40.156901 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe334a-80b3-4f77-8b8c-15cc57c65548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:40.158366 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe334a-80b3-4f77-8b8c-15cc57c65548 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:40.178258 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 133/265] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:40.184634 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e007c590-5e1c-4d2b-bc7a-c2eba3745e46 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:40.350117 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e007c590-5e1c-4d2b-bc7a-c2eba3745e46 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:40.388424 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:40.400919 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669e511-23cb-4b83-bec8-214b95065e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:40.404951 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669e511-23cb-4b83-bec8-214b95065e61 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:40.405239 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669e511-23cb-4b83-bec8-214b95065e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:40.405520 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669e511-23cb-4b83-bec8-214b95065e61 None admin] PATH_INFO: `/v3/users/42d4912ed3ee499b87ee17a6c4d89820` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:40.406888 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669e511-23cb-4b83-bec8-214b95065e61 None admin] RBAC: Authorizing `identity:get_user(user_id=42d4912ed3ee499b87ee17a6c4d89820)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:40.408386 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669e511-23cb-4b83-bec8-214b95065e61 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:40.410067 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 133/266] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:40 2022] GET /identity/v3/users/42d4912ed3ee499b87ee17a6c4d89820 => generated 283 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:40.416070 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe334a-80b3-4f77-8b8c-15cc57c65548 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:40.525261 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:40.612508 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe334a-80b3-4f77-8b8c-15cc57c65548 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:40.666192 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea01be-9399-4bb8-8792-1212367765b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:40.666833 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea01be-9399-4bb8-8792-1212367765b2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:40.667276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea01be-9399-4bb8-8792-1212367765b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:40.667766 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea01be-9399-4bb8-8792-1212367765b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:40.767659 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea01be-9399-4bb8-8792-1212367765b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:40.769225 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea01be-9399-4bb8-8792-1212367765b2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:40.810467 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77c07f-8ac5-4317-b92a-915eafc2f937 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:40.810819 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77c07f-8ac5-4317-b92a-915eafc2f937 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:40.811005 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77c07f-8ac5-4317-b92a-915eafc2f937 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:40.812698 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 134/267] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:42:40.818296 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb82e8-7de2-46f2-a757-c7f717670d80 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:40.818573 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb82e8-7de2-46f2-a757-c7f717670d80 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:40.818845 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb82e8-7de2-46f2-a757-c7f717670d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:40.834088 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:40.855217 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-accb82e8-7de2-46f2-a757-c7f717670d80 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:40.856443 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-accb82e8-7de2-46f2-a757-c7f717670d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:40.922333 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 134/268] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:40.931466 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea01be-9399-4bb8-8792-1212367765b2 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:41.020927 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 135/269] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:42:41.054256 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb82e8-7de2-46f2-a757-c7f717670d80 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:41.076118 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea01be-9399-4bb8-8792-1212367765b2 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:41.118023 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e506622-dd94-459c-a421-b963a048e5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:41.119427 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e506622-dd94-459c-a421-b963a048e5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:41.120291 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e506622-dd94-459c-a421-b963a048e5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:41.120715 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e506622-dd94-459c-a421-b963a048e5a7 None admin] PATH_INFO: `/v3/projects/2626df1e7e3e430790b7db426c06948f` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:41.122081 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e506622-dd94-459c-a421-b963a048e5a7 None admin] RBAC: Authorizing `identity:get_project(project_id=2626df1e7e3e430790b7db426c06948f)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:41.124241 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e506622-dd94-459c-a421-b963a048e5a7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:41.127358 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 135/270] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:40 2022] GET /identity/v3/projects/2626df1e7e3e430790b7db426c06948f => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:41.134097 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39df2c3-ba72-48dd-85c8-3edd827da050 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:41.134097 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39df2c3-ba72-48dd-85c8-3edd827da050 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:41.134097 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39df2c3-ba72-48dd-85c8-3edd827da050 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:41.134337 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 136/271] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:41.136941 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39df2c3-ba72-48dd-85c8-3edd827da050 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:41.153494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:41.193378 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb82e8-7de2-46f2-a757-c7f717670d80 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:41.224334 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:41.240069 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a8abf-c972-4d9e-8175-4e91c96768e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:41.242066 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a8abf-c972-4d9e-8175-4e91c96768e6 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:41.242535 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a8abf-c972-4d9e-8175-4e91c96768e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:41.242953 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a8abf-c972-4d9e-8175-4e91c96768e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:41.255944 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a8abf-c972-4d9e-8175-4e91c96768e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:41.263724 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-d49a8abf-c972-4d9e-8175-4e91c96768e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:42:41.263724 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:41.263724 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:41.263724 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:41.263724 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:41.263724 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:41.263724 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:41.263724 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:41.263724 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:41.263724 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:41.263724 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:41.263724 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:41.263724 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:41.263724 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:41.263724 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:41.263724 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:41.264675 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:41.264675 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:41.264675 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:41.264675 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:41.264675 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:41.264675 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:41.264675 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:41.264675 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:41.264675 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:41.264675 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:41.264675 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:41.264675 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:41.264675 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:41.264675 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:41.264675 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:41.264675 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:41.265490 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:41.265490 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:41.265490 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:41.265490 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:41.265490 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:41.265490 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:41.265490 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:41.265490 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:41.265490 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:41.265490 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:41.265490 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:42:41.265490 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:42:41.268023 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 136/272] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:41.270205 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7c4e5-4fff-4f09-957c-60acb7d5c819 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:41.270712 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7c4e5-4fff-4f09-957c-60acb7d5c819 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:41.271110 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7c4e5-4fff-4f09-957c-60acb7d5c819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:41.276762 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39df2c3-ba72-48dd-85c8-3edd827da050 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:41.289677 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-baa7c4e5-4fff-4f09-957c-60acb7d5c819 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:41.291054 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-baa7c4e5-4fff-4f09-957c-60acb7d5c819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:41.315171 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8e638-f2e1-451c-ae63-31bce44c8047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:41.315840 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8e638-f2e1-451c-ae63-31bce44c8047 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:41.316165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8e638-f2e1-451c-ae63-31bce44c8047 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:41.316550 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8e638-f2e1-451c-ae63-31bce44c8047 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:41.317392 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8e638-f2e1-451c-ae63-31bce44c8047 None admin] RBAC: Adding query filter params (role.id=2f7fa8924ea9447aab26981f0329ad43, scope.project.id=2626df1e7e3e430790b7db426c06948f, user.id=42d4912ed3ee499b87ee17a6c4d89820) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:41.317706 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8e638-f2e1-451c-ae63-31bce44c8047 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:41.319173 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8e638-f2e1-451c-ae63-31bce44c8047 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:41.325377 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 137/273] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:42:41 2022] GET /identity/v3/role_assignments?user.id=42d4912ed3ee499b87ee17a6c4d89820&scope.project.id=2626df1e7e3e430790b7db426c06948f&role.id=2f7fa8924ea9447aab26981f0329ad43 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:41.326646 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a169d-469b-4804-9c15-3f9d3c1a438e None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:41.326926 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a169d-469b-4804-9c15-3f9d3c1a438e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:41.327196 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a169d-469b-4804-9c15-3f9d3c1a438e None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:41.331941 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 138/274] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:41.331941 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a169d-469b-4804-9c15-3f9d3c1a438e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:41.389330 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 137/275] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:41.391619 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a10f38-6114-4c2e-ae4f-8dcc6e84cca0 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:41.392088 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a10f38-6114-4c2e-ae4f-8dcc6e84cca0 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:41.392490 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a10f38-6114-4c2e-ae4f-8dcc6e84cca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:41.425083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-84a10f38-6114-4c2e-ae4f-8dcc6e84cca0 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:41.426607 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-84a10f38-6114-4c2e-ae4f-8dcc6e84cca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:41.432985 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:41.470831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a169d-469b-4804-9c15-3f9d3c1a438e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:41.522736 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 138/276] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:41.524542 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a10f38-6114-4c2e-ae4f-8dcc6e84cca0 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:41.528655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7435cb2-635d-43ec-8f06-a09695268ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:41.529347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7435cb2-635d-43ec-8f06-a09695268ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:41.529623 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7435cb2-635d-43ec-8f06-a09695268ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:41.529890 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7435cb2-635d-43ec-8f06-a09695268ed3 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:41.530711 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7435cb2-635d-43ec-8f06-a09695268ed3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:41.530951 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7435cb2-635d-43ec-8f06-a09695268ed3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:41.532439 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7435cb2-635d-43ec-8f06-a09695268ed3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:41.543664 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 139/277] 10.222.0.85 () {56 vars in 1101 bytes} [Thu Jun 16 14:42:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:41.546652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7435cb2-635d-43ec-8f06-a09695268ed3 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:41.595524 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:41.665341 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a10f38-6114-4c2e-ae4f-8dcc6e84cca0 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:41.678519 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7435cb2-635d-43ec-8f06-a09695268ed3 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:41.700946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf2067-ca1d-49b4-a486-58bf5bba2d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:41.701744 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf2067-ca1d-49b4-a486-58bf5bba2d0a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:41.702021 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf2067-ca1d-49b4-a486-58bf5bba2d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:41.702289 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf2067-ca1d-49b4-a486-58bf5bba2d0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:41.703448 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf2067-ca1d-49b4-a486-58bf5bba2d0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:41.704945 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf2067-ca1d-49b4-a486-58bf5bba2d0a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:41.706578 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 139/278] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:41.707335 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf2067-ca1d-49b4-a486-58bf5bba2d0a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:41.719939 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759ed98-17a5-4b7e-93da-95e9271293df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:41.720759 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759ed98-17a5-4b7e-93da-95e9271293df None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:41.721093 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759ed98-17a5-4b7e-93da-95e9271293df None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:41.721322 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759ed98-17a5-4b7e-93da-95e9271293df None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:41.723813 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:41.735543 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759ed98-17a5-4b7e-93da-95e9271293df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:41.743971 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-b759ed98-17a5-4b7e-93da-95e9271293df None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:42:41.743971 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:41.743971 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:41.743971 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:41.743971 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:41.743971 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:41.743971 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:41.743971 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:41.743971 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:41.743971 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:41.743971 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:41.743971 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:41.743971 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:41.743971 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:41.743971 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:41.743971 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:41.744950 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:41.744950 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:41.744950 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:41.744950 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:41.744950 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:41.744950 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:41.744950 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:41.744950 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:41.744950 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:41.744950 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:41.744950 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:41.744950 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:41.744950 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:41.744950 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:41.744950 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:41.744950 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:41.745878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:41.745878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:41.745878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:41.745878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:41.745878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:41.745878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:41.745878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:41.745878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:41.745878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:41.745878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:41.745878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:42:41.745878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:42:41.750666 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 140/279] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:41.751425 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759ed98-17a5-4b7e-93da-95e9271293df None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:41.810941 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf2067-ca1d-49b4-a486-58bf5bba2d0a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:41.822170 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:41.849917 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e4137-4a4b-41c9-a47f-6c3bb9a8e829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:41.850826 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e4137-4a4b-41c9-a47f-6c3bb9a8e829 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:41.851073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e4137-4a4b-41c9-a47f-6c3bb9a8e829 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:41.851349 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e4137-4a4b-41c9-a47f-6c3bb9a8e829 None admin] PATH_INFO: `/v3/users/2698fcc39bf54601bac888cebd5483ff` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:41.858336 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759ed98-17a5-4b7e-93da-95e9271293df None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:41.865775 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e4137-4a4b-41c9-a47f-6c3bb9a8e829 None admin] RBAC: Authorizing `identity:get_user(user_id=2698fcc39bf54601bac888cebd5483ff)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:41.867251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e4137-4a4b-41c9-a47f-6c3bb9a8e829 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:41.869030 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 140/280] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:41 2022] GET /identity/v3/users/2698fcc39bf54601bac888cebd5483ff => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:41.869958 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e4137-4a4b-41c9-a47f-6c3bb9a8e829 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:41.898617 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df9e1b-2e08-40b7-ad13-77aed90f023d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:41.899308 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df9e1b-2e08-40b7-ad13-77aed90f023d None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:41.899601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df9e1b-2e08-40b7-ad13-77aed90f023d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:41.899890 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df9e1b-2e08-40b7-ad13-77aed90f023d None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:41.900641 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df9e1b-2e08-40b7-ad13-77aed90f023d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:41.902328 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df9e1b-2e08-40b7-ad13-77aed90f023d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:41.935927 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 141/281] 10.222.0.85 () {60 vars in 1132 bytes} [Thu Jun 16 14:42:41 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:42:41.935927 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df9e1b-2e08-40b7-ad13-77aed90f023d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:42.000061 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e4137-4a4b-41c9-a47f-6c3bb9a8e829 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:42.008597 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:42.052915 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08fee8-01ba-4136-8f50-0fbb68a9144d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:42.054045 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08fee8-01ba-4136-8f50-0fbb68a9144d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:42.054499 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08fee8-01ba-4136-8f50-0fbb68a9144d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:42.054946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08fee8-01ba-4136-8f50-0fbb68a9144d None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:42.055972 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08fee8-01ba-4136-8f50-0fbb68a9144d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:42.056470 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08fee8-01ba-4136-8f50-0fbb68a9144d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:42.058943 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08fee8-01ba-4136-8f50-0fbb68a9144d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:42.069701 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 141/282] 10.222.0.85 () {56 vars in 1101 bytes} [Thu Jun 16 14:42:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:42.075369 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08fee8-01ba-4136-8f50-0fbb68a9144d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:42.080191 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df9e1b-2e08-40b7-ad13-77aed90f023d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:42.119089 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:42.130806 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52bb97-6860-42ea-a844-9941c3d74638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:42.132429 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52bb97-6860-42ea-a844-9941c3d74638 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:42.132853 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52bb97-6860-42ea-a844-9941c3d74638 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:42.133284 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52bb97-6860-42ea-a844-9941c3d74638 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:42.134282 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52bb97-6860-42ea-a844-9941c3d74638 None admin] RBAC: Adding query filter params (role.id=26e7e900cf574eaabe4fcf886acb0c46, user.id=2698fcc39bf54601bac888cebd5483ff, scope.system=all) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:42.136626 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52bb97-6860-42ea-a844-9941c3d74638 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:42.138499 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52bb97-6860-42ea-a844-9941c3d74638 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:42.145335 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 142/283] 10.222.0.85 () {56 vars in 1308 bytes} [Thu Jun 16 14:42:41 2022] GET /identity/v3/role_assignments?user.id=2698fcc39bf54601bac888cebd5483ff&scope.system=all&role.id=26e7e900cf574eaabe4fcf886acb0c46 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:42.221432 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08fee8-01ba-4136-8f50-0fbb68a9144d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:42.263754 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128806db-f584-4e98-aa3f-091389b74983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:42.264640 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128806db-f584-4e98-aa3f-091389b74983 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:42.264922 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128806db-f584-4e98-aa3f-091389b74983 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:42.265200 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128806db-f584-4e98-aa3f-091389b74983 None admin] PATH_INFO: `/v3/users/4710a673597e4e8b834c6ee483fdb303` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:42.266541 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128806db-f584-4e98-aa3f-091389b74983 None admin] RBAC: Authorizing `identity:get_user(user_id=4710a673597e4e8b834c6ee483fdb303)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:42.268140 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128806db-f584-4e98-aa3f-091389b74983 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:42.270306 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 142/284] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:42 2022] GET /identity/v3/users/4710a673597e4e8b834c6ee483fdb303 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:42.276205 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52bb97-6860-42ea-a844-9941c3d74638 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:42.376877 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e370072-bf13-4801-8fb2-c78470c21e24 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:42.377218 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e370072-bf13-4801-8fb2-c78470c21e24 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:42.377426 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e370072-bf13-4801-8fb2-c78470c21e24 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:42.379209 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 143/285] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:42.384092 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211121de-3e92-42c6-acd6-762c71bfa619 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:42.384383 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211121de-3e92-42c6-acd6-762c71bfa619 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:42.384669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211121de-3e92-42c6-acd6-762c71bfa619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:42.404248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-211121de-3e92-42c6-acd6-762c71bfa619 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:42.405407 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-211121de-3e92-42c6-acd6-762c71bfa619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:42.427151 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52bb97-6860-42ea-a844-9941c3d74638 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:42.445252 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:42.489754 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 144/286] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:42:42.496001 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3c386-f40f-45c1-918d-124e119e7292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:42.496001 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3c386-f40f-45c1-918d-124e119e7292 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:42.496001 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3c386-f40f-45c1-918d-124e119e7292 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:42.496001 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3c386-f40f-45c1-918d-124e119e7292 None admin] PATH_INFO: `/v3/projects/2626df1e7e3e430790b7db426c06948f` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:42.498523 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3c386-f40f-45c1-918d-124e119e7292 None admin] RBAC: Authorizing `identity:get_project(project_id=2626df1e7e3e430790b7db426c06948f)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:42.500046 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3c386-f40f-45c1-918d-124e119e7292 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:42.502170 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 143/287] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:42 2022] GET /identity/v3/projects/2626df1e7e3e430790b7db426c06948f => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:42.507576 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211121de-3e92-42c6-acd6-762c71bfa619 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:42.527338 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3c386-f40f-45c1-918d-124e119e7292 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:42.550574 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:42.620853 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211121de-3e92-42c6-acd6-762c71bfa619 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:42.667052 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c03ee-8fc3-4ff3-b04b-bdaf0c1b27f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:42.668512 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c03ee-8fc3-4ff3-b04b-bdaf0c1b27f2 None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:42.668988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c03ee-8fc3-4ff3-b04b-bdaf0c1b27f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:42.669450 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c03ee-8fc3-4ff3-b04b-bdaf0c1b27f2 None admin] PATH_INFO: `/v3/projects/2626df1e7e3e430790b7db426c06948f/users/4710a673597e4e8b834c6ee483fdb303/roles/d7118e244cb94310a267cf9a9b5bbfd4` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:42.677287 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c03ee-8fc3-4ff3-b04b-bdaf0c1b27f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=2626df1e7e3e430790b7db426c06948f, user_id=4710a673597e4e8b834c6ee483fdb303, role_id=d7118e244cb94310a267cf9a9b5bbfd4)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:42.679272 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c03ee-8fc3-4ff3-b04b-bdaf0c1b27f2 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:42.710232 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 145/288] 10.222.0.85 () {58 vars in 1439 bytes} [Thu Jun 16 14:42:42 2022] PUT /identity/v3/projects/2626df1e7e3e430790b7db426c06948f/users/4710a673597e4e8b834c6ee483fdb303/roles/d7118e244cb94310a267cf9a9b5bbfd4 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:42:42.727255 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3c386-f40f-45c1-918d-124e119e7292 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:42.783740 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e57a8a-c465-4a5b-ac8f-21a485c68a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:42.784583 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e57a8a-c465-4a5b-ac8f-21a485c68a44 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:42.784863 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e57a8a-c465-4a5b-ac8f-21a485c68a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:42.785134 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e57a8a-c465-4a5b-ac8f-21a485c68a44 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:42.804695 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e57a8a-c465-4a5b-ac8f-21a485c68a44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:42.813086 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-27e57a8a-c465-4a5b-ac8f-21a485c68a44 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:42:42.813086 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:42.813086 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:42.813086 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:42.813086 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:42.813086 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:42.813086 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:42.813086 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:42.813086 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:42.813086 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:42.813086 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:42.813086 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:42.813086 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:42.813086 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:42.813086 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:42.813086 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:42.814053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:42.814053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:42.814053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:42.814053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:42.814053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:42.814053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:42.814053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:42.814053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:42.814053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:42.814053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:42.814053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:42.814053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:42.814053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:42.814053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:42.814053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:42.814053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:42.814833 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:42.814833 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:42.814833 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:42.814833 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:42.814833 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:42.814833 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:42.814833 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:42.814833 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:42.814833 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:42.814833 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:42.814833 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:42:42.814833 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:42:42.814833 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 144/289] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:42.820691 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c03ee-8fc3-4ff3-b04b-bdaf0c1b27f2 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:42.968011 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:42.983242 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c03ee-8fc3-4ff3-b04b-bdaf0c1b27f2 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:43.026864 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98da1d3-4d51-4c27-a4d8-debb3c7480d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:43.028279 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98da1d3-4d51-4c27-a4d8-debb3c7480d5 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:43.028755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98da1d3-4d51-4c27-a4d8-debb3c7480d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:43.029250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98da1d3-4d51-4c27-a4d8-debb3c7480d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:43.030228 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98da1d3-4d51-4c27-a4d8-debb3c7480d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:43.030725 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98da1d3-4d51-4c27-a4d8-debb3c7480d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:43.032372 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98da1d3-4d51-4c27-a4d8-debb3c7480d5 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:43.042273 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 146/290] 10.222.0.85 () {56 vars in 1101 bytes} [Thu Jun 16 14:42:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:43.049397 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e57a8a-c465-4a5b-ac8f-21a485c68a44 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:43.127613 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:43.192825 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e57a8a-c465-4a5b-ac8f-21a485c68a44 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:43.235180 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c2a27-2288-4108-8614-c384d29efeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:43.236118 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c2a27-2288-4108-8614-c384d29efeb6 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:43.236405 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c2a27-2288-4108-8614-c384d29efeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:43.236685 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c2a27-2288-4108-8614-c384d29efeb6 None admin] PATH_INFO: `/v3/users/292294d346c24ce785aecbcc9a27fd6c` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:43.237922 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c2a27-2288-4108-8614-c384d29efeb6 None admin] RBAC: Authorizing `identity:get_user(user_id=292294d346c24ce785aecbcc9a27fd6c)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:43.239396 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c2a27-2288-4108-8614-c384d29efeb6 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:43.241559 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 145/291] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:43 2022] GET /identity/v3/users/292294d346c24ce785aecbcc9a27fd6c => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:43.247276 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98da1d3-4d51-4c27-a4d8-debb3c7480d5 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:43.387947 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98da1d3-4d51-4c27-a4d8-debb3c7480d5 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:43.424414 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6628b8a-2423-42f2-a909-1f34ff10d9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:43.425067 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6628b8a-2423-42f2-a909-1f34ff10d9cd None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:43.425342 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6628b8a-2423-42f2-a909-1f34ff10d9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:43.425622 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6628b8a-2423-42f2-a909-1f34ff10d9cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:43.445102 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:43.507556 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6628b8a-2423-42f2-a909-1f34ff10d9cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:43.509090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6628b8a-2423-42f2-a909-1f34ff10d9cd None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:43.649803 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 147/292] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:43.655624 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c2a27-2288-4108-8614-c384d29efeb6 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:43.818836 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c2a27-2288-4108-8614-c384d29efeb6 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:43.837129 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:43.869513 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b161d-5f5c-4d9a-809b-5cc15dd5c9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:43.870464 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b161d-5f5c-4d9a-809b-5cc15dd5c9ec None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:43.870739 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b161d-5f5c-4d9a-809b-5cc15dd5c9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:43.871016 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b161d-5f5c-4d9a-809b-5cc15dd5c9ec None admin] PATH_INFO: `/v3/projects/2626df1e7e3e430790b7db426c06948f` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:43.872253 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b161d-5f5c-4d9a-809b-5cc15dd5c9ec None admin] RBAC: Authorizing `identity:get_project(project_id=2626df1e7e3e430790b7db426c06948f)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:43.873702 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b161d-5f5c-4d9a-809b-5cc15dd5c9ec None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:43.875764 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 146/293] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:43 2022] GET /identity/v3/projects/2626df1e7e3e430790b7db426c06948f => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:43.881847 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6628b8a-2423-42f2-a909-1f34ff10d9cd None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:43.985007 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:44.058028 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6628b8a-2423-42f2-a909-1f34ff10d9cd None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:44.108392 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0fd60-bc6a-4740-8bbe-01705590b011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:44.109383 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0fd60-bc6a-4740-8bbe-01705590b011 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:44.109808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0fd60-bc6a-4740-8bbe-01705590b011 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:44.110227 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0fd60-bc6a-4740-8bbe-01705590b011 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:44.111249 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0fd60-bc6a-4740-8bbe-01705590b011 None admin] RBAC: Adding query filter params (role.id=26e7e900cf574eaabe4fcf886acb0c46, scope.project.id=2626df1e7e3e430790b7db426c06948f, user.id=292294d346c24ce785aecbcc9a27fd6c) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:44.111737 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0fd60-bc6a-4740-8bbe-01705590b011 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:44.113502 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0fd60-bc6a-4740-8bbe-01705590b011 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:44.125546 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 148/294] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:42:43 2022] GET /identity/v3/role_assignments?user.id=292294d346c24ce785aecbcc9a27fd6c&scope.project.id=2626df1e7e3e430790b7db426c06948f&role.id=26e7e900cf574eaabe4fcf886acb0c46 => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:44.825011 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2369e5-155a-4112-8b74-a7928b632ccf None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:44.825521 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2369e5-155a-4112-8b74-a7928b632ccf None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:44.825521 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2369e5-155a-4112-8b74-a7928b632ccf None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:44.827236 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 147/295] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:44.833348 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b72eaa-90ad-4ac2-9898-4e06579ee29a None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:44.834327 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b72eaa-90ad-4ac2-9898-4e06579ee29a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:44.834793 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b72eaa-90ad-4ac2-9898-4e06579ee29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:44.853557 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-93b72eaa-90ad-4ac2-9898-4e06579ee29a None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:44.855359 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-93b72eaa-90ad-4ac2-9898-4e06579ee29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:44.901478 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53b340-8611-454c-9728-d49d3e17a0a0 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:44.902154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53b340-8611-454c-9728-d49d3e17a0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:44.902491 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53b340-8611-454c-9728-d49d3e17a0a0 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:44.904517 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 148/296] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:44.910413 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984e3a7-28ba-4d28-a38a-6454669788b5 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:44.911028 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984e3a7-28ba-4d28-a38a-6454669788b5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:44.911511 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984e3a7-28ba-4d28-a38a-6454669788b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:44.930779 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e984e3a7-28ba-4d28-a38a-6454669788b5 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:44.932675 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e984e3a7-28ba-4d28-a38a-6454669788b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:44.936012 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 149/297] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:44.954028 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b72eaa-90ad-4ac2-9898-4e06579ee29a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:45.002174 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:45.006353 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 149/298] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:42:45.007705 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b9f08-4aec-4a88-9c0f-c1e7458e48a3 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:45.008023 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b9f08-4aec-4a88-9c0f-c1e7458e48a3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:45.008301 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b9f08-4aec-4a88-9c0f-c1e7458e48a3 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:45.009723 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 150/299] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:45.017913 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e907a0-7c3f-43f9-95b4-daf987d44139 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:45.018202 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e907a0-7c3f-43f9-95b4-daf987d44139 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:45.018484 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e907a0-7c3f-43f9-95b4-daf987d44139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:45.037918 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f5e907a0-7c3f-43f9-95b4-daf987d44139 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:45.039110 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f5e907a0-7c3f-43f9-95b4-daf987d44139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:45.064316 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b72eaa-90ad-4ac2-9898-4e06579ee29a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:45.099953 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d64b4f-60b6-4753-a341-3d8721da9267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:45.100763 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d64b4f-60b6-4753-a341-3d8721da9267 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:45.101048 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d64b4f-60b6-4753-a341-3d8721da9267 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:45.101327 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d64b4f-60b6-4753-a341-3d8721da9267 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:45.102588 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d64b4f-60b6-4753-a341-3d8721da9267 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:45.104124 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d64b4f-60b6-4753-a341-3d8721da9267 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:45.105957 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 150/300] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:45.106554 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d64b4f-60b6-4753-a341-3d8721da9267 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:45.123896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 151/301] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:42:45.123896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e907a0-7c3f-43f9-95b4-daf987d44139 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:45.162871 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:45.229433 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d64b4f-60b6-4753-a341-3d8721da9267 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:45.229810 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e907a0-7c3f-43f9-95b4-daf987d44139 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:45.243134 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:45.265564 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c8190-603e-48e5-852a-c8668b3a738e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:45.266379 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c8190-603e-48e5-852a-c8668b3a738e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:45.266663 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c8190-603e-48e5-852a-c8668b3a738e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:45.266936 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c8190-603e-48e5-852a-c8668b3a738e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:45.267702 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91ecee-6e8b-4b8c-9baa-4f0a6ca57619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:45.268411 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91ecee-6e8b-4b8c-9baa-4f0a6ca57619 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:45.268730 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91ecee-6e8b-4b8c-9baa-4f0a6ca57619 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:45.269014 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91ecee-6e8b-4b8c-9baa-4f0a6ca57619 None admin] PATH_INFO: `/v3/groups` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:45.269708 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91ecee-6e8b-4b8c-9baa-4f0a6ca57619 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:45.271170 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91ecee-6e8b-4b8c-9baa-4f0a6ca57619 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:45.277517 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c8190-603e-48e5-852a-c8668b3a738e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:45.286246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 152/302] 10.222.0.85 () {60 vars in 1134 bytes} [Thu Jun 16 14:42:45 2022] POST /identity/v3/groups => generated 229 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:42:45.286359 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-ef9c8190-603e-48e5-852a-c8668b3a738e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:42:45.286359 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:45.286359 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:45.286359 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:45.286359 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:45.286359 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:45.286359 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:45.286359 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:45.286359 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:45.286359 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:45.286359 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:45.286359 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:45.286359 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:45.286359 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:45.286359 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:45.286359 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:45.287364 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:45.287364 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:45.287364 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:45.287364 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:45.287364 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:45.287364 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:45.287364 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:45.287364 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:45.287364 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:45.287364 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:45.287364 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:45.287364 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:45.287364 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:45.287364 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:45.287364 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:45.287364 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:45.289141 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:45.289141 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:45.289141 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:45.289141 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:45.289141 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:45.289141 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:45.289141 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:45.289141 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:45.289141 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:45.289141 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:45.289141 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:42:45.289141 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:42:45.289739 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91ecee-6e8b-4b8c-9baa-4f0a6ca57619 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:45.289807 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 151/303] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:45.289807 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77cff6-11a5-429f-a174-55ce8ce8b9ca None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:45.289807 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77cff6-11a5-429f-a174-55ce8ce8b9ca None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:45.289807 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77cff6-11a5-429f-a174-55ce8ce8b9ca None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:45.290757 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 152/304] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:45.293572 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77cff6-11a5-429f-a174-55ce8ce8b9ca None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:45.411277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77cff6-11a5-429f-a174-55ce8ce8b9ca None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:45.424666 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:45.429770 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91ecee-6e8b-4b8c-9baa-4f0a6ca57619 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:45.451119 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9ea65-0eef-4b23-a948-4064bdf3c13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:45.451804 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9ea65-0eef-4b23-a948-4064bdf3c13d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:45.452125 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9ea65-0eef-4b23-a948-4064bdf3c13d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:45.452405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9ea65-0eef-4b23-a948-4064bdf3c13d None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:45.453171 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9ea65-0eef-4b23-a948-4064bdf3c13d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:45.453870 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9ea65-0eef-4b23-a948-4064bdf3c13d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:45.454877 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9ea65-0eef-4b23-a948-4064bdf3c13d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:45.468950 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 153/305] 10.222.0.85 () {56 vars in 1101 bytes} [Thu Jun 16 14:42:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:45.470176 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b658c-0904-439b-a131-5c2dbbb017a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:45.470384 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd7c81-a49b-410b-94cd-31969d3651ce None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:45.470622 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd7c81-a49b-410b-94cd-31969d3651ce None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:45.470923 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd7c81-a49b-410b-94cd-31969d3651ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:45.471031 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b658c-0904-439b-a131-5c2dbbb017a3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:45.471737 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b658c-0904-439b-a131-5c2dbbb017a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:45.471737 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b658c-0904-439b-a131-5c2dbbb017a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:45.486626 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b658c-0904-439b-a131-5c2dbbb017a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:45.492695 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-9ecd7c81-a49b-410b-94cd-31969d3651ce None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:45.494037 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9ecd7c81-a49b-410b-94cd-31969d3651ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:45.494395 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-b01b658c-0904-439b-a131-5c2dbbb017a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:42:45.494395 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:45.494395 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:45.494395 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:45.494395 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:45.494395 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:45.494395 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:45.494395 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:45.494395 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:45.494395 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:45.494395 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:45.494395 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:45.494395 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:45.494395 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:45.494395 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:45.494395 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:45.495347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:45.495347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:45.495347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:45.495347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:45.495347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:45.495347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:45.495347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:45.495347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:45.495347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:45.495347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:45.495347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:45.495347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:45.495347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:45.495347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:45.495347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:45.495347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:45.496235 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:45.496235 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:45.496235 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:45.496235 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:45.496235 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:45.496235 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:45.496235 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:45.496235 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:45.496235 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:45.496235 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:45.496235 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:42:45.496235 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:42:45.496867 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 153/306] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:45.497423 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b658c-0904-439b-a131-5c2dbbb017a3 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:45.527474 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:45.576052 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 154/307] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:45.576052 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd7c81-a49b-410b-94cd-31969d3651ce None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:45.622508 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b658c-0904-439b-a131-5c2dbbb017a3 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:45.662615 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5db0e8-c751-47ea-93b9-eb39bc6e0406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:45.663706 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5db0e8-c751-47ea-93b9-eb39bc6e0406 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:45.664026 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5db0e8-c751-47ea-93b9-eb39bc6e0406 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:45.664450 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5db0e8-c751-47ea-93b9-eb39bc6e0406 None admin] PATH_INFO: `/v3/users/61a16ed8b68c4557a5500e27876f7a94` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:45.681083 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5db0e8-c751-47ea-93b9-eb39bc6e0406 None admin] RBAC: Authorizing `identity:get_user(user_id=61a16ed8b68c4557a5500e27876f7a94)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:45.682687 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5db0e8-c751-47ea-93b9-eb39bc6e0406 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:45.684764 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 154/308] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:45 2022] GET /identity/v3/users/61a16ed8b68c4557a5500e27876f7a94 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:45.686318 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd7c81-a49b-410b-94cd-31969d3651ce None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:45.690078 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5db0e8-c751-47ea-93b9-eb39bc6e0406 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:45.709247 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:45.722837 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f9617-b320-4460-9a86-04f7df510526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:45.723462 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f9617-b320-4460-9a86-04f7df510526 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:45.723743 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f9617-b320-4460-9a86-04f7df510526 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:45.724043 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f9617-b320-4460-9a86-04f7df510526 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:45.724800 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f9617-b320-4460-9a86-04f7df510526 None admin] RBAC: Adding query filter params (name=member) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:45.725107 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f9617-b320-4460-9a86-04f7df510526 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:45.726502 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f9617-b320-4460-9a86-04f7df510526 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:45.735475 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 155/309] 10.222.0.85 () {56 vars in 1101 bytes} [Thu Jun 16 14:42:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:45.736340 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f9617-b320-4460-9a86-04f7df510526 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:45.768244 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:45.802498 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5db0e8-c751-47ea-93b9-eb39bc6e0406 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:45.838865 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192dfb86-58eb-40ed-bd1b-f99ba38f30cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:45.839773 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192dfb86-58eb-40ed-bd1b-f99ba38f30cd None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:45.840089 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192dfb86-58eb-40ed-bd1b-f99ba38f30cd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:45.840362 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192dfb86-58eb-40ed-bd1b-f99ba38f30cd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:45.845562 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f9617-b320-4460-9a86-04f7df510526 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:45.851122 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192dfb86-58eb-40ed-bd1b-f99ba38f30cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:45.858986 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-192dfb86-58eb-40ed-bd1b-f99ba38f30cd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:42:45.858986 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:45.858986 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:45.858986 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:45.858986 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:45.858986 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:45.858986 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:45.858986 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:45.858986 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:45.858986 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:45.858986 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:45.858986 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:45.858986 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:45.858986 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:45.858986 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:45.858986 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:45.860306 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:45.860306 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:45.860306 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:45.860306 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:45.860306 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:45.860306 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:45.860306 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:45.860306 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:45.860306 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:45.860306 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:45.860306 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:45.860306 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:45.860306 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:45.860306 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:45.860306 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:45.860306 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:45.861110 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:45.861110 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:45.861110 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:45.861110 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:45.861110 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:45.861110 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:45.861110 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:45.861110 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:45.861110 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:45.861110 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:45.861110 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:42:45.861110 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:42:45.861110 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 155/310] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:45.861767 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192dfb86-58eb-40ed-bd1b-f99ba38f30cd None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:45.888287 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af091527-ed01-46ea-829d-655e085dfff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:45.888970 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af091527-ed01-46ea-829d-655e085dfff3 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:45.889257 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af091527-ed01-46ea-829d-655e085dfff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:45.889521 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af091527-ed01-46ea-829d-655e085dfff3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:45.890365 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af091527-ed01-46ea-829d-655e085dfff3 None admin] RBAC: Adding query filter params (role.id=d7118e244cb94310a267cf9a9b5bbfd4, user.id=61a16ed8b68c4557a5500e27876f7a94, scope.system=all) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:45.890683 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af091527-ed01-46ea-829d-655e085dfff3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:45.892168 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af091527-ed01-46ea-829d-655e085dfff3 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:45.897518 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 156/311] 10.222.0.85 () {56 vars in 1308 bytes} [Thu Jun 16 14:42:45 2022] GET /identity/v3/role_assignments?user.id=61a16ed8b68c4557a5500e27876f7a94&scope.system=all&role.id=d7118e244cb94310a267cf9a9b5bbfd4 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:45.898336 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af091527-ed01-46ea-829d-655e085dfff3 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:45.968270 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:46.009950 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192dfb86-58eb-40ed-bd1b-f99ba38f30cd None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:46.032142 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:46.045239 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af091527-ed01-46ea-829d-655e085dfff3 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:46.068565 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdddbfa-b8a6-4523-bb82-2c5bc0ea23ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:46.070499 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdddbfa-b8a6-4523-bb82-2c5bc0ea23ca None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:46.071010 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdddbfa-b8a6-4523-bb82-2c5bc0ea23ca None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:46.071631 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdddbfa-b8a6-4523-bb82-2c5bc0ea23ca None admin] PATH_INFO: `/v3/users/2698fcc39bf54601bac888cebd5483ff` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:46.073551 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdddbfa-b8a6-4523-bb82-2c5bc0ea23ca None admin] RBAC: Authorizing `identity:get_user(user_id=2698fcc39bf54601bac888cebd5483ff)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:46.075708 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdddbfa-b8a6-4523-bb82-2c5bc0ea23ca None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:46.078151 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 156/312] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:45 2022] GET /identity/v3/users/2698fcc39bf54601bac888cebd5483ff => generated 293 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:46.083788 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdddbfa-b8a6-4523-bb82-2c5bc0ea23ca None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:46.086934 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2c4db-cbb6-480a-842d-ce2f6004317f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:46.087619 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2c4db-cbb6-480a-842d-ce2f6004317f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:46.087930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2c4db-cbb6-480a-842d-ce2f6004317f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:46.088248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2c4db-cbb6-480a-842d-ce2f6004317f None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:46.089075 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2c4db-cbb6-480a-842d-ce2f6004317f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:46.089408 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2c4db-cbb6-480a-842d-ce2f6004317f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:46.090917 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2c4db-cbb6-480a-842d-ce2f6004317f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:46.101283 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 157/313] 10.222.0.85 () {56 vars in 1101 bytes} [Thu Jun 16 14:42:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:46.107317 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2c4db-cbb6-480a-842d-ce2f6004317f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:46.196270 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdddbfa-b8a6-4523-bb82-2c5bc0ea23ca None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:46.231506 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17291d-2784-4810-bf68-79fedf526734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:46.232751 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17291d-2784-4810-bf68-79fedf526734 None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:46.233247 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17291d-2784-4810-bf68-79fedf526734 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:46.233713 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17291d-2784-4810-bf68-79fedf526734 None admin] PATH_INFO: `/v3/system/users/2698fcc39bf54601bac888cebd5483ff/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:46.235389 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17291d-2784-4810-bf68-79fedf526734 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2698fcc39bf54601bac888cebd5483ff, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:46.237009 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17291d-2784-4810-bf68-79fedf526734 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:46.237582 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2c4db-cbb6-480a-842d-ce2f6004317f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:46.256416 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 157/314] 10.222.0.85 () {58 vars in 1334 bytes} [Thu Jun 16 14:42:46 2022] PUT /identity/v3/system/users/2698fcc39bf54601bac888cebd5483ff/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:42:46.275797 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8327c-2aee-449e-922d-1bc331280b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:46.276973 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8327c-2aee-449e-922d-1bc331280b42 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:46.277257 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8327c-2aee-449e-922d-1bc331280b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:46.277533 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8327c-2aee-449e-922d-1bc331280b42 None admin] PATH_INFO: `/v3/users/4710a673597e4e8b834c6ee483fdb303` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:46.278813 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8327c-2aee-449e-922d-1bc331280b42 None admin] RBAC: Authorizing `identity:get_user(user_id=4710a673597e4e8b834c6ee483fdb303)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:46.280336 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8327c-2aee-449e-922d-1bc331280b42 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:46.282414 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 158/315] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:46 2022] GET /identity/v3/users/4710a673597e4e8b834c6ee483fdb303 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:46.287752 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17291d-2784-4810-bf68-79fedf526734 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:46.311520 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:46.430163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17291d-2784-4810-bf68-79fedf526734 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:46.466878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70235e-5626-4c33-9e6f-96c80d96f971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:46.467550 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70235e-5626-4c33-9e6f-96c80d96f971 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:46.467837 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70235e-5626-4c33-9e6f-96c80d96f971 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:46.468172 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70235e-5626-4c33-9e6f-96c80d96f971 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:46.545156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70235e-5626-4c33-9e6f-96c80d96f971 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:46.546650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70235e-5626-4c33-9e6f-96c80d96f971 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:46.566560 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:46.668353 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 158/316] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:46.675136 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8327c-2aee-449e-922d-1bc331280b42 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:46.703004 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:46.793918 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8327c-2aee-449e-922d-1bc331280b42 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:46.830889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138752a-5640-4788-8a1b-2e8ef5ef1e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:46.831681 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138752a-5640-4788-8a1b-2e8ef5ef1e3c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:46.831992 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138752a-5640-4788-8a1b-2e8ef5ef1e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:46.832286 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138752a-5640-4788-8a1b-2e8ef5ef1e3c None admin] PATH_INFO: `/v3/projects/2626df1e7e3e430790b7db426c06948f` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:46.833591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8138752a-5640-4788-8a1b-2e8ef5ef1e3c None admin] RBAC: Authorizing `identity:get_project(project_id=2626df1e7e3e430790b7db426c06948f)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:46.834990 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8138752a-5640-4788-8a1b-2e8ef5ef1e3c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:46.837151 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 159/317] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:46 2022] GET /identity/v3/projects/2626df1e7e3e430790b7db426c06948f => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:46.843445 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70235e-5626-4c33-9e6f-96c80d96f971 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:46.953549 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70235e-5626-4c33-9e6f-96c80d96f971 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:46.964299 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:46.993226 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e2057-bb46-45e9-84ad-ca63f3a973d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:46.994066 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e2057-bb46-45e9-84ad-ca63f3a973d2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:46.994421 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e2057-bb46-45e9-84ad-ca63f3a973d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:46.994824 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e2057-bb46-45e9-84ad-ca63f3a973d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:46.996208 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e2057-bb46-45e9-84ad-ca63f3a973d2 None admin] RBAC: Adding query filter params (role.id=d7118e244cb94310a267cf9a9b5bbfd4, scope.project.id=2626df1e7e3e430790b7db426c06948f, user.id=4710a673597e4e8b834c6ee483fdb303) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:46.996536 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e2057-bb46-45e9-84ad-ca63f3a973d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:46.998226 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e2057-bb46-45e9-84ad-ca63f3a973d2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:47.005208 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 159/318] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:42:46 2022] GET /identity/v3/role_assignments?user.id=4710a673597e4e8b834c6ee483fdb303&scope.project.id=2626df1e7e3e430790b7db426c06948f&role.id=d7118e244cb94310a267cf9a9b5bbfd4 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:47.481483 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1831b0-56b8-4427-9e01-83eae2492123 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:47.482104 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1831b0-56b8-4427-9e01-83eae2492123 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:47.482104 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1831b0-56b8-4427-9e01-83eae2492123 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:47.483400 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 160/319] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:47.489088 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5aac6-7c3d-46e2-b049-a915da03d962 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:47.489475 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5aac6-7c3d-46e2-b049-a915da03d962 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:47.489786 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5aac6-7c3d-46e2-b049-a915da03d962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:47.509371 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1bc5aac6-7c3d-46e2-b049-a915da03d962 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:47.510816 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1bc5aac6-7c3d-46e2-b049-a915da03d962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:47.607901 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 160/320] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:47.625251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1831b0-56b8-4427-9e01-83eae2492123 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:47.738879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:47.757551 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1831b0-56b8-4427-9e01-83eae2492123 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:47.801097 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9858b-eef0-421d-870c-3ad396b41820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:47.801942 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9858b-eef0-421d-870c-3ad396b41820 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:47.802216 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9858b-eef0-421d-870c-3ad396b41820 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:47.802485 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9858b-eef0-421d-870c-3ad396b41820 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:47.803661 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9858b-eef0-421d-870c-3ad396b41820 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:47.805187 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9858b-eef0-421d-870c-3ad396b41820 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:47.807013 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 161/321] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:47.812811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5aac6-7c3d-46e2-b049-a915da03d962 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:47.920317 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5aac6-7c3d-46e2-b049-a915da03d962 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:47.921942 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:47.979396 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c305be7-d846-46ce-ab59-bbb84a876d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:47.980492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c305be7-d846-46ce-ab59-bbb84a876d11 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:47.981011 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c305be7-d846-46ce-ab59-bbb84a876d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:47.981452 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c305be7-d846-46ce-ab59-bbb84a876d11 None admin] PATH_INFO: `/v3/groups` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:47.982613 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c305be7-d846-46ce-ab59-bbb84a876d11 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:47.985060 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c305be7-d846-46ce-ab59-bbb84a876d11 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:48.005333 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 161/322] 10.222.0.85 () {60 vars in 1134 bytes} [Thu Jun 16 14:42:47 2022] POST /identity/v3/groups => generated 226 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:42:48.231473 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929516a2-d0cf-48ca-8bbb-40e0647da676 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:48.231762 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929516a2-d0cf-48ca-8bbb-40e0647da676 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:48.232115 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929516a2-d0cf-48ca-8bbb-40e0647da676 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:48.233535 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 162/323] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:48.239109 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75256ac4-ac8e-40d5-abf4-41d9fb46b93a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:48.239405 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75256ac4-ac8e-40d5-abf4-41d9fb46b93a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:48.239681 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75256ac4-ac8e-40d5-abf4-41d9fb46b93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:48.258950 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-75256ac4-ac8e-40d5-abf4-41d9fb46b93a None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:48.260175 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-75256ac4-ac8e-40d5-abf4-41d9fb46b93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:48.333448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 162/324] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:48.355820 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929516a2-d0cf-48ca-8bbb-40e0647da676 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:48.473859 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929516a2-d0cf-48ca-8bbb-40e0647da676 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:48.511586 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ab88b-6320-4419-90e0-0f4154cad489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:48.512442 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ab88b-6320-4419-90e0-0f4154cad489 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:48.512766 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ab88b-6320-4419-90e0-0f4154cad489 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:48.513046 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ab88b-6320-4419-90e0-0f4154cad489 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:48.530722 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ab88b-6320-4419-90e0-0f4154cad489 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:48.539106 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-5c6ab88b-6320-4419-90e0-0f4154cad489 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:42:48.539106 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:48.539106 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:48.539106 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:48.539106 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:48.539106 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:48.539106 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:48.539106 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:48.539106 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:48.539106 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:48.539106 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:48.539106 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:48.539106 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:48.539106 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:48.539106 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:48.539106 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:48.540155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:48.540155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:48.540155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:48.540155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:48.540155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:48.540155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:48.540155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:48.540155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:48.540155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:48.540155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:48.540155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:48.540155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:48.540155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:48.540155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:48.540155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:48.540155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:48.540937 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:48.540937 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:48.540937 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:48.540937 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:48.540937 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:48.540937 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:48.540937 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:48.540937 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:48.540937 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:48.540937 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:48.540937 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:42:48.540937 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:42:48.540937 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 163/325] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:48.548192 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75256ac4-ac8e-40d5-abf4-41d9fb46b93a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:48.599839 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eadf41-75c8-4023-9c1f-37258c73c158 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:48.600183 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eadf41-75c8-4023-9c1f-37258c73c158 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:48.600449 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eadf41-75c8-4023-9c1f-37258c73c158 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:48.601989 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 164/326] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:48.607843 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ab1a7-0025-4f9b-ad00-a532d8ff90ed None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:48.608503 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ab1a7-0025-4f9b-ad00-a532d8ff90ed None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:48.608977 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ab1a7-0025-4f9b-ad00-a532d8ff90ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:48.631901 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-3b9ab1a7-0025-4f9b-ad00-a532d8ff90ed None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:48.631901 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3b9ab1a7-0025-4f9b-ad00-a532d8ff90ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:48.648275 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:48.672487 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:48.685765 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75256ac4-ac8e-40d5-abf4-41d9fb46b93a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:48.729739 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41000b23-4555-461d-affe-4b8f549a23f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:48.730521 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41000b23-4555-461d-affe-4b8f549a23f3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:48.730807 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41000b23-4555-461d-affe-4b8f549a23f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:48.731085 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41000b23-4555-461d-affe-4b8f549a23f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:48.731842 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41000b23-4555-461d-affe-4b8f549a23f3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:48.734629 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41000b23-4555-461d-affe-4b8f549a23f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:48.735972 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 165/327] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:42:48.736165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41000b23-4555-461d-affe-4b8f549a23f3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:48.746429 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 163/328] 10.222.0.85 () {56 vars in 1101 bytes} [Thu Jun 16 14:42:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:48.751847 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ab1a7-0025-4f9b-ad00-a532d8ff90ed None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:48.759511 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41000b23-4555-461d-affe-4b8f549a23f3 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:48.865936 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ab1a7-0025-4f9b-ad00-a532d8ff90ed None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:48.884575 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41000b23-4555-461d-affe-4b8f549a23f3 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:48.904562 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75554e97-9b56-4a8e-abae-b1f1be774f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:48.905464 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75554e97-9b56-4a8e-abae-b1f1be774f2b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:48.905749 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75554e97-9b56-4a8e-abae-b1f1be774f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:48.906030 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75554e97-9b56-4a8e-abae-b1f1be774f2b None admin] PATH_INFO: `/v3/users/61a16ed8b68c4557a5500e27876f7a94` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:48.907829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75554e97-9b56-4a8e-abae-b1f1be774f2b None admin] RBAC: Authorizing `identity:get_user(user_id=61a16ed8b68c4557a5500e27876f7a94)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:48.909670 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75554e97-9b56-4a8e-abae-b1f1be774f2b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:48.912265 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 166/329] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:48 2022] GET /identity/v3/users/61a16ed8b68c4557a5500e27876f7a94 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:48.918158 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75554e97-9b56-4a8e-abae-b1f1be774f2b None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:48.934580 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c57bfe-cfc0-4d0b-9871-5b5f27ff5035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:48.935409 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c57bfe-cfc0-4d0b-9871-5b5f27ff5035 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:48.935833 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c57bfe-cfc0-4d0b-9871-5b5f27ff5035 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:48.936170 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c57bfe-cfc0-4d0b-9871-5b5f27ff5035 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:48.944893 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:48.954450 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c57bfe-cfc0-4d0b-9871-5b5f27ff5035 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:48.964602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-34c57bfe-cfc0-4d0b-9871-5b5f27ff5035 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:42:48.964602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:48.964602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:48.964602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:48.964602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:48.964602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:48.964602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:48.964602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:48.964602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:48.964602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:48.964602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:48.964602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:48.964602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:48.964602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:48.964602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:48.964602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:48.965745 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:48.965745 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:48.965745 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:48.965745 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:48.965745 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:48.965745 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:48.965745 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:48.965745 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:48.965745 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:48.965745 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:48.965745 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:48.965745 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:48.965745 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:48.965745 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:48.965745 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:48.965745 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:48.966766 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:48.966766 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:48.966766 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:48.966766 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:48.966766 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:48.966766 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:48.966766 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:48.966766 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:48.966766 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:48.966766 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:48.966766 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:42:48.966766 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:42:48.969785 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 164/330] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:48.975570 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c57bfe-cfc0-4d0b-9871-5b5f27ff5035 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:48.992792 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:49.033636 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75554e97-9b56-4a8e-abae-b1f1be774f2b None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:49.070541 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17035141-b44d-4419-ad2b-5bc9de6adab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:49.071706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17035141-b44d-4419-ad2b-5bc9de6adab4 None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:49.072159 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17035141-b44d-4419-ad2b-5bc9de6adab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:49.072621 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17035141-b44d-4419-ad2b-5bc9de6adab4 None admin] PATH_INFO: `/v3/system/users/61a16ed8b68c4557a5500e27876f7a94/roles/d7118e244cb94310a267cf9a9b5bbfd4` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:49.074439 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17035141-b44d-4419-ad2b-5bc9de6adab4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=61a16ed8b68c4557a5500e27876f7a94, role_id=d7118e244cb94310a267cf9a9b5bbfd4)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:49.076008 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17035141-b44d-4419-ad2b-5bc9de6adab4 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:49.086964 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c57bfe-cfc0-4d0b-9871-5b5f27ff5035 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:49.092858 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 167/331] 10.222.0.85 () {58 vars in 1334 bytes} [Thu Jun 16 14:42:48 2022] PUT /identity/v3/system/users/61a16ed8b68c4557a5500e27876f7a94/roles/d7118e244cb94310a267cf9a9b5bbfd4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:42:49.127649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccffbe-e063-4549-afc4-34dc45358868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:49.128293 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccffbe-e063-4549-afc4-34dc45358868 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:49.128581 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccffbe-e063-4549-afc4-34dc45358868 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:49.128860 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccffbe-e063-4549-afc4-34dc45358868 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:49.129634 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ccffbe-e063-4549-afc4-34dc45358868 None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:49.129955 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ccffbe-e063-4549-afc4-34dc45358868 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:49.131447 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ccffbe-e063-4549-afc4-34dc45358868 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:49.142553 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 165/332] 10.222.0.85 () {56 vars in 1101 bytes} [Thu Jun 16 14:42:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:49.148227 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17035141-b44d-4419-ad2b-5bc9de6adab4 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:49.244558 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:49.277565 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17035141-b44d-4419-ad2b-5bc9de6adab4 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:49.322373 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d88de-016c-4ad0-a72d-10aed2cc91ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:49.323682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d88de-016c-4ad0-a72d-10aed2cc91ff None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:49.324187 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d88de-016c-4ad0-a72d-10aed2cc91ff None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:49.324637 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d88de-016c-4ad0-a72d-10aed2cc91ff None admin] PATH_INFO: `/v3/users/2698fcc39bf54601bac888cebd5483ff` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:49.327890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d88de-016c-4ad0-a72d-10aed2cc91ff None admin] RBAC: Authorizing `identity:get_user(user_id=2698fcc39bf54601bac888cebd5483ff)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:49.329598 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d88de-016c-4ad0-a72d-10aed2cc91ff None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:49.331939 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 168/333] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:49 2022] GET /identity/v3/users/2698fcc39bf54601bac888cebd5483ff => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:49.337749 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccffbe-e063-4549-afc4-34dc45358868 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:49.455473 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:49.484868 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccffbe-e063-4549-afc4-34dc45358868 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:49.532543 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ac102-11ca-4200-9c2f-fd3bf2d7cad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:49.533542 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ac102-11ca-4200-9c2f-fd3bf2d7cad8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:49.533994 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ac102-11ca-4200-9c2f-fd3bf2d7cad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:49.534555 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ac102-11ca-4200-9c2f-fd3bf2d7cad8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:49.535583 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ac102-11ca-4200-9c2f-fd3bf2d7cad8 None admin] RBAC: Adding query filter params (role.id=26e7e900cf574eaabe4fcf886acb0c46, user.id=2698fcc39bf54601bac888cebd5483ff, scope.system=all) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:49.536089 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ac102-11ca-4200-9c2f-fd3bf2d7cad8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:49.537730 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ac102-11ca-4200-9c2f-fd3bf2d7cad8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:49.557452 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 166/334] 10.222.0.85 () {56 vars in 1308 bytes} [Thu Jun 16 14:42:49 2022] GET /identity/v3/role_assignments?user.id=2698fcc39bf54601bac888cebd5483ff&scope.system=all&role.id=26e7e900cf574eaabe4fcf886acb0c46 => generated 510 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:51.112226 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95762c7a-6b03-4663-849d-e11edec39f09 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:51.113323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95762c7a-6b03-4663-849d-e11edec39f09 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:51.113816 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95762c7a-6b03-4663-849d-e11edec39f09 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:51.115773 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 169/335] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:51.121480 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa7f1b-2668-402d-9769-f5c4146b3016 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:51.122395 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa7f1b-2668-402d-9769-f5c4146b3016 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:51.122906 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa7f1b-2668-402d-9769-f5c4146b3016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:51.141250 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-69fa7f1b-2668-402d-9769-f5c4146b3016 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:51.142788 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-69fa7f1b-2668-402d-9769-f5c4146b3016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:51.217708 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 167/336] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:51.265762 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95762c7a-6b03-4663-849d-e11edec39f09 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:51.378138 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a409e87-8cbf-4834-ba0b-7e86fc28814e None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:51.378755 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a409e87-8cbf-4834-ba0b-7e86fc28814e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:51.379241 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a409e87-8cbf-4834-ba0b-7e86fc28814e None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:51.384543 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 168/337] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:51.386367 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f5189-7d1f-4d5d-b1a7-b73beac3f016 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:51.386846 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f5189-7d1f-4d5d-b1a7-b73beac3f016 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:51.387323 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f5189-7d1f-4d5d-b1a7-b73beac3f016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:51.388203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95762c7a-6b03-4663-849d-e11edec39f09 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:51.420967 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3d8f5189-7d1f-4d5d-b1a7-b73beac3f016 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:51.422532 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3d8f5189-7d1f-4d5d-b1a7-b73beac3f016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:51.441412 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94489e-10c9-4caa-b295-db9b0b3390c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:51.442234 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94489e-10c9-4caa-b295-db9b0b3390c9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:51.442515 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94489e-10c9-4caa-b295-db9b0b3390c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:51.442790 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94489e-10c9-4caa-b295-db9b0b3390c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:51.466764 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94489e-10c9-4caa-b295-db9b0b3390c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:51.481021 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-dc94489e-10c9-4caa-b295-db9b0b3390c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:42:51.481021 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:51.481021 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:51.481021 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:51.481021 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:51.481021 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:51.481021 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:51.481021 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:51.481021 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:51.481021 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:51.481021 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:51.481021 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:51.481021 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:51.481021 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:51.481021 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:51.481021 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:51.482088 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:51.482088 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:51.482088 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:51.482088 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:51.482088 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:51.482088 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:51.482088 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:51.482088 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:51.482088 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:51.482088 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:51.482088 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:51.482088 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:51.482088 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:51.482088 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:51.482088 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:51.482088 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:51.482889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:51.482889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:51.482889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:51.482889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:51.482889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:51.482889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:51.482889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:51.482889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:51.482889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:51.482889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:51.482889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:42:51.482889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:42:51.489406 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 170/338] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:51.496984 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94489e-10c9-4caa-b295-db9b0b3390c9 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:51.512257 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:51.551904 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:51.569700 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 169/339] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:51.640867 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f5189-7d1f-4d5d-b1a7-b73beac3f016 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:51.794910 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94489e-10c9-4caa-b295-db9b0b3390c9 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:51.799341 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f5189-7d1f-4d5d-b1a7-b73beac3f016 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:51.846093 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89980d-2c3e-45b9-84b6-2807746a5246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:51.847215 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89980d-2c3e-45b9-84b6-2807746a5246 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:51.847637 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89980d-2c3e-45b9-84b6-2807746a5246 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:51.848108 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89980d-2c3e-45b9-84b6-2807746a5246 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:51.869557 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89980d-2c3e-45b9-84b6-2807746a5246 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:51.876628 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ceb70f-3811-4cc3-961d-8b68601cfa2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:51.877616 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ceb70f-3811-4cc3-961d-8b68601cfa2c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:51.878110 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ceb70f-3811-4cc3-961d-8b68601cfa2c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:51.878580 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ceb70f-3811-4cc3-961d-8b68601cfa2c None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:51.879533 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ceb70f-3811-4cc3-961d-8b68601cfa2c None admin] RBAC: Adding query filter params (name=member) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:51.880062 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ceb70f-3811-4cc3-961d-8b68601cfa2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:51.881666 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ceb70f-3811-4cc3-961d-8b68601cfa2c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:51.886425 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-6a89980d-2c3e-45b9-84b6-2807746a5246 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:42:51.886425 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:51.886425 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:51.886425 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:51.886425 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:51.886425 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:51.886425 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:51.886425 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:51.886425 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:51.886425 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:51.886425 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:51.886425 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:51.886425 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:51.886425 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:51.886425 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:51.886425 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:51.887338 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:51.887338 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:51.887338 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:51.887338 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:51.887338 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:51.887338 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:51.887338 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:51.887338 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:51.887338 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:51.887338 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:51.887338 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:51.887338 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:51.887338 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:51.887338 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:51.887338 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:51.887338 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:51.888164 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:51.888164 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:51.888164 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:51.888164 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:51.888164 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:51.888164 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:51.888164 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:51.888164 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:51.888164 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:51.888164 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:51.888164 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:42:51.888164 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:42:51.891110 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 170/340] 10.222.0.85 () {56 vars in 1114 bytes} [Thu Jun 16 14:42:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:51.892266 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 171/341] 10.222.0.85 () {56 vars in 1101 bytes} [Thu Jun 16 14:42:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:51.896396 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89980d-2c3e-45b9-84b6-2807746a5246 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:51.899186 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ceb70f-3811-4cc3-961d-8b68601cfa2c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:51.970029 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:52.023967 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89980d-2c3e-45b9-84b6-2807746a5246 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:52.029433 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:52.050140 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ceb70f-3811-4cc3-961d-8b68601cfa2c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:52.069093 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19c3ca-915c-4187-8811-413002716ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:52.070139 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19c3ca-915c-4187-8811-413002716ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:52.070601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19c3ca-915c-4187-8811-413002716ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:52.071052 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19c3ca-915c-4187-8811-413002716ff2 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:52.072052 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19c3ca-915c-4187-8811-413002716ff2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:52.072612 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19c3ca-915c-4187-8811-413002716ff2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:52.074928 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19c3ca-915c-4187-8811-413002716ff2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:52.086365 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 171/342] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:52.091912 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19c3ca-915c-4187-8811-413002716ff2 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:52.129194 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258ad78-39bc-425a-b55a-16274f986190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:52.130511 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258ad78-39bc-425a-b55a-16274f986190 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:52.130988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258ad78-39bc-425a-b55a-16274f986190 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:52.131417 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258ad78-39bc-425a-b55a-16274f986190 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:52.217005 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19c3ca-915c-4187-8811-413002716ff2 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:52.235522 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c258ad78-39bc-425a-b55a-16274f986190 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:52.237355 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c258ad78-39bc-425a-b55a-16274f986190 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:52.238078 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:52.273130 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b61ea5-ad50-4997-b3a1-2bd8b1b54e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:52.274329 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b61ea5-ad50-4997-b3a1-2bd8b1b54e8a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:52.274902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b61ea5-ad50-4997-b3a1-2bd8b1b54e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:52.275368 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b61ea5-ad50-4997-b3a1-2bd8b1b54e8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:52.326428 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:52.391594 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 172/343] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 14:42:52.397163 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83458268-7b6d-4e24-a13a-dabb7e2cbad5 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:52.397698 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83458268-7b6d-4e24-a13a-dabb7e2cbad5 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:52.398138 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83458268-7b6d-4e24-a13a-dabb7e2cbad5 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:52.399681 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 173/344] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:52.402750 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b61ea5-ad50-4997-b3a1-2bd8b1b54e8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:52.403284 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83458268-7b6d-4e24-a13a-dabb7e2cbad5 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:52.404490 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b61ea5-ad50-4997-b3a1-2bd8b1b54e8a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:52.526258 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 172/345] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:52.528127 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd88b22-d67d-4933-a5cb-a2e47e30abb2 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:52.528632 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd88b22-d67d-4933-a5cb-a2e47e30abb2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:52.529244 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd88b22-d67d-4933-a5cb-a2e47e30abb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:52.550291 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-8cd88b22-d67d-4933-a5cb-a2e47e30abb2 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:52.553072 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8cd88b22-d67d-4933-a5cb-a2e47e30abb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:52.565134 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83458268-7b6d-4e24-a13a-dabb7e2cbad5 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:52.578602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:52.604455 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05923a9e-e233-40a0-a5cb-0c67a60e6a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:52.605324 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05923a9e-e233-40a0-a5cb-0c67a60e6a68 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:52.605831 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05923a9e-e233-40a0-a5cb-0c67a60e6a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:52.606335 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05923a9e-e233-40a0-a5cb-0c67a60e6a68 None admin] PATH_INFO: `/v3/projects/379430b83a8643be9d1e7d6fee22017d` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:52.607752 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05923a9e-e233-40a0-a5cb-0c67a60e6a68 None admin] RBAC: Authorizing `identity:get_project(project_id=379430b83a8643be9d1e7d6fee22017d)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:52.609441 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05923a9e-e233-40a0-a5cb-0c67a60e6a68 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:52.611852 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 174/346] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:52 2022] GET /identity/v3/projects/379430b83a8643be9d1e7d6fee22017d => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:52.612845 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05923a9e-e233-40a0-a5cb-0c67a60e6a68 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:52.633302 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 173/347] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:52.634883 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53385eb-b1ee-4bde-8072-66e63129047a None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:52.640365 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53385eb-b1ee-4bde-8072-66e63129047a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:52.640728 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53385eb-b1ee-4bde-8072-66e63129047a None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:52.642512 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 174/348] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:52.643421 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53385eb-b1ee-4bde-8072-66e63129047a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:52.667801 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:52.739762 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05923a9e-e233-40a0-a5cb-0c67a60e6a68 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:52.786588 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db2480-4ac5-4f6b-a3ea-826230888960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:52.787824 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db2480-4ac5-4f6b-a3ea-826230888960 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:52.788363 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db2480-4ac5-4f6b-a3ea-826230888960 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:52.788819 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db2480-4ac5-4f6b-a3ea-826230888960 None admin] PATH_INFO: `/v3/projects/379430b83a8643be9d1e7d6fee22017d` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:52.790301 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db2480-4ac5-4f6b-a3ea-826230888960 None admin] RBAC: Authorizing `identity:get_project(project_id=379430b83a8643be9d1e7d6fee22017d)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:52.791837 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db2480-4ac5-4f6b-a3ea-826230888960 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:52.793870 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 175/349] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:52 2022] GET /identity/v3/projects/379430b83a8643be9d1e7d6fee22017d => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:52.794931 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4f55a-1765-43d3-aa55-779c8d6cdeba None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:52.796191 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4f55a-1765-43d3-aa55-779c8d6cdeba None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:52.796331 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53385eb-b1ee-4bde-8072-66e63129047a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:52.796797 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4f55a-1765-43d3-aa55-779c8d6cdeba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:52.820514 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-22a4f55a-1765-43d3-aa55-779c8d6cdeba None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:52.821792 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-22a4f55a-1765-43d3-aa55-779c8d6cdeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:52.840753 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22cabed-ae5d-4e03-ae7d-83e57cf837ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:52.842194 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22cabed-ae5d-4e03-ae7d-83e57cf837ad None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:52.842588 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22cabed-ae5d-4e03-ae7d-83e57cf837ad None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:52.843062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22cabed-ae5d-4e03-ae7d-83e57cf837ad None admin] PATH_INFO: `/v3/groups/5a87635480bc471ba12ebaa5e97a7fb7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:52.854511 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22cabed-ae5d-4e03-ae7d-83e57cf837ad None admin] RBAC: Authorizing `identity:get_group(group_id=5a87635480bc471ba12ebaa5e97a7fb7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:52.854511 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22cabed-ae5d-4e03-ae7d-83e57cf837ad None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:52.857424 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 175/350] 10.222.0.85 () {56 vars in 1180 bytes} [Thu Jun 16 14:42:52 2022] GET /identity/v3/groups/5a87635480bc471ba12ebaa5e97a7fb7 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:52.858241 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22cabed-ae5d-4e03-ae7d-83e57cf837ad None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:52.881606 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:52.925664 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 176/351] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:52.927331 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126202d-5663-4260-978c-90d553cb3f54 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:52.927789 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126202d-5663-4260-978c-90d553cb3f54 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:52.928249 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126202d-5663-4260-978c-90d553cb3f54 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:52.929698 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 177/352] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:52.930558 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126202d-5663-4260-978c-90d553cb3f54 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:52.978530 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:53.035157 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22cabed-ae5d-4e03-ae7d-83e57cf837ad None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:53.065373 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126202d-5663-4260-978c-90d553cb3f54 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:53.088007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2fd6a1-0a62-4ce1-9216-4b51778b8b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:53.089330 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fd6a1-0a62-4ce1-9216-4b51778b8b4e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:53.089515 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fd6a1-0a62-4ce1-9216-4b51778b8b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:53.089791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fd6a1-0a62-4ce1-9216-4b51778b8b4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:53.103860 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2fd6a1-0a62-4ce1-9216-4b51778b8b4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:53.110528 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c75a7-d1bf-44f2-8788-80c5effdc744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:53.111411 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c75a7-d1bf-44f2-8788-80c5effdc744 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:53.111692 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c75a7-d1bf-44f2-8788-80c5effdc744 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:53.111863 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-7c2fd6a1-0a62-4ce1-9216-4b51778b8b4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:42:53.111863 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:53.111863 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:53.111863 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:53.111863 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:53.111863 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:53.111863 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:53.111863 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:53.111863 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:53.111863 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:53.111863 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:53.111863 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:53.111863 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:53.111863 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:53.111863 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:53.111863 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:53.112828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:53.112828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:53.112828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:53.112828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:53.112828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:53.112828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:53.112828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:53.112828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:53.112828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:53.112828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:53.112828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:53.112828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:53.112828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:53.112828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:53.112828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:53.112828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:53.114058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:53.114058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:53.114058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:53.114058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:53.114058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:53.114058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:53.114058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:53.114058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:53.114058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:53.114058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:53.114058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:42:53.114058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:42:53.114897 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c75a7-d1bf-44f2-8788-80c5effdc744 None admin] PATH_INFO: `/v3/groups/5a87635480bc471ba12ebaa5e97a7fb7` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:53.114974 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 176/353] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:53.115040 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c75a7-d1bf-44f2-8788-80c5effdc744 None admin] RBAC: Authorizing `identity:get_group(group_id=5a87635480bc471ba12ebaa5e97a7fb7)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:53.115111 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2fd6a1-0a62-4ce1-9216-4b51778b8b4e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:53.115176 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c75a7-d1bf-44f2-8788-80c5effdc744 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:53.118213 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 178/354] 10.222.0.85 () {56 vars in 1180 bytes} [Thu Jun 16 14:42:52 2022] GET /identity/v3/groups/5a87635480bc471ba12ebaa5e97a7fb7 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:53.118213 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc2729-5c55-44f7-a880-82e0fb1693d8 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:53.118213 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc2729-5c55-44f7-a880-82e0fb1693d8 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:53.118468 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc2729-5c55-44f7-a880-82e0fb1693d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:53.145133 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-83cc2729-5c55-44f7-a880-82e0fb1693d8 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:53.146395 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-83cc2729-5c55-44f7-a880-82e0fb1693d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:53.227278 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:53.236916 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 179/355] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:53.237799 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc2729-5c55-44f7-a880-82e0fb1693d8 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:53.251403 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2fd6a1-0a62-4ce1-9216-4b51778b8b4e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:53.279179 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:53.296804 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ffebe5-5a7a-4440-b32a-dbbf4bb60cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:53.297475 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffebe5-5a7a-4440-b32a-dbbf4bb60cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:53.298095 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffebe5-5a7a-4440-b32a-dbbf4bb60cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:53.298376 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffebe5-5a7a-4440-b32a-dbbf4bb60cf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:53.299218 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ffebe5-5a7a-4440-b32a-dbbf4bb60cf0 None admin] RBAC: Adding query filter params (group.id=5a87635480bc471ba12ebaa5e97a7fb7, role.id=26e7e900cf574eaabe4fcf886acb0c46, scope.project.id=379430b83a8643be9d1e7d6fee22017d) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:53.299531 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ffebe5-5a7a-4440-b32a-dbbf4bb60cf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:53.302082 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ffebe5-5a7a-4440-b32a-dbbf4bb60cf0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:53.308963 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 177/356] 10.222.0.85 () {56 vars in 1376 bytes} [Thu Jun 16 14:42:53 2022] GET /identity/v3/role_assignments?group.id=5a87635480bc471ba12ebaa5e97a7fb7&scope.project.id=379430b83a8643be9d1e7d6fee22017d&role.id=26e7e900cf574eaabe4fcf886acb0c46 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:53.310453 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ffebe5-5a7a-4440-b32a-dbbf4bb60cf0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:53.386255 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc2729-5c55-44f7-a880-82e0fb1693d8 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:53.435392 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041542f5-6a54-4e77-83ca-d62859d683fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:53.436688 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041542f5-6a54-4e77-83ca-d62859d683fa None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:53.436978 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041542f5-6a54-4e77-83ca-d62859d683fa None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:53.437254 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041542f5-6a54-4e77-83ca-d62859d683fa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:53.446817 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ffebe5-5a7a-4440-b32a-dbbf4bb60cf0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:53.451285 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041542f5-6a54-4e77-83ca-d62859d683fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:53.459386 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-041542f5-6a54-4e77-83ca-d62859d683fa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:42:53.459386 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:53.459386 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:53.459386 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:53.459386 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:53.459386 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:53.459386 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:53.459386 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:53.459386 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:53.459386 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:53.459386 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:53.459386 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:53.459386 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:53.459386 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:53.459386 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:53.459386 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:53.460445 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:53.460445 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:53.460445 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:53.460445 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:53.460445 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:53.460445 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:53.460445 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:53.460445 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:53.460445 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:53.460445 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:53.460445 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:53.460445 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:53.460445 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:53.460445 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:53.460445 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:53.460445 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:53.461253 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:53.461253 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:53.461253 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:53.461253 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:53.461253 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:53.461253 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:53.461253 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:53.461253 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:53.461253 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:53.461253 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:53.461253 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:42:53.461253 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:42:53.461253 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 180/357] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:53.461935 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041542f5-6a54-4e77-83ca-d62859d683fa None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:53.504888 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a58710-9672-4236-bf46-340addc8b18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:53.506030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a58710-9672-4236-bf46-340addc8b18b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:53.507049 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a58710-9672-4236-bf46-340addc8b18b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:53.507049 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a58710-9672-4236-bf46-340addc8b18b None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:53.507744 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a58710-9672-4236-bf46-340addc8b18b None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:53.508081 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a58710-9672-4236-bf46-340addc8b18b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:53.510676 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a58710-9672-4236-bf46-340addc8b18b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:53.511574 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:53.527577 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 178/358] 10.222.0.85 () {56 vars in 1101 bytes} [Thu Jun 16 14:42:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:53.529001 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8d1cc-deba-44d4-b3ae-4a878aaef374 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:53.529290 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8d1cc-deba-44d4-b3ae-4a878aaef374 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:53.529563 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8d1cc-deba-44d4-b3ae-4a878aaef374 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:53.531150 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 179/359] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:53.531857 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8d1cc-deba-44d4-b3ae-4a878aaef374 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:53.590722 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:53.605906 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041542f5-6a54-4e77-83ca-d62859d683fa None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:53.656583 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bacc7e-87d9-4ad6-8b8c-ad2cde7b6528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:53.657327 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bacc7e-87d9-4ad6-8b8c-ad2cde7b6528 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:53.657611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bacc7e-87d9-4ad6-8b8c-ad2cde7b6528 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:53.657894 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bacc7e-87d9-4ad6-8b8c-ad2cde7b6528 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:53.658863 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bacc7e-87d9-4ad6-8b8c-ad2cde7b6528 None admin] RBAC: Adding query filter params (group.id=5a87635480bc471ba12ebaa5e97a7fb7, role.id=2f7fa8924ea9447aab26981f0329ad43, scope.project.id=379430b83a8643be9d1e7d6fee22017d) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:53.659182 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bacc7e-87d9-4ad6-8b8c-ad2cde7b6528 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:53.660744 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bacc7e-87d9-4ad6-8b8c-ad2cde7b6528 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:53.667623 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 181/360] 10.222.0.85 () {56 vars in 1376 bytes} [Thu Jun 16 14:42:53 2022] GET /identity/v3/role_assignments?group.id=5a87635480bc471ba12ebaa5e97a7fb7&scope.project.id=379430b83a8643be9d1e7d6fee22017d&role.id=2f7fa8924ea9447aab26981f0329ad43 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:53.672023 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bacc7e-87d9-4ad6-8b8c-ad2cde7b6528 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:53.674166 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8d1cc-deba-44d4-b3ae-4a878aaef374 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:53.716297 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ba4ec-b305-4df6-9bd4-d6e7781a38da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:53.717231 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ba4ec-b305-4df6-9bd4-d6e7781a38da None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:53.717510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ba4ec-b305-4df6-9bd4-d6e7781a38da None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:53.717783 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ba4ec-b305-4df6-9bd4-d6e7781a38da None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:53.732661 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ba4ec-b305-4df6-9bd4-d6e7781a38da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:53.741533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-441ba4ec-b305-4df6-9bd4-d6e7781a38da None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:42:53.741533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:53.741533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:53.741533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:53.741533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:53.741533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:53.741533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:53.741533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:53.741533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:53.741533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:53.741533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:53.741533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:53.741533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:53.741533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:53.741533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:53.741533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:53.742490 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:53.742490 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:53.742490 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:53.742490 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:53.742490 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:53.742490 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:53.742490 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:53.742490 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:53.742490 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:53.742490 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:53.742490 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:53.742490 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:53.742490 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:53.742490 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:53.742490 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:53.742490 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:53.743333 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:53.743333 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:53.743333 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:53.743333 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:53.743333 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:53.743333 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:53.743333 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:53.743333 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:53.743333 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:53.743333 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:53.743333 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:42:53.743333 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:42:53.744650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 180/361] 10.222.0.85 () {56 vars in 1114 bytes} [Thu Jun 16 14:42:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:53.744650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ba4ec-b305-4df6-9bd4-d6e7781a38da None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:53.820216 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bacc7e-87d9-4ad6-8b8c-ad2cde7b6528 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:53.827232 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:53.871563 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46e988-a87e-4aa1-bbbd-662627aae0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:53.872645 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46e988-a87e-4aa1-bbbd-662627aae0c7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:53.872931 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46e988-a87e-4aa1-bbbd-662627aae0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:53.873210 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46e988-a87e-4aa1-bbbd-662627aae0c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:53.874302 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46e988-a87e-4aa1-bbbd-662627aae0c7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:53.874612 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46e988-a87e-4aa1-bbbd-662627aae0c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:53.876582 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46e988-a87e-4aa1-bbbd-662627aae0c7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:53.889652 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 182/362] 10.222.0.85 () {56 vars in 1101 bytes} [Thu Jun 16 14:42:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:53.891269 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb1ba3-fc20-492b-bd40-13650f75059c None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:53.891565 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb1ba3-fc20-492b-bd40-13650f75059c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:53.891846 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb1ba3-fc20-492b-bd40-13650f75059c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:53.892950 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ba4ec-b305-4df6-9bd4-d6e7781a38da None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:53.914702 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-e5bb1ba3-fc20-492b-bd40-13650f75059c None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:53.915844 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e5bb1ba3-fc20-492b-bd40-13650f75059c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:53.944302 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:53.948876 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2c0a2-7386-481c-9eba-5b784b577752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:53.949986 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2c0a2-7386-481c-9eba-5b784b577752 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:53.950282 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2c0a2-7386-481c-9eba-5b784b577752 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:53.950562 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2c0a2-7386-481c-9eba-5b784b577752 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:54.008839 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 183/363] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:54.009880 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb1ba3-fc20-492b-bd40-13650f75059c None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:54.060440 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2c0a2-7386-481c-9eba-5b784b577752 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:54.063047 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2c0a2-7386-481c-9eba-5b784b577752 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:54.144184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:54.158681 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb1ba3-fc20-492b-bd40-13650f75059c None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:54.209541 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 181/364] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:54.210337 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2c0a2-7386-481c-9eba-5b784b577752 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:54.236808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9146ba9-0ca0-43d4-80e2-cad96ceacc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:54.237657 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9146ba9-0ca0-43d4-80e2-cad96ceacc79 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:54.238052 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9146ba9-0ca0-43d4-80e2-cad96ceacc79 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:54.238504 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9146ba9-0ca0-43d4-80e2-cad96ceacc79 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:54.239350 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9146ba9-0ca0-43d4-80e2-cad96ceacc79 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:54.241253 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9146ba9-0ca0-43d4-80e2-cad96ceacc79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:54.242765 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9146ba9-0ca0-43d4-80e2-cad96ceacc79 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:54.255585 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 184/365] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:54.256349 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9146ba9-0ca0-43d4-80e2-cad96ceacc79 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:54.272266 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:54.355040 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2c0a2-7386-481c-9eba-5b784b577752 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:54.397528 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9146ba9-0ca0-43d4-80e2-cad96ceacc79 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:54.399645 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48da88-2fd4-44fd-a353-1c3070854f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:54.400816 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48da88-2fd4-44fd-a353-1c3070854f67 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:54.401098 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48da88-2fd4-44fd-a353-1c3070854f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:54.401377 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48da88-2fd4-44fd-a353-1c3070854f67 None admin] PATH_INFO: `/v3/users/61a16ed8b68c4557a5500e27876f7a94` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:54.405413 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b48da88-2fd4-44fd-a353-1c3070854f67 None admin] RBAC: Authorizing `identity:get_user(user_id=61a16ed8b68c4557a5500e27876f7a94)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:54.411162 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b48da88-2fd4-44fd-a353-1c3070854f67 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:54.413597 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 182/366] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:54 2022] GET /identity/v3/users/61a16ed8b68c4557a5500e27876f7a94 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:54.414578 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48da88-2fd4-44fd-a353-1c3070854f67 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:54.445738 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8e62b-f0c0-4412-95ca-73b36c8786d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:54.446560 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8e62b-f0c0-4412-95ca-73b36c8786d4 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:54.446913 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8e62b-f0c0-4412-95ca-73b36c8786d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:54.447196 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8e62b-f0c0-4412-95ca-73b36c8786d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:54.458531 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:54.461837 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8e62b-f0c0-4412-95ca-73b36c8786d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:54.470732 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-20d8e62b-f0c0-4412-95ca-73b36c8786d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:54.470732 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:54.470732 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:54.470732 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:54.470732 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:54.470732 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:54.470732 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:54.470732 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:54.470732 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:54.470732 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:54.470732 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:54.470732 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:54.470732 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:54.470732 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:54.470732 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:54.470732 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:54.471706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:54.471706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:54.471706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:54.471706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:54.471706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:54.471706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:54.471706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:54.471706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:54.471706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:54.471706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:54.471706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:54.471706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:54.471706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:54.471706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:54.471706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:54.471706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:54.472549 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:54.472549 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:54.472549 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:54.472549 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:54.472549 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:54.472549 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:54.472549 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:54.472549 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:54.472549 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:54.472549 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:54.472549 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:54.472549 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:42:54.473355 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 185/367] 10.222.0.85 () {56 vars in 1096 bytes} [Thu Jun 16 14:42:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:54.474173 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8e62b-f0c0-4412-95ca-73b36c8786d4 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:54.568346 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:54.573054 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48da88-2fd4-44fd-a353-1c3070854f67 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:54.606028 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8e62b-f0c0-4412-95ca-73b36c8786d4 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:54.622319 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c79dd-424b-40c2-8758-6ec36ffc6e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:54.623245 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c79dd-424b-40c2-8758-6ec36ffc6e63 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:54.623698 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c79dd-424b-40c2-8758-6ec36ffc6e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:54.624024 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c79dd-424b-40c2-8758-6ec36ffc6e63 None admin] PATH_INFO: `/v3/projects/2626df1e7e3e430790b7db426c06948f` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:54.625966 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c79dd-424b-40c2-8758-6ec36ffc6e63 None admin] RBAC: Authorizing `identity:get_project(project_id=2626df1e7e3e430790b7db426c06948f)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:54.627631 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c79dd-424b-40c2-8758-6ec36ffc6e63 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:54.631979 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 183/368] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:54 2022] GET /identity/v3/projects/2626df1e7e3e430790b7db426c06948f => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:54.632840 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c79dd-424b-40c2-8758-6ec36ffc6e63 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:54.675766 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d04cc-83bd-4a67-8f78-b2ec27667f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:54.677488 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d04cc-83bd-4a67-8f78-b2ec27667f8a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:54.677778 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d04cc-83bd-4a67-8f78-b2ec27667f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:54.678186 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d04cc-83bd-4a67-8f78-b2ec27667f8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:54.750914 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:54.765888 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c79dd-424b-40c2-8758-6ec36ffc6e63 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:54.807433 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80f6cd-5dbc-46f9-9db7-4df2c872ea66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:54.808580 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80f6cd-5dbc-46f9-9db7-4df2c872ea66 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:54.809200 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80f6cd-5dbc-46f9-9db7-4df2c872ea66 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:54.809588 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80f6cd-5dbc-46f9-9db7-4df2c872ea66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:54.810523 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc80f6cd-5dbc-46f9-9db7-4df2c872ea66 None admin] RBAC: Adding query filter params (role.id=d7118e244cb94310a267cf9a9b5bbfd4, user.id=61a16ed8b68c4557a5500e27876f7a94, scope.system=all) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:54.810933 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc80f6cd-5dbc-46f9-9db7-4df2c872ea66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:54.812601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc80f6cd-5dbc-46f9-9db7-4df2c872ea66 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:54.813916 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d04cc-83bd-4a67-8f78-b2ec27667f8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:54.818644 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d04cc-83bd-4a67-8f78-b2ec27667f8a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:54.832253 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 184/369] 10.222.0.85 () {56 vars in 1308 bytes} [Thu Jun 16 14:42:54 2022] GET /identity/v3/role_assignments?user.id=61a16ed8b68c4557a5500e27876f7a94&scope.system=all&role.id=d7118e244cb94310a267cf9a9b5bbfd4 => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:54.833247 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80f6cd-5dbc-46f9-9db7-4df2c872ea66 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:54.930332 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:54.983028 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 186/370] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:54.984407 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d04cc-83bd-4a67-8f78-b2ec27667f8a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:55.083081 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80f6cd-5dbc-46f9-9db7-4df2c872ea66 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:55.119248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d04cc-83bd-4a67-8f78-b2ec27667f8a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:55.158100 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898990e2-2106-4e9c-8a5a-83fe574d0868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:55.158886 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898990e2-2106-4e9c-8a5a-83fe574d0868 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:55.159166 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898990e2-2106-4e9c-8a5a-83fe574d0868 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:55.159435 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898990e2-2106-4e9c-8a5a-83fe574d0868 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:55.160216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898990e2-2106-4e9c-8a5a-83fe574d0868 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:55.160518 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898990e2-2106-4e9c-8a5a-83fe574d0868 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:55.161915 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898990e2-2106-4e9c-8a5a-83fe574d0868 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:55.168678 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc460a8-4382-4a76-963b-ef51d2451cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:55.169570 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc460a8-4382-4a76-963b-ef51d2451cbe None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:55.169884 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc460a8-4382-4a76-963b-ef51d2451cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:55.170327 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc460a8-4382-4a76-963b-ef51d2451cbe None admin] PATH_INFO: `/v3/groups/5a87635480bc471ba12ebaa5e97a7fb7` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:55.171593 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc460a8-4382-4a76-963b-ef51d2451cbe None admin] RBAC: Authorizing `identity:get_group(group_id=5a87635480bc471ba12ebaa5e97a7fb7)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:55.172395 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 185/371] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:55.173474 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc460a8-4382-4a76-963b-ef51d2451cbe None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:55.173595 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898990e2-2106-4e9c-8a5a-83fe574d0868 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:55.175491 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 187/372] 10.222.0.85 () {56 vars in 1180 bytes} [Thu Jun 16 14:42:54 2022] GET /identity/v3/groups/5a87635480bc471ba12ebaa5e97a7fb7 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:55.179981 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc460a8-4382-4a76-963b-ef51d2451cbe None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:55.191013 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:55.228189 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:55.296277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc460a8-4382-4a76-963b-ef51d2451cbe None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:55.299004 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898990e2-2106-4e9c-8a5a-83fe574d0868 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:55.337135 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133acd58-30b2-473c-b9d5-702663c34aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:55.337631 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133acd58-30b2-473c-b9d5-702663c34aaf None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:55.337917 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133acd58-30b2-473c-b9d5-702663c34aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:55.338223 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133acd58-30b2-473c-b9d5-702663c34aaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:55.340057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc385fd-28ed-46d4-8202-385f9cb269ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:55.341142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc385fd-28ed-46d4-8202-385f9cb269ee None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:55.341631 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc385fd-28ed-46d4-8202-385f9cb269ee None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:55.342047 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc385fd-28ed-46d4-8202-385f9cb269ee None admin] PATH_INFO: `/v3/projects/2626df1e7e3e430790b7db426c06948f` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:55.344573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc385fd-28ed-46d4-8202-385f9cb269ee None admin] RBAC: Authorizing `identity:get_project(project_id=2626df1e7e3e430790b7db426c06948f)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:55.346227 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc385fd-28ed-46d4-8202-385f9cb269ee None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:55.348628 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 186/373] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:55 2022] GET /identity/v3/projects/2626df1e7e3e430790b7db426c06948f => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:55.349629 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc385fd-28ed-46d4-8202-385f9cb269ee None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:55.417696 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133acd58-30b2-473c-b9d5-702663c34aaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:55.419795 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133acd58-30b2-473c-b9d5-702663c34aaf None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:55.453175 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:55.462739 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:55.488172 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc385fd-28ed-46d4-8202-385f9cb269ee None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:55.530461 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 188/374] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:55.531470 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133acd58-30b2-473c-b9d5-702663c34aaf None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:55.541075 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa28f5-dc70-484c-895b-c99a07a520a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:55.541887 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa28f5-dc70-484c-895b-c99a07a520a2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:55.542172 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa28f5-dc70-484c-895b-c99a07a520a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:55.542834 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa28f5-dc70-484c-895b-c99a07a520a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:55.544015 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa28f5-dc70-484c-895b-c99a07a520a2 None admin] RBAC: Adding query filter params (group.id=5a87635480bc471ba12ebaa5e97a7fb7, role.id=26e7e900cf574eaabe4fcf886acb0c46, scope.project.id=2626df1e7e3e430790b7db426c06948f) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:55.544349 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa28f5-dc70-484c-895b-c99a07a520a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:55.546109 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa28f5-dc70-484c-895b-c99a07a520a2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:55.560326 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 187/375] 10.222.0.85 () {56 vars in 1376 bytes} [Thu Jun 16 14:42:55 2022] GET /identity/v3/role_assignments?group.id=5a87635480bc471ba12ebaa5e97a7fb7&scope.project.id=2626df1e7e3e430790b7db426c06948f&role.id=26e7e900cf574eaabe4fcf886acb0c46 => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:55.561392 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa28f5-dc70-484c-895b-c99a07a520a2 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:55.716494 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133acd58-30b2-473c-b9d5-702663c34aaf None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:55.761524 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbcbf6f-0e93-4475-93c0-e32c140bc3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:55.762959 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcbf6f-0e93-4475-93c0-e32c140bc3e5 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:55.763248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcbf6f-0e93-4475-93c0-e32c140bc3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:55.765594 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcbf6f-0e93-4475-93c0-e32c140bc3e5 None admin] PATH_INFO: `/v3/groups/5a87635480bc471ba12ebaa5e97a7fb7` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:55.767384 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbcbf6f-0e93-4475-93c0-e32c140bc3e5 None admin] RBAC: Authorizing `identity:get_group(group_id=5a87635480bc471ba12ebaa5e97a7fb7)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:55.768985 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbcbf6f-0e93-4475-93c0-e32c140bc3e5 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:55.771150 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 189/376] 10.222.0.85 () {56 vars in 1180 bytes} [Thu Jun 16 14:42:55 2022] GET /identity/v3/groups/5a87635480bc471ba12ebaa5e97a7fb7 => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:55.777418 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbcbf6f-0e93-4475-93c0-e32c140bc3e5 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:55.785232 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa28f5-dc70-484c-895b-c99a07a520a2 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:55.793067 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:55.836660 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b8492-165c-4c28-a6d2-18fae9da5daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:55.837567 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b8492-165c-4c28-a6d2-18fae9da5daf None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:55.837915 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b8492-165c-4c28-a6d2-18fae9da5daf None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:55.838272 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b8492-165c-4c28-a6d2-18fae9da5daf None admin] PATH_INFO: `/v3/projects/d8f4fd10bac54b6ca305e8af48785eb7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:55.844694 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b8492-165c-4c28-a6d2-18fae9da5daf None admin] RBAC: Authorizing `identity:get_project(project_id=d8f4fd10bac54b6ca305e8af48785eb7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:55.846182 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b8492-165c-4c28-a6d2-18fae9da5daf None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:55.848265 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 188/377] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:55 2022] GET /identity/v3/projects/d8f4fd10bac54b6ca305e8af48785eb7 => generated 344 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:55.854876 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b8492-165c-4c28-a6d2-18fae9da5daf None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:55.874191 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:55.941438 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbcbf6f-0e93-4475-93c0-e32c140bc3e5 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:55.984307 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b8492-165c-4c28-a6d2-18fae9da5daf None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:55.994307 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb0eb1-e906-4c5f-aef3-49436ff599a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:55.995793 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb0eb1-e906-4c5f-aef3-49436ff599a0 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:55.996325 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb0eb1-e906-4c5f-aef3-49436ff599a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:55.996804 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb0eb1-e906-4c5f-aef3-49436ff599a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:55.998504 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb0eb1-e906-4c5f-aef3-49436ff599a0 None admin] RBAC: Adding query filter params (group.id=5a87635480bc471ba12ebaa5e97a7fb7, role.id=2f7fa8924ea9447aab26981f0329ad43, scope.project.id=2626df1e7e3e430790b7db426c06948f) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:55.999006 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb0eb1-e906-4c5f-aef3-49436ff599a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:56.001056 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb0eb1-e906-4c5f-aef3-49436ff599a0 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:56.008489 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 190/378] 10.222.0.85 () {56 vars in 1376 bytes} [Thu Jun 16 14:42:55 2022] GET /identity/v3/role_assignments?group.id=5a87635480bc471ba12ebaa5e97a7fb7&scope.project.id=2626df1e7e3e430790b7db426c06948f&role.id=2f7fa8924ea9447aab26981f0329ad43 => generated 260 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:56.033383 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18390a-937d-442d-b114-917ba967100c None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:56.034025 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18390a-937d-442d-b114-917ba967100c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:56.034504 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18390a-937d-442d-b114-917ba967100c None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:56.037437 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 191/379] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:56.043676 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb6fb8-f003-415d-88d5-a13abf6b8ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:56.044609 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb6fb8-f003-415d-88d5-a13abf6b8ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:56.044893 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb6fb8-f003-415d-88d5-a13abf6b8ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:56.045084 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544e8fb-2af1-48b5-935f-4024820a5197 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:56.045202 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb6fb8-f003-415d-88d5-a13abf6b8ab9 None admin] PATH_INFO: `/v3/groups/1669774be26f4f0088a9f8d4679c2a3b` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:56.045670 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544e8fb-2af1-48b5-935f-4024820a5197 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:56.046152 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544e8fb-2af1-48b5-935f-4024820a5197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:56.054354 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb6fb8-f003-415d-88d5-a13abf6b8ab9 None admin] RBAC: Authorizing `identity:get_group(group_id=1669774be26f4f0088a9f8d4679c2a3b)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:56.055974 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb6fb8-f003-415d-88d5-a13abf6b8ab9 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:56.058262 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 189/380] 10.222.0.85 () {56 vars in 1180 bytes} [Thu Jun 16 14:42:55 2022] GET /identity/v3/groups/1669774be26f4f0088a9f8d4679c2a3b => generated 229 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:56.064428 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb6fb8-f003-415d-88d5-a13abf6b8ab9 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:56.066733 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-9544e8fb-2af1-48b5-935f-4024820a5197 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:56.068400 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9544e8fb-2af1-48b5-935f-4024820a5197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:56.183711 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:56.194099 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 192/381] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:42:56.216376 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:56.249292 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544e8fb-2af1-48b5-935f-4024820a5197 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:56.276367 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb6fb8-f003-415d-88d5-a13abf6b8ab9 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:56.321025 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92631fa4-dc09-4e09-b4c7-1513826f2643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:56.322072 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92631fa4-dc09-4e09-b4c7-1513826f2643 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:56.322651 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92631fa4-dc09-4e09-b4c7-1513826f2643 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:56.323131 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92631fa4-dc09-4e09-b4c7-1513826f2643 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:56.324232 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92631fa4-dc09-4e09-b4c7-1513826f2643 None admin] RBAC: Adding query filter params (group.id=1669774be26f4f0088a9f8d4679c2a3b, role.id=95dcfa6c726a4d01a41d2642554fd338, scope.project.id=d8f4fd10bac54b6ca305e8af48785eb7) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:56.324772 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92631fa4-dc09-4e09-b4c7-1513826f2643 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:56.326485 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92631fa4-dc09-4e09-b4c7-1513826f2643 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:56.333412 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 190/382] 10.222.0.85 () {56 vars in 1376 bytes} [Thu Jun 16 14:42:56 2022] GET /identity/v3/role_assignments?group.id=1669774be26f4f0088a9f8d4679c2a3b&scope.project.id=d8f4fd10bac54b6ca305e8af48785eb7&role.id=95dcfa6c726a4d01a41d2642554fd338 => generated 260 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:56.436332 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544e8fb-2af1-48b5-935f-4024820a5197 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:56.484883 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724045d-8227-42c2-b062-405642101873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:56.485760 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724045d-8227-42c2-b062-405642101873 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:56.486050 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724045d-8227-42c2-b062-405642101873 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:56.486332 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724045d-8227-42c2-b062-405642101873 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:56.500931 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724045d-8227-42c2-b062-405642101873 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:56.510388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-a724045d-8227-42c2-b062-405642101873 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:42:56.510388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:56.510388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:56.510388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:56.510388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:56.510388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:56.510388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:56.510388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:56.510388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:56.510388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:56.510388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:56.510388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:56.510388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:56.510388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:56.510388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:56.510388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:56.511646 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:56.511646 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:56.511646 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:56.511646 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:56.511646 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:56.511646 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:56.511646 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:56.511646 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:56.511646 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:56.511646 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:56.511646 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:56.511646 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:56.511646 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:56.511646 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:56.511646 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:56.511646 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:56.512488 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:56.512488 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:56.512488 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:56.512488 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:56.512488 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:56.512488 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:56.512488 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:56.512488 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:56.512488 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:56.512488 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:56.512488 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:42:56.512488 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:42:56.512488 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 193/383] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:56.520569 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92631fa4-dc09-4e09-b4c7-1513826f2643 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:56.580279 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1835216-aee8-466a-a15d-d3e14787b339 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:56.580649 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1835216-aee8-466a-a15d-d3e14787b339 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:56.580848 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1835216-aee8-466a-a15d-d3e14787b339 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:56.582677 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 194/384] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:42:56.588618 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7610c-49fe-46c1-9696-0705480c1c5f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:56.589025 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7610c-49fe-46c1-9696-0705480c1c5f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:56.589178 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7610c-49fe-46c1-9696-0705480c1c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:56.629087 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d0f7610c-49fe-46c1-9696-0705480c1c5f None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:56.630320 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d0f7610c-49fe-46c1-9696-0705480c1c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:56.731793 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:56.736167 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92631fa4-dc09-4e09-b4c7-1513826f2643 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:56.744601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 195/385] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:42:56.785369 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235d15a-d493-4f6a-bd64-a9ddf10d5f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:56.785948 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235d15a-d493-4f6a-bd64-a9ddf10d5f77 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:56.786232 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235d15a-d493-4f6a-bd64-a9ddf10d5f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:56.786596 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235d15a-d493-4f6a-bd64-a9ddf10d5f77 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:56.787378 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235d15a-d493-4f6a-bd64-a9ddf10d5f77 None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:56.787737 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235d15a-d493-4f6a-bd64-a9ddf10d5f77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:56.789299 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235d15a-d493-4f6a-bd64-a9ddf10d5f77 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:56.803542 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 191/386] 10.222.0.85 () {56 vars in 1101 bytes} [Thu Jun 16 14:42:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:56.812906 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7610c-49fe-46c1-9696-0705480c1c5f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:56.819727 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235d15a-d493-4f6a-bd64-a9ddf10d5f77 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:56.823950 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:57.011040 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7610c-49fe-46c1-9696-0705480c1c5f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:57.021968 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235d15a-d493-4f6a-bd64-a9ddf10d5f77 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:57.093432 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3e448-4dc5-4749-a5ca-63f117c477d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:57.094760 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3e448-4dc5-4749-a5ca-63f117c477d4 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:57.095233 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3e448-4dc5-4749-a5ca-63f117c477d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:57.095705 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3e448-4dc5-4749-a5ca-63f117c477d4 None admin] PATH_INFO: `/v3/groups/5a87635480bc471ba12ebaa5e97a7fb7` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:57.100680 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3e448-4dc5-4749-a5ca-63f117c477d4 None admin] RBAC: Authorizing `identity:get_group(group_id=5a87635480bc471ba12ebaa5e97a7fb7)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:57.103202 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3e448-4dc5-4749-a5ca-63f117c477d4 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:57.107429 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 196/387] 10.222.0.85 () {56 vars in 1180 bytes} [Thu Jun 16 14:42:56 2022] GET /identity/v3/groups/5a87635480bc471ba12ebaa5e97a7fb7 => generated 226 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:57.112826 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb79bc-7748-4219-91f1-f88c4d8c62ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:57.114407 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb79bc-7748-4219-91f1-f88c4d8c62ed None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:57.116163 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3e448-4dc5-4749-a5ca-63f117c477d4 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:57.117010 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb79bc-7748-4219-91f1-f88c4d8c62ed None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:57.117504 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb79bc-7748-4219-91f1-f88c4d8c62ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:57.162434 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb79bc-7748-4219-91f1-f88c4d8c62ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:57.190902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-66bb79bc-7748-4219-91f1-f88c4d8c62ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:42:57.190902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:57.190902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:57.190902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:57.190902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:57.190902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:57.190902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:57.190902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:57.190902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:57.190902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:57.190902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:57.190902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:57.190902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:57.190902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:57.190902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:57.190902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:57.192643 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:57.192643 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:57.192643 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:57.192643 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:57.192643 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:57.192643 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:57.192643 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:57.192643 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:57.192643 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:57.192643 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:57.192643 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:57.192643 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:57.192643 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:57.192643 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:57.192643 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:57.192643 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:57.194120 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:57.194120 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:57.194120 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:57.194120 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:57.194120 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:57.194120 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:57.194120 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:57.194120 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:57.194120 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:57.194120 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:57.194120 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:42:57.194120 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:42:57.194120 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 192/388] 10.222.0.85 () {56 vars in 1114 bytes} [Thu Jun 16 14:42:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:57.203211 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb79bc-7748-4219-91f1-f88c4d8c62ed None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:57.321448 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:57.367570 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:57.452222 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3e448-4dc5-4749-a5ca-63f117c477d4 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:57.463926 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb79bc-7748-4219-91f1-f88c4d8c62ed None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:57.532989 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e173e-9704-411d-a4c3-ca94d2ed026e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:57.533875 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e173e-9704-411d-a4c3-ca94d2ed026e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:57.534162 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e173e-9704-411d-a4c3-ca94d2ed026e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:57.534442 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e173e-9704-411d-a4c3-ca94d2ed026e None admin] PATH_INFO: `/v3/projects/379430b83a8643be9d1e7d6fee22017d` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:57.536121 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e173e-9704-411d-a4c3-ca94d2ed026e None admin] RBAC: Authorizing `identity:get_project(project_id=379430b83a8643be9d1e7d6fee22017d)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:57.537580 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e173e-9704-411d-a4c3-ca94d2ed026e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:57.540071 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5204799-a266-4c54-add1-38112435aba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:57.540759 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5204799-a266-4c54-add1-38112435aba2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:57.541044 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5204799-a266-4c54-add1-38112435aba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:57.541420 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5204799-a266-4c54-add1-38112435aba2 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:57.542186 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5204799-a266-4c54-add1-38112435aba2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:57.542495 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5204799-a266-4c54-add1-38112435aba2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:57.543974 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5204799-a266-4c54-add1-38112435aba2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:57.546452 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 197/389] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:57 2022] GET /identity/v3/projects/379430b83a8643be9d1e7d6fee22017d => generated 298 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:57.547331 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e173e-9704-411d-a4c3-ca94d2ed026e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:57.558933 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 193/390] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:57.567909 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5204799-a266-4c54-add1-38112435aba2 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:57.727914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e173e-9704-411d-a4c3-ca94d2ed026e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:57.751233 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5204799-a266-4c54-add1-38112435aba2 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:57.780257 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:57.794509 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:57.801266 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4a037-4ca0-4a64-bd44-c0695ee5ea4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:57.802217 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4a037-4ca0-4a64-bd44-c0695ee5ea4c None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:57.802499 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4a037-4ca0-4a64-bd44-c0695ee5ea4c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:57.802777 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4a037-4ca0-4a64-bd44-c0695ee5ea4c None admin] PATH_INFO: `/v3/projects/379430b83a8643be9d1e7d6fee22017d/groups/5a87635480bc471ba12ebaa5e97a7fb7/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:57.805865 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4a037-4ca0-4a64-bd44-c0695ee5ea4c None admin] RBAC: Authorizing `identity:create_grant(project_id=379430b83a8643be9d1e7d6fee22017d, group_id=5a87635480bc471ba12ebaa5e97a7fb7, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:57.807471 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4a037-4ca0-4a64-bd44-c0695ee5ea4c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:57.819136 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8400d-f4d2-42f2-8e52-15d302221bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:57.820062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8400d-f4d2-42f2-8e52-15d302221bdf None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:57.820393 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8400d-f4d2-42f2-8e52-15d302221bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:57.820649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8400d-f4d2-42f2-8e52-15d302221bdf None admin] PATH_INFO: `/v3/groups/5a87635480bc471ba12ebaa5e97a7fb7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:57.821982 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8400d-f4d2-42f2-8e52-15d302221bdf None admin] RBAC: Authorizing `identity:get_group(group_id=5a87635480bc471ba12ebaa5e97a7fb7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:57.829970 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8400d-f4d2-42f2-8e52-15d302221bdf None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:57.833265 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 194/391] 10.222.0.85 () {56 vars in 1180 bytes} [Thu Jun 16 14:42:57 2022] GET /identity/v3/groups/5a87635480bc471ba12ebaa5e97a7fb7 => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:57.836436 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 198/392] 10.222.0.85 () {58 vars in 1442 bytes} [Thu Jun 16 14:42:57 2022] PUT /identity/v3/projects/379430b83a8643be9d1e7d6fee22017d/groups/5a87635480bc471ba12ebaa5e97a7fb7/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:42:57.842908 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8400d-f4d2-42f2-8e52-15d302221bdf None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:58.055152 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8400d-f4d2-42f2-8e52-15d302221bdf None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:58.113801 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c4d99-f85d-4327-937b-a79214c26c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:58.114715 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c4d99-f85d-4327-937b-a79214c26c06 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:58.114994 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c4d99-f85d-4327-937b-a79214c26c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:58.115268 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c4d99-f85d-4327-937b-a79214c26c06 None admin] PATH_INFO: `/v3/projects/379430b83a8643be9d1e7d6fee22017d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:58.116576 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c4d99-f85d-4327-937b-a79214c26c06 None admin] RBAC: Authorizing `identity:get_project(project_id=379430b83a8643be9d1e7d6fee22017d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:58.118058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c4d99-f85d-4327-937b-a79214c26c06 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:58.120482 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 195/393] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:57 2022] GET /identity/v3/projects/379430b83a8643be9d1e7d6fee22017d => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:58.126324 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4a037-4ca0-4a64-bd44-c0695ee5ea4c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:58.231774 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4a037-4ca0-4a64-bd44-c0695ee5ea4c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:58.268930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5555545-5b2c-4a9b-b50a-101207b0e66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:58.269831 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5555545-5b2c-4a9b-b50a-101207b0e66a None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:58.270108 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5555545-5b2c-4a9b-b50a-101207b0e66a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:58.270378 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5555545-5b2c-4a9b-b50a-101207b0e66a None admin] PATH_INFO: `/v3/projects/379430b83a8643be9d1e7d6fee22017d/groups/5a87635480bc471ba12ebaa5e97a7fb7/roles/2f7fa8924ea9447aab26981f0329ad43` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:58.272631 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5555545-5b2c-4a9b-b50a-101207b0e66a None admin] RBAC: Authorizing `identity:create_grant(project_id=379430b83a8643be9d1e7d6fee22017d, group_id=5a87635480bc471ba12ebaa5e97a7fb7, role_id=2f7fa8924ea9447aab26981f0329ad43)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:58.274082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5555545-5b2c-4a9b-b50a-101207b0e66a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:58.289564 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 199/394] 10.222.0.85 () {58 vars in 1442 bytes} [Thu Jun 16 14:42:58 2022] PUT /identity/v3/projects/379430b83a8643be9d1e7d6fee22017d/groups/5a87635480bc471ba12ebaa5e97a7fb7/roles/2f7fa8924ea9447aab26981f0329ad43 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:42:58.516394 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83867a73-2000-432c-ba38-d7d5250e298d None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:58.516951 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83867a73-2000-432c-ba38-d7d5250e298d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:58.517348 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83867a73-2000-432c-ba38-d7d5250e298d None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:58.518972 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 196/395] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:58.525079 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e154fd0-98ea-4bc6-b013-f171e643bd06 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:58.525703 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e154fd0-98ea-4bc6-b013-f171e643bd06 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:58.525802 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e154fd0-98ea-4bc6-b013-f171e643bd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:58.546581 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-0e154fd0-98ea-4bc6-b013-f171e643bd06 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:58.548185 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-0e154fd0-98ea-4bc6-b013-f171e643bd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:58.594522 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:58.621699 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 200/396] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:58.646396 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83867a73-2000-432c-ba38-d7d5250e298d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:58.732503 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:58.787185 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83867a73-2000-432c-ba38-d7d5250e298d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:58.826839 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465da1d-1f22-4ae3-9039-e8585e4d2236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:58.827653 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465da1d-1f22-4ae3-9039-e8585e4d2236 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:58.827967 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465da1d-1f22-4ae3-9039-e8585e4d2236 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:58.828239 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465da1d-1f22-4ae3-9039-e8585e4d2236 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:58.840439 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465da1d-1f22-4ae3-9039-e8585e4d2236 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:58.848363 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-9465da1d-1f22-4ae3-9039-e8585e4d2236 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:42:58.848363 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:58.848363 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:58.848363 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:58.848363 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:58.848363 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:58.848363 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:58.848363 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:58.848363 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:58.848363 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:58.848363 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:58.848363 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:58.848363 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:58.848363 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:58.848363 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:58.848363 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:58.849453 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:58.849453 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:58.849453 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:58.849453 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:58.849453 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:58.849453 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:58.849453 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:58.849453 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:58.849453 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:58.849453 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:58.849453 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:58.849453 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:58.849453 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:58.849453 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:58.849453 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:58.849453 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:58.850434 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:58.850434 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:58.850434 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:58.850434 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:58.850434 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:58.850434 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:58.850434 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:58.850434 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:58.850434 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:58.850434 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:58.850434 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:42:58.850434 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:42:58.850434 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 197/397] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:58.857348 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e154fd0-98ea-4bc6-b013-f171e643bd06 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:59.001076 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e154fd0-98ea-4bc6-b013-f171e643bd06 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:59.048826 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855fc37a-fbc7-41d8-ab48-926b708b01fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:59.049501 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855fc37a-fbc7-41d8-ab48-926b708b01fd None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:59.049784 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855fc37a-fbc7-41d8-ab48-926b708b01fd None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:59.050060 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855fc37a-fbc7-41d8-ab48-926b708b01fd None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:59.050834 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855fc37a-fbc7-41d8-ab48-926b708b01fd None admin] RBAC: Adding query filter params (name=member) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:59.051136 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855fc37a-fbc7-41d8-ab48-926b708b01fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:59.052583 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855fc37a-fbc7-41d8-ab48-926b708b01fd None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:59.061905 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 201/398] 10.222.0.85 () {56 vars in 1101 bytes} [Thu Jun 16 14:42:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:59.067777 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465da1d-1f22-4ae3-9039-e8585e4d2236 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:59.086970 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff7e98-a1a5-4c36-b7df-7c88668751bd None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:59.087301 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff7e98-a1a5-4c36-b7df-7c88668751bd None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:59.087525 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff7e98-a1a5-4c36-b7df-7c88668751bd None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:59.089611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 202/399] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:59.094805 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201edf0-00ac-40fa-ad02-dc7a7af2c930 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:59.095095 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201edf0-00ac-40fa-ad02-dc7a7af2c930 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:59.095375 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201edf0-00ac-40fa-ad02-dc7a7af2c930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:59.114964 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b201edf0-00ac-40fa-ad02-dc7a7af2c930 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:59.116192 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b201edf0-00ac-40fa-ad02-dc7a7af2c930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:59.151451 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:59.225720 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 203/400] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:59.252432 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465da1d-1f22-4ae3-9039-e8585e4d2236 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:59.258807 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba07af-9e15-40be-80b0-07f4a1bd6198 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:59.259090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba07af-9e15-40be-80b0-07f4a1bd6198 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:59.259371 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba07af-9e15-40be-80b0-07f4a1bd6198 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:59.261214 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 204/401] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:42:59.262996 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba07af-9e15-40be-80b0-07f4a1bd6198 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:59.273414 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:59.291893 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d210db-9905-4a30-ab61-8207c4d03ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:59.294695 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d210db-9905-4a30-ab61-8207c4d03ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:59.295277 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d210db-9905-4a30-ab61-8207c4d03ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:59.295558 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d210db-9905-4a30-ab61-8207c4d03ef3 None admin] PATH_INFO: `/v3/groups/5a87635480bc471ba12ebaa5e97a7fb7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:59.296813 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d210db-9905-4a30-ab61-8207c4d03ef3 None admin] RBAC: Authorizing `identity:get_group(group_id=5a87635480bc471ba12ebaa5e97a7fb7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:59.298807 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d210db-9905-4a30-ab61-8207c4d03ef3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:59.303967 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 198/402] 10.222.0.85 () {56 vars in 1180 bytes} [Thu Jun 16 14:42:59 2022] GET /identity/v3/groups/5a87635480bc471ba12ebaa5e97a7fb7 => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:59.303967 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361a1c1-25b4-41be-a0ce-8182f4f25894 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:59.303967 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361a1c1-25b4-41be-a0ce-8182f4f25894 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:59.303967 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361a1c1-25b4-41be-a0ce-8182f4f25894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:59.320960 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-8361a1c1-25b4-41be-a0ce-8182f4f25894 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:59.322258 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8361a1c1-25b4-41be-a0ce-8182f4f25894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:59.386303 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba07af-9e15-40be-80b0-07f4a1bd6198 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:59.402734 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 199/403] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:59.408253 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361a1c1-25b4-41be-a0ce-8182f4f25894 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:59.449435 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bfa05-e17f-4e5b-9c4b-f01fec97a474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:59.451260 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bfa05-e17f-4e5b-9c4b-f01fec97a474 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:59.451758 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bfa05-e17f-4e5b-9c4b-f01fec97a474 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:59.452265 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bfa05-e17f-4e5b-9c4b-f01fec97a474 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:59.467015 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1bfa05-e17f-4e5b-9c4b-f01fec97a474 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:59.478656 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-6b1bfa05-e17f-4e5b-9c4b-f01fec97a474 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:42:59.478656 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:59.478656 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:59.478656 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:59.478656 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:59.478656 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:59.478656 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:59.478656 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:59.478656 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:59.478656 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:59.478656 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:59.478656 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:59.478656 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:59.478656 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:59.478656 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:59.478656 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:59.479548 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:59.479548 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:59.479548 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:59.479548 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:59.479548 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:59.479548 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:59.479548 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:59.479548 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:59.479548 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:59.479548 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:59.479548 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:59.479548 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:59.479548 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:59.479548 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:59.479548 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:59.479548 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:59.480876 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:59.480876 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:59.480876 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:59.480876 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:59.480876 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:59.480876 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:59.480876 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:59.480876 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:59.480876 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:59.480876 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:59.480876 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:42:59.480876 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:42:59.483970 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 205/404] 10.222.0.85 () {56 vars in 1114 bytes} [Thu Jun 16 14:42:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:59.488926 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bfa05-e17f-4e5b-9c4b-f01fec97a474 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:59.532499 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361a1c1-25b4-41be-a0ce-8182f4f25894 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:59.539484 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:59.555484 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:59.577166 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2876a69-3510-4e9c-a117-08e608d21894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:59.578051 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2876a69-3510-4e9c-a117-08e608d21894 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:59.578332 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2876a69-3510-4e9c-a117-08e608d21894 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:59.578606 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2876a69-3510-4e9c-a117-08e608d21894 None admin] PATH_INFO: `/v3/projects/2626df1e7e3e430790b7db426c06948f` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:59.579812 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2876a69-3510-4e9c-a117-08e608d21894 None admin] RBAC: Authorizing `identity:get_project(project_id=2626df1e7e3e430790b7db426c06948f)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:59.581382 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2876a69-3510-4e9c-a117-08e608d21894 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:59.583470 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 200/405] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:42:59 2022] GET /identity/v3/projects/2626df1e7e3e430790b7db426c06948f => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:59.584341 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2876a69-3510-4e9c-a117-08e608d21894 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:59.653750 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bfa05-e17f-4e5b-9c4b-f01fec97a474 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:59.691136 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff987de-7d3f-43bc-ac9b-56d9b7efe759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:59.691773 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff987de-7d3f-43bc-ac9b-56d9b7efe759 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:59.692080 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff987de-7d3f-43bc-ac9b-56d9b7efe759 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:59.692352 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff987de-7d3f-43bc-ac9b-56d9b7efe759 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:59.703889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff987de-7d3f-43bc-ac9b-56d9b7efe759 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:59.709762 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2876a69-3510-4e9c-a117-08e608d21894 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:59.712068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-eff987de-7d3f-43bc-ac9b-56d9b7efe759 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:59.712068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:59.712068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:59.712068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:59.712068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:59.712068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:59.712068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:59.712068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:59.712068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:59.712068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:59.712068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:59.712068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:59.712068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:59.712068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:59.712068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:59.712068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:59.713063 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:59.713063 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:59.713063 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:59.713063 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:59.713063 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:59.713063 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:59.713063 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:59.713063 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:59.713063 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:59.713063 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:59.713063 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:59.713063 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:59.713063 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:59.713063 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:59.713063 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:59.713063 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:59.713868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:59.713868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:59.713868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:59.713868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:59.713868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:59.713868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:59.713868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:59.713868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:59.713868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:59.713868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:59.713868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:59.713868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:42:59.714460 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 206/406] 10.222.0.85 () {56 vars in 1096 bytes} [Thu Jun 16 14:42:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:59.715012 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff987de-7d3f-43bc-ac9b-56d9b7efe759 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:59.757669 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f62ff-2c54-43b3-b4e3-4a901fb4befc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:59.758719 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f62ff-2c54-43b3-b4e3-4a901fb4befc None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:59.759215 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f62ff-2c54-43b3-b4e3-4a901fb4befc None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:59.759676 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f62ff-2c54-43b3-b4e3-4a901fb4befc None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:59.760958 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f62ff-2c54-43b3-b4e3-4a901fb4befc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:59.761479 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f62ff-2c54-43b3-b4e3-4a901fb4befc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:59.763048 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f62ff-2c54-43b3-b4e3-4a901fb4befc None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:59.772212 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 201/407] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:42:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:59.773369 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f62ff-2c54-43b3-b4e3-4a901fb4befc None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:59.810147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:59.823687 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff987de-7d3f-43bc-ac9b-56d9b7efe759 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:59.826582 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:59.859727 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2f632-8c56-4be7-a200-e80a0ce84baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:59.860861 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2f632-8c56-4be7-a200-e80a0ce84baa None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:59.861286 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2f632-8c56-4be7-a200-e80a0ce84baa None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:59.861668 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2f632-8c56-4be7-a200-e80a0ce84baa None admin] PATH_INFO: `/v3/projects/2626df1e7e3e430790b7db426c06948f/groups/5a87635480bc471ba12ebaa5e97a7fb7/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:59.863811 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2f632-8c56-4be7-a200-e80a0ce84baa None admin] RBAC: Authorizing `identity:create_grant(project_id=2626df1e7e3e430790b7db426c06948f, group_id=5a87635480bc471ba12ebaa5e97a7fb7, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:59.865391 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2f632-8c56-4be7-a200-e80a0ce84baa None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:59.883322 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 207/408] 10.222.0.85 () {58 vars in 1442 bytes} [Thu Jun 16 14:42:59 2022] PUT /identity/v3/projects/2626df1e7e3e430790b7db426c06948f/groups/5a87635480bc471ba12ebaa5e97a7fb7/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:42:59.884594 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2f632-8c56-4be7-a200-e80a0ce84baa None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:59.885885 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f62ff-2c54-43b3-b4e3-4a901fb4befc None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:59.935057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad15b88-8185-417c-8069-fbbe89633e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:59.936118 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad15b88-8185-417c-8069-fbbe89633e2a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:59.936536 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad15b88-8185-417c-8069-fbbe89633e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:59.936945 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad15b88-8185-417c-8069-fbbe89633e2a None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:59.937849 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad15b88-8185-417c-8069-fbbe89633e2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:59.938387 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad15b88-8185-417c-8069-fbbe89633e2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:59.941610 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad15b88-8185-417c-8069-fbbe89633e2a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:59.961168 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 202/409] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:59.967994 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad15b88-8185-417c-8069-fbbe89633e2a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:00.000356 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2f632-8c56-4be7-a200-e80a0ce84baa None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:00.046550 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39e3fd-a273-40ca-852c-968215157d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:00.048545 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39e3fd-a273-40ca-852c-968215157d7e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:00.048942 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39e3fd-a273-40ca-852c-968215157d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:00.049423 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39e3fd-a273-40ca-852c-968215157d7e None admin] PATH_INFO: `/v3/groups/5a87635480bc471ba12ebaa5e97a7fb7` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:00.051064 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39e3fd-a273-40ca-852c-968215157d7e None admin] RBAC: Authorizing `identity:get_group(group_id=5a87635480bc471ba12ebaa5e97a7fb7)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:00.052978 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39e3fd-a273-40ca-852c-968215157d7e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:00.055330 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 208/410] 10.222.0.85 () {56 vars in 1180 bytes} [Thu Jun 16 14:42:59 2022] GET /identity/v3/groups/5a87635480bc471ba12ebaa5e97a7fb7 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:00.063964 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39e3fd-a273-40ca-852c-968215157d7e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:00.088285 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:00.188927 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad15b88-8185-417c-8069-fbbe89633e2a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:00.201365 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:00.210420 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39e3fd-a273-40ca-852c-968215157d7e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:00.230406 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448c3de-0c79-46ed-ba38-956ddb7def05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:00.231752 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448c3de-0c79-46ed-ba38-956ddb7def05 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:00.232260 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448c3de-0c79-46ed-ba38-956ddb7def05 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:00.232777 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448c3de-0c79-46ed-ba38-956ddb7def05 None admin] PATH_INFO: `/v3/groups/1669774be26f4f0088a9f8d4679c2a3b` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:00.234209 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d448c3de-0c79-46ed-ba38-956ddb7def05 None admin] RBAC: Authorizing `identity:get_group(group_id=1669774be26f4f0088a9f8d4679c2a3b)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:00.236754 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d448c3de-0c79-46ed-ba38-956ddb7def05 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:00.239159 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 203/411] 10.222.0.85 () {56 vars in 1180 bytes} [Thu Jun 16 14:42:59 2022] GET /identity/v3/groups/1669774be26f4f0088a9f8d4679c2a3b => generated 229 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:00.244798 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448c3de-0c79-46ed-ba38-956ddb7def05 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:00.246643 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87eb3a5-c7e9-4992-a0f8-00565a7b8452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:00.247521 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87eb3a5-c7e9-4992-a0f8-00565a7b8452 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:00.247801 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87eb3a5-c7e9-4992-a0f8-00565a7b8452 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:00.248113 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87eb3a5-c7e9-4992-a0f8-00565a7b8452 None admin] PATH_INFO: `/v3/projects/2626df1e7e3e430790b7db426c06948f` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:00.249329 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87eb3a5-c7e9-4992-a0f8-00565a7b8452 None admin] RBAC: Authorizing `identity:get_project(project_id=2626df1e7e3e430790b7db426c06948f)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:00.250798 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87eb3a5-c7e9-4992-a0f8-00565a7b8452 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:00.252900 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 209/412] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:00 2022] GET /identity/v3/projects/2626df1e7e3e430790b7db426c06948f => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:00.260335 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87eb3a5-c7e9-4992-a0f8-00565a7b8452 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:00.368877 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448c3de-0c79-46ed-ba38-956ddb7def05 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:00.408074 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0227420-a3a1-46b4-92a8-cb9555f55881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:00.409350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0227420-a3a1-46b4-92a8-cb9555f55881 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:00.409858 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0227420-a3a1-46b4-92a8-cb9555f55881 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:00.410357 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0227420-a3a1-46b4-92a8-cb9555f55881 None admin] PATH_INFO: `/v3/projects/d8f4fd10bac54b6ca305e8af48785eb7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:00.411786 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0227420-a3a1-46b4-92a8-cb9555f55881 None admin] RBAC: Authorizing `identity:get_project(project_id=d8f4fd10bac54b6ca305e8af48785eb7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:00.414083 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0227420-a3a1-46b4-92a8-cb9555f55881 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:00.416456 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 204/413] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:00 2022] GET /identity/v3/projects/d8f4fd10bac54b6ca305e8af48785eb7 => generated 344 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:00.425317 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0227420-a3a1-46b4-92a8-cb9555f55881 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:00.435368 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:00.460408 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87eb3a5-c7e9-4992-a0f8-00565a7b8452 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:00.500412 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097e965-41a5-4139-a216-857a55cbd129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:00.502102 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097e965-41a5-4139-a216-857a55cbd129 None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:00.502637 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097e965-41a5-4139-a216-857a55cbd129 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:00.503117 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097e965-41a5-4139-a216-857a55cbd129 None admin] PATH_INFO: `/v3/projects/2626df1e7e3e430790b7db426c06948f/groups/5a87635480bc471ba12ebaa5e97a7fb7/roles/2f7fa8924ea9447aab26981f0329ad43` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:00.508056 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097e965-41a5-4139-a216-857a55cbd129 None admin] RBAC: Authorizing `identity:create_grant(project_id=2626df1e7e3e430790b7db426c06948f, group_id=5a87635480bc471ba12ebaa5e97a7fb7, role_id=2f7fa8924ea9447aab26981f0329ad43)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:00.509801 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097e965-41a5-4139-a216-857a55cbd129 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:00.540711 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:00.554325 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 210/414] 10.222.0.85 () {58 vars in 1442 bytes} [Thu Jun 16 14:43:00 2022] PUT /identity/v3/projects/2626df1e7e3e430790b7db426c06948f/groups/5a87635480bc471ba12ebaa5e97a7fb7/roles/2f7fa8924ea9447aab26981f0329ad43 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:43:00.599213 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0227420-a3a1-46b4-92a8-cb9555f55881 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:00.637283 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90122629-bf71-4ac2-a751-800e9d199be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:00.638554 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90122629-bf71-4ac2-a751-800e9d199be6 None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:00.639054 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90122629-bf71-4ac2-a751-800e9d199be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:00.639519 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90122629-bf71-4ac2-a751-800e9d199be6 None admin] PATH_INFO: `/v3/projects/d8f4fd10bac54b6ca305e8af48785eb7/groups/1669774be26f4f0088a9f8d4679c2a3b/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:00.641829 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90122629-bf71-4ac2-a751-800e9d199be6 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8f4fd10bac54b6ca305e8af48785eb7, group_id=1669774be26f4f0088a9f8d4679c2a3b, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:00.643479 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90122629-bf71-4ac2-a751-800e9d199be6 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:00.674281 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 205/415] 10.222.0.85 () {58 vars in 1442 bytes} [Thu Jun 16 14:43:00 2022] PUT /identity/v3/projects/d8f4fd10bac54b6ca305e8af48785eb7/groups/1669774be26f4f0088a9f8d4679c2a3b/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:43:00.892443 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253f21e-a00c-4f24-800a-a00da3adcbda None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:00.892788 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253f21e-a00c-4f24-800a-a00da3adcbda None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:00.892964 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253f21e-a00c-4f24-800a-a00da3adcbda None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:00.894667 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 211/416] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:00.900961 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d75695-877a-48e2-9839-a0600daa5c62 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:00.901512 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d75695-877a-48e2-9839-a0600daa5c62 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:00.901512 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d75695-877a-48e2-9839-a0600daa5c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:00.920869 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-34d75695-877a-48e2-9839-a0600daa5c62 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:00.922126 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-34d75695-877a-48e2-9839-a0600daa5c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:00.985377 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10ca68-96f6-49a8-b65f-84eac3886c4f None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:00.986006 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10ca68-96f6-49a8-b65f-84eac3886c4f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:00.986515 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10ca68-96f6-49a8-b65f-84eac3886c4f None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:00.988127 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 212/417] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:00.995484 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ff855-b264-4a2b-8089-f09c48f3f30c None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:00.995775 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ff855-b264-4a2b-8089-f09c48f3f30c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:00.996207 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ff855-b264-4a2b-8089-f09c48f3f30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:01.003978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 206/418] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:01.013312 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-7b4ff855-b264-4a2b-8089-f09c48f3f30c None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:01.014503 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7b4ff855-b264-4a2b-8089-f09c48f3f30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:01.022355 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d75695-877a-48e2-9839-a0600daa5c62 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:01.071706 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:01.130715 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 213/419] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:43:01.172903 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d75695-877a-48e2-9839-a0600daa5c62 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:01.177103 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ff855-b264-4a2b-8089-f09c48f3f30c None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:01.250128 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc5661-e355-4943-bce1-206cfe3d2b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:01.250962 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc5661-e355-4943-bce1-206cfe3d2b60 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:01.251247 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc5661-e355-4943-bce1-206cfe3d2b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:01.251521 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc5661-e355-4943-bce1-206cfe3d2b60 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:01.268493 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc5661-e355-4943-bce1-206cfe3d2b60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:01.281350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-cfdc5661-e355-4943-bce1-206cfe3d2b60 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:43:01.281350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:01.281350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:01.281350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:01.281350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:01.281350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:01.281350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:01.281350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:01.281350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:01.281350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:01.281350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:01.281350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:01.281350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:01.281350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:01.281350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:01.281350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:01.282510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:01.282510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:01.282510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:01.282510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:01.282510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:01.282510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:01.282510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:01.282510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:01.282510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:01.282510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:01.282510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:01.282510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:01.282510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:01.282510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:01.282510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:01.282510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:01.283448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:01.283448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:01.283448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:01.283448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:01.283448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:01.283448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:01.283448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:01.283448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:01.283448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:01.283448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:01.283448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:43:01.283448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:01.295790 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 207/420] 10.222.0.85 () {56 vars in 1114 bytes} [Thu Jun 16 14:43:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:43:01.296040 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:01.304955 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc5661-e355-4943-bce1-206cfe3d2b60 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:01.326345 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ff855-b264-4a2b-8089-f09c48f3f30c None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:01.365144 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e125a93-4a95-4181-ae8f-2ff16474a4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:01.366409 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e125a93-4a95-4181-ae8f-2ff16474a4f0 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:01.367247 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e125a93-4a95-4181-ae8f-2ff16474a4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:01.367888 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e125a93-4a95-4181-ae8f-2ff16474a4f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:01.395698 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e125a93-4a95-4181-ae8f-2ff16474a4f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:01.416716 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-3e125a93-4a95-4181-ae8f-2ff16474a4f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:01.416716 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:01.416716 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:01.416716 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:01.416716 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:01.416716 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:01.416716 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:01.416716 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:01.416716 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:01.416716 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:01.416716 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:01.416716 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:01.416716 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:01.416716 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:01.416716 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:01.416716 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:01.417850 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:01.417850 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:01.417850 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:01.417850 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:01.417850 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:01.417850 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:01.417850 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:01.417850 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:01.417850 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:01.417850 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:01.417850 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:01.417850 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:01.417850 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:01.417850 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:01.417850 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:01.417850 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:01.418794 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:01.418794 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:01.418794 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:01.418794 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:01.418794 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:01.418794 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:01.418794 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:01.418794 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:01.418794 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:01.418794 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:01.418794 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:01.418794 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:01.420826 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 214/421] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:43:01.427064 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e125a93-4a95-4181-ae8f-2ff16474a4f0 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:01.532213 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:01.547060 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc5661-e355-4943-bce1-206cfe3d2b60 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:01.555922 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e125a93-4a95-4181-ae8f-2ff16474a4f0 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:01.598015 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c3b0c-f0e0-4b30-a5f8-41c1a40ecf11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:01.599155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c3b0c-f0e0-4b30-a5f8-41c1a40ecf11 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:01.603900 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c3b0c-f0e0-4b30-a5f8-41c1a40ecf11 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:01.603900 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c3b0c-f0e0-4b30-a5f8-41c1a40ecf11 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:01.603900 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c3b0c-f0e0-4b30-a5f8-41c1a40ecf11 None admin] RBAC: Adding query filter params (name=member) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:01.603900 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c3b0c-f0e0-4b30-a5f8-41c1a40ecf11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:01.603900 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c3b0c-f0e0-4b30-a5f8-41c1a40ecf11 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:01.614454 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 215/422] 10.222.0.85 () {56 vars in 1101 bytes} [Thu Jun 16 14:43:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:01.616377 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:01.624468 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c3b0c-f0e0-4b30-a5f8-41c1a40ecf11 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:01.640853 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f0289-5163-4854-a831-c5a543da4f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:01.641815 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f0289-5163-4854-a831-c5a543da4f0c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:01.642289 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f0289-5163-4854-a831-c5a543da4f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:01.642750 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f0289-5163-4854-a831-c5a543da4f0c None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:01.643684 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f0289-5163-4854-a831-c5a543da4f0c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:01.644241 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f0289-5163-4854-a831-c5a543da4f0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:01.645801 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f0289-5163-4854-a831-c5a543da4f0c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:01.659923 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 208/423] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:01.668776 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f0289-5163-4854-a831-c5a543da4f0c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:01.807723 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c3b0c-f0e0-4b30-a5f8-41c1a40ecf11 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:01.845747 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f5078-5e42-45c4-8b30-e88d15900757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:01.846420 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f5078-5e42-45c4-8b30-e88d15900757 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:01.846746 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f5078-5e42-45c4-8b30-e88d15900757 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:01.847041 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f5078-5e42-45c4-8b30-e88d15900757 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:01.924320 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:01.929861 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f0289-5163-4854-a831-c5a543da4f0c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:01.931145 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f5078-5e42-45c4-8b30-e88d15900757 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:01.933491 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f5078-5e42-45c4-8b30-e88d15900757 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:02.047321 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 216/424] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:02.052973 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f5078-5e42-45c4-8b30-e88d15900757 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:02.064899 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10b029-6a6d-45ea-ba27-448a15b0a941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:02.065259 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10b029-6a6d-45ea-ba27-448a15b0a941 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:02.065547 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10b029-6a6d-45ea-ba27-448a15b0a941 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:02.065832 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10b029-6a6d-45ea-ba27-448a15b0a941 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:02.160156 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f5078-5e42-45c4-8b30-e88d15900757 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:02.161364 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:02.164277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:02.202190 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d820eb6-c506-416a-ade8-08e3b967b7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:02.203430 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d820eb6-c506-416a-ade8-08e3b967b7bb None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:02.203970 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d820eb6-c506-416a-ade8-08e3b967b7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:02.204446 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d820eb6-c506-416a-ade8-08e3b967b7bb None admin] PATH_INFO: `/v3/projects/379430b83a8643be9d1e7d6fee22017d` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:02.205930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d820eb6-c506-416a-ade8-08e3b967b7bb None admin] RBAC: Authorizing `identity:get_project(project_id=379430b83a8643be9d1e7d6fee22017d)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:02.207604 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d820eb6-c506-416a-ade8-08e3b967b7bb None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:02.210858 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 217/425] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:02 2022] GET /identity/v3/projects/379430b83a8643be9d1e7d6fee22017d => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:02.217423 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d820eb6-c506-416a-ade8-08e3b967b7bb None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:02.281867 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10b029-6a6d-45ea-ba27-448a15b0a941 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:02.284225 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10b029-6a6d-45ea-ba27-448a15b0a941 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:02.425826 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d820eb6-c506-416a-ade8-08e3b967b7bb None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:02.485432 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b5fb7-315b-442a-8ab3-456eda73f0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:02.486714 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b5fb7-315b-442a-8ab3-456eda73f0fd None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:02.488203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b5fb7-315b-442a-8ab3-456eda73f0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:02.488849 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b5fb7-315b-442a-8ab3-456eda73f0fd None admin] PATH_INFO: `/v3/groups/5a87635480bc471ba12ebaa5e97a7fb7` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:02.490523 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b5fb7-315b-442a-8ab3-456eda73f0fd None admin] RBAC: Authorizing `identity:get_group(group_id=5a87635480bc471ba12ebaa5e97a7fb7)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:02.492336 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b5fb7-315b-442a-8ab3-456eda73f0fd None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:02.495483 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 218/426] 10.222.0.85 () {56 vars in 1180 bytes} [Thu Jun 16 14:43:02 2022] GET /identity/v3/groups/5a87635480bc471ba12ebaa5e97a7fb7 => generated 226 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:02.505515 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b5fb7-315b-442a-8ab3-456eda73f0fd None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:02.529269 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 209/427] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 861 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:02.533290 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10b029-6a6d-45ea-ba27-448a15b0a941 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:02.580278 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:02.625085 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:02.678784 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b5fb7-315b-442a-8ab3-456eda73f0fd None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:02.681296 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10b029-6a6d-45ea-ba27-448a15b0a941 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:02.717511 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05accb01-7bfe-4813-93ea-c6933d3f3b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:02.718167 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05accb01-7bfe-4813-93ea-c6933d3f3b8d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:02.718450 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05accb01-7bfe-4813-93ea-c6933d3f3b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:02.718725 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05accb01-7bfe-4813-93ea-c6933d3f3b8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:02.719572 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05accb01-7bfe-4813-93ea-c6933d3f3b8d None admin] RBAC: Adding query filter params (group.id=5a87635480bc471ba12ebaa5e97a7fb7, role.id=26e7e900cf574eaabe4fcf886acb0c46, scope.project.id=379430b83a8643be9d1e7d6fee22017d) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:02.719909 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05accb01-7bfe-4813-93ea-c6933d3f3b8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:02.721497 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05accb01-7bfe-4813-93ea-c6933d3f3b8d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:02.726680 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fef08a-f7c8-429a-bb0b-4b6a5b58ef13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:02.727769 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fef08a-f7c8-429a-bb0b-4b6a5b58ef13 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:02.728215 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fef08a-f7c8-429a-bb0b-4b6a5b58ef13 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:02.728318 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 219/428] 10.222.0.85 () {56 vars in 1376 bytes} [Thu Jun 16 14:43:02 2022] GET /identity/v3/role_assignments?group.id=5a87635480bc471ba12ebaa5e97a7fb7&scope.project.id=379430b83a8643be9d1e7d6fee22017d&role.id=26e7e900cf574eaabe4fcf886acb0c46 => generated 611 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:02.728940 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fef08a-f7c8-429a-bb0b-4b6a5b58ef13 None admin] PATH_INFO: `/v3/projects/379430b83a8643be9d1e7d6fee22017d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:02.729712 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70b396-502a-4f2f-bdea-eb3431bcb0f4 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:02.729999 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70b396-502a-4f2f-bdea-eb3431bcb0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:02.730277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70b396-502a-4f2f-bdea-eb3431bcb0f4 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:02.730830 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fef08a-f7c8-429a-bb0b-4b6a5b58ef13 None admin] RBAC: Authorizing `identity:get_project(project_id=379430b83a8643be9d1e7d6fee22017d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:02.731560 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 220/429] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:02.732629 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fef08a-f7c8-429a-bb0b-4b6a5b58ef13 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:02.735002 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 210/430] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:02 2022] GET /identity/v3/projects/379430b83a8643be9d1e7d6fee22017d => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:02.737389 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0739f0-d9e4-4973-b3f3-d1be4f286aa1 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:02.737685 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0739f0-d9e4-4973-b3f3-d1be4f286aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:02.737968 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0739f0-d9e4-4973-b3f3-d1be4f286aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:02.740782 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fef08a-f7c8-429a-bb0b-4b6a5b58ef13 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:02.756698 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-1a0739f0-d9e4-4973-b3f3-d1be4f286aa1 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:02.757760 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1a0739f0-d9e4-4973-b3f3-d1be4f286aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:02.855899 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 221/431] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:02.884251 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fef08a-f7c8-429a-bb0b-4b6a5b58ef13 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:02.913956 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0739f0-d9e4-4973-b3f3-d1be4f286aa1 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:02.924246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:02.934842 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c94951-9662-400d-b748-f8af87bc8d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:02.935635 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c94951-9662-400d-b748-f8af87bc8d3c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:02.935960 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c94951-9662-400d-b748-f8af87bc8d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:02.936241 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c94951-9662-400d-b748-f8af87bc8d3c None admin] PATH_INFO: `/v3/groups/5a87635480bc471ba12ebaa5e97a7fb7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:02.937493 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c94951-9662-400d-b748-f8af87bc8d3c None admin] RBAC: Authorizing `identity:get_group(group_id=5a87635480bc471ba12ebaa5e97a7fb7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:02.938964 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c94951-9662-400d-b748-f8af87bc8d3c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:02.941008 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 211/432] 10.222.0.85 () {56 vars in 1180 bytes} [Thu Jun 16 14:43:02 2022] GET /identity/v3/groups/5a87635480bc471ba12ebaa5e97a7fb7 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:02.955507 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c94951-9662-400d-b748-f8af87bc8d3c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:02.985396 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:03.104820 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0739f0-d9e4-4973-b3f3-d1be4f286aa1 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:03.112438 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c94951-9662-400d-b748-f8af87bc8d3c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:03.151185 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6f5e7-1f4f-4ecd-861b-2a4c975c0fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:03.153616 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6f5e7-1f4f-4ecd-861b-2a4c975c0fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:03.154128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6f5e7-1f4f-4ecd-861b-2a4c975c0fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:03.154592 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6f5e7-1f4f-4ecd-861b-2a4c975c0fa8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:03.160963 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbe3aa-ec13-435a-beb5-930527cdb547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:03.162822 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbe3aa-ec13-435a-beb5-930527cdb547 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:03.163505 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbe3aa-ec13-435a-beb5-930527cdb547 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:03.165106 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbe3aa-ec13-435a-beb5-930527cdb547 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:03.166188 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bbe3aa-ec13-435a-beb5-930527cdb547 None admin] RBAC: Adding query filter params (group.id=5a87635480bc471ba12ebaa5e97a7fb7, role.id=2f7fa8924ea9447aab26981f0329ad43, scope.project.id=379430b83a8643be9d1e7d6fee22017d) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:03.166967 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bbe3aa-ec13-435a-beb5-930527cdb547 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:03.170990 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bbe3aa-ec13-435a-beb5-930527cdb547 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:03.178011 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea6f5e7-1f4f-4ecd-861b-2a4c975c0fa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:03.180133 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 212/433] 10.222.0.85 () {56 vars in 1376 bytes} [Thu Jun 16 14:43:02 2022] GET /identity/v3/role_assignments?group.id=5a87635480bc471ba12ebaa5e97a7fb7&scope.project.id=379430b83a8643be9d1e7d6fee22017d&role.id=2f7fa8924ea9447aab26981f0329ad43 => generated 611 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:03.187274 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-cea6f5e7-1f4f-4ecd-861b-2a4c975c0fa8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:03.187274 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:03.187274 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:03.187274 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:03.187274 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:03.187274 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:03.187274 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:03.187274 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:03.187274 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:03.187274 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:03.187274 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:03.187274 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:03.187274 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:03.187274 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:03.187274 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:03.187274 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:03.188253 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:03.188253 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:03.188253 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:03.188253 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:03.188253 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:03.188253 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:03.188253 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:03.188253 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:03.188253 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:03.188253 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:03.188253 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:03.188253 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:03.188253 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:03.188253 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:03.188253 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:03.188253 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:03.189044 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:03.189044 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:03.189044 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:03.189044 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:03.189044 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:03.189044 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:03.189044 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:03.189044 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:03.189044 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:03.189044 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:03.189044 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:03.189044 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:03.192228 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 222/434] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:43:03.205295 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbe3aa-ec13-435a-beb5-930527cdb547 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:03.266856 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec8c0d-3851-45ab-815e-7c123b8a5506 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:03.267528 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec8c0d-3851-45ab-815e-7c123b8a5506 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:03.268112 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec8c0d-3851-45ab-815e-7c123b8a5506 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:03.269725 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 223/435] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:43:03.274320 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:03.277925 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ea9ae-a62b-4f80-9392-b525ebda7fda None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:03.278397 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ea9ae-a62b-4f80-9392-b525ebda7fda None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:03.278871 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ea9ae-a62b-4f80-9392-b525ebda7fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:03.315431 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-8b1ea9ae-a62b-4f80-9392-b525ebda7fda None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:03.316662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8b1ea9ae-a62b-4f80-9392-b525ebda7fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:03.329294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbe3aa-ec13-435a-beb5-930527cdb547 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:03.368548 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219cbed-b091-46b4-aa35-36b16374c974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:03.369687 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219cbed-b091-46b4-aa35-36b16374c974 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:03.370222 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219cbed-b091-46b4-aa35-36b16374c974 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:03.370694 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219cbed-b091-46b4-aa35-36b16374c974 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:03.371665 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219cbed-b091-46b4-aa35-36b16374c974 None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:03.372231 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219cbed-b091-46b4-aa35-36b16374c974 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:03.373925 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219cbed-b091-46b4-aa35-36b16374c974 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:03.383928 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 213/436] 10.222.0.85 () {56 vars in 1101 bytes} [Thu Jun 16 14:43:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:03.390525 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219cbed-b091-46b4-aa35-36b16374c974 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:03.398913 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 224/437] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:43:03.429027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ea9ae-a62b-4f80-9392-b525ebda7fda None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:03.462720 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:03.536921 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219cbed-b091-46b4-aa35-36b16374c974 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:03.575574 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:03.575792 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ea9ae-a62b-4f80-9392-b525ebda7fda None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:03.600100 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11dc91-9304-4e53-b191-e5a1dd3738ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:03.601259 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11dc91-9304-4e53-b191-e5a1dd3738ab None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:03.601821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11dc91-9304-4e53-b191-e5a1dd3738ab None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:03.602298 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11dc91-9304-4e53-b191-e5a1dd3738ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:03.625814 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054775d6-c930-48d2-8d04-06ff615ca857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:03.627533 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054775d6-c930-48d2-8d04-06ff615ca857 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:03.628073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054775d6-c930-48d2-8d04-06ff615ca857 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:03.628614 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054775d6-c930-48d2-8d04-06ff615ca857 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:03.644271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054775d6-c930-48d2-8d04-06ff615ca857 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:03.653809 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-054775d6-c930-48d2-8d04-06ff615ca857 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:43:03.653809 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:03.653809 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:03.653809 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:03.653809 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:03.653809 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:03.653809 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:03.653809 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:03.653809 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:03.653809 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:03.653809 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:03.653809 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:03.653809 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:03.653809 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:03.653809 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:03.653809 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:03.654793 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:03.654793 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:03.654793 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:03.654793 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:03.654793 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:03.654793 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:03.654793 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:03.654793 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:03.654793 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:03.654793 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:03.654793 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:03.654793 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:03.654793 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:03.654793 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:03.654793 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:03.654793 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:03.655588 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:03.655588 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:03.655588 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:03.655588 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:03.655588 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:03.655588 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:03.655588 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:03.655588 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:03.655588 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:03.655588 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:03.655588 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:43:03.655588 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:03.655588 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 225/438] 10.222.0.85 () {56 vars in 1114 bytes} [Thu Jun 16 14:43:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:03.664860 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054775d6-c930-48d2-8d04-06ff615ca857 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:03.698661 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11dc91-9304-4e53-b191-e5a1dd3738ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:03.700270 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11dc91-9304-4e53-b191-e5a1dd3738ab None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:03.758889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:03.790110 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054775d6-c930-48d2-8d04-06ff615ca857 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:03.826321 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 214/439] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 14:43:03.827697 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa60ba-10a8-4558-8419-ef4fda717485 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:03.828104 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa60ba-10a8-4558-8419-ef4fda717485 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:03.828384 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa60ba-10a8-4558-8419-ef4fda717485 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:03.833558 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 215/440] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:03.833558 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa60ba-10a8-4558-8419-ef4fda717485 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:03.844464 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480cc43-abbb-430a-acd2-95a2bca4e50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:03.845155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480cc43-abbb-430a-acd2-95a2bca4e50c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:03.845439 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480cc43-abbb-430a-acd2-95a2bca4e50c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:03.845716 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480cc43-abbb-430a-acd2-95a2bca4e50c None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:03.846483 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480cc43-abbb-430a-acd2-95a2bca4e50c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:03.846798 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480cc43-abbb-430a-acd2-95a2bca4e50c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:03.848250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480cc43-abbb-430a-acd2-95a2bca4e50c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:03.858586 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 226/441] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:03.860250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae361cc-82f5-40bb-a4d2-0721f5fab1c0 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:03.860617 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae361cc-82f5-40bb-a4d2-0721f5fab1c0 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:03.860900 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae361cc-82f5-40bb-a4d2-0721f5fab1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:03.864245 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:03.877995 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-cae361cc-82f5-40bb-a4d2-0721f5fab1c0 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:03.879193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-cae361cc-82f5-40bb-a4d2-0721f5fab1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:03.944370 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa60ba-10a8-4558-8419-ef4fda717485 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:03.947835 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 227/442] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:03.948822 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae361cc-82f5-40bb-a4d2-0721f5fab1c0 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:03.995709 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb403187-bf65-4114-8f90-679a7e66035e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:03.996608 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb403187-bf65-4114-8f90-679a7e66035e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:03.996890 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb403187-bf65-4114-8f90-679a7e66035e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:03.997157 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb403187-bf65-4114-8f90-679a7e66035e None admin] PATH_INFO: `/v3/projects/2626df1e7e3e430790b7db426c06948f` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:03.998316 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb403187-bf65-4114-8f90-679a7e66035e None admin] RBAC: Authorizing `identity:get_project(project_id=2626df1e7e3e430790b7db426c06948f)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:03.999769 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb403187-bf65-4114-8f90-679a7e66035e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:04.006054 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 216/443] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:03 2022] GET /identity/v3/projects/2626df1e7e3e430790b7db426c06948f => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:04.006054 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb403187-bf65-4114-8f90-679a7e66035e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:04.015896 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:04.050090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae361cc-82f5-40bb-a4d2-0721f5fab1c0 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:04.090524 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23ce92-a2c9-4e2e-aefd-c112d49d10d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:04.091181 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23ce92-a2c9-4e2e-aefd-c112d49d10d3 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:04.091463 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23ce92-a2c9-4e2e-aefd-c112d49d10d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:04.091741 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23ce92-a2c9-4e2e-aefd-c112d49d10d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:04.094073 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:04.108000 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb403187-bf65-4114-8f90-679a7e66035e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:04.143323 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c78b31-57a9-4205-aa72-be3b81423732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:04.144157 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c78b31-57a9-4205-aa72-be3b81423732 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:04.144436 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c78b31-57a9-4205-aa72-be3b81423732 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:04.144708 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c78b31-57a9-4205-aa72-be3b81423732 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:04.155086 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c78b31-57a9-4205-aa72-be3b81423732 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:04.159004 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23ce92-a2c9-4e2e-aefd-c112d49d10d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:04.160562 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23ce92-a2c9-4e2e-aefd-c112d49d10d3 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:04.162723 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-61c78b31-57a9-4205-aa72-be3b81423732 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:04.162723 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:04.162723 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:04.162723 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:04.162723 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:04.162723 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:04.162723 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:04.162723 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:04.162723 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:04.162723 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:04.162723 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:04.162723 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:04.162723 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:04.162723 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:04.162723 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:04.162723 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:04.163681 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:04.163681 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:04.163681 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:04.163681 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:04.163681 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:04.163681 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:04.163681 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:04.163681 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:04.163681 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:04.163681 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:04.163681 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:04.163681 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:04.163681 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:04.163681 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:04.163681 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:04.163681 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:04.164538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:04.164538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:04.164538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:04.164538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:04.164538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:04.164538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:04.164538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:04.164538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:04.164538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:04.164538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:04.164538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:04.164538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:04.164538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 217/444] 10.222.0.85 () {56 vars in 1096 bytes} [Thu Jun 16 14:43:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:04.165181 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c78b31-57a9-4205-aa72-be3b81423732 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:04.226549 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:04.265435 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 228/445] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:04.266555 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23ce92-a2c9-4e2e-aefd-c112d49d10d3 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:04.274326 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c78b31-57a9-4205-aa72-be3b81423732 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:04.308297 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e140695-809b-4898-adaf-3783467b2eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:04.309166 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e140695-809b-4898-adaf-3783467b2eaa None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:04.309422 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e140695-809b-4898-adaf-3783467b2eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:04.309697 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e140695-809b-4898-adaf-3783467b2eaa None admin] PATH_INFO: `/v3/groups/5a87635480bc471ba12ebaa5e97a7fb7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:04.310883 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e140695-809b-4898-adaf-3783467b2eaa None admin] RBAC: Authorizing `identity:get_group(group_id=5a87635480bc471ba12ebaa5e97a7fb7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:04.312372 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e140695-809b-4898-adaf-3783467b2eaa None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:04.314011 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 218/446] 10.222.0.85 () {56 vars in 1180 bytes} [Thu Jun 16 14:43:04 2022] GET /identity/v3/groups/5a87635480bc471ba12ebaa5e97a7fb7 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:04.314760 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e140695-809b-4898-adaf-3783467b2eaa None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:04.333288 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:04.371682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23ce92-a2c9-4e2e-aefd-c112d49d10d3 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:04.408107 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f714211-8573-4214-9655-af5bfd25be63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:04.408784 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f714211-8573-4214-9655-af5bfd25be63 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:04.409065 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f714211-8573-4214-9655-af5bfd25be63 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:04.409341 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f714211-8573-4214-9655-af5bfd25be63 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:04.410092 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f714211-8573-4214-9655-af5bfd25be63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:04.410396 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f714211-8573-4214-9655-af5bfd25be63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:04.411789 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f714211-8573-4214-9655-af5bfd25be63 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:04.420410 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 229/447] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:04.421119 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f714211-8573-4214-9655-af5bfd25be63 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:04.426492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e140695-809b-4898-adaf-3783467b2eaa None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:04.453365 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:04.461816 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017ed53-7016-47c3-9842-2978d8dad94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:04.462690 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017ed53-7016-47c3-9842-2978d8dad94b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:04.462965 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017ed53-7016-47c3-9842-2978d8dad94b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:04.463237 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017ed53-7016-47c3-9842-2978d8dad94b None admin] PATH_INFO: `/v3/projects/2626df1e7e3e430790b7db426c06948f` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:04.464481 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2017ed53-7016-47c3-9842-2978d8dad94b None admin] RBAC: Authorizing `identity:get_project(project_id=2626df1e7e3e430790b7db426c06948f)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:04.465926 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2017ed53-7016-47c3-9842-2978d8dad94b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:04.467631 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 219/448] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:04 2022] GET /identity/v3/projects/2626df1e7e3e430790b7db426c06948f => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:04.468413 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017ed53-7016-47c3-9842-2978d8dad94b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:04.529201 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f714211-8573-4214-9655-af5bfd25be63 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:04.561383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:04.567820 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385cdeb-569a-4909-af10-fc71675a6adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:04.568521 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385cdeb-569a-4909-af10-fc71675a6adf None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:04.568803 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385cdeb-569a-4909-af10-fc71675a6adf None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:04.569080 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385cdeb-569a-4909-af10-fc71675a6adf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:04.569921 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385cdeb-569a-4909-af10-fc71675a6adf None admin] RBAC: Adding query filter params (group.id=5a87635480bc471ba12ebaa5e97a7fb7, role.id=26e7e900cf574eaabe4fcf886acb0c46, scope.project.id=2626df1e7e3e430790b7db426c06948f) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:04.570241 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385cdeb-569a-4909-af10-fc71675a6adf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:04.571694 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385cdeb-569a-4909-af10-fc71675a6adf None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:04.578305 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 230/449] 10.222.0.85 () {56 vars in 1376 bytes} [Thu Jun 16 14:43:04 2022] GET /identity/v3/role_assignments?group.id=5a87635480bc471ba12ebaa5e97a7fb7&scope.project.id=2626df1e7e3e430790b7db426c06948f&role.id=26e7e900cf574eaabe4fcf886acb0c46 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:04.579041 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017ed53-7016-47c3-9842-2978d8dad94b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:04.579138 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385cdeb-569a-4909-af10-fc71675a6adf None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:04.624245 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ccf8d-ea54-4df5-845a-13e4091ad5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:04.624911 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ccf8d-ea54-4df5-845a-13e4091ad5cc None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:04.625189 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ccf8d-ea54-4df5-845a-13e4091ad5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:04.625463 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ccf8d-ea54-4df5-845a-13e4091ad5cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:04.689781 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:04.698931 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385cdeb-569a-4909-af10-fc71675a6adf None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:04.703459 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ccf8d-ea54-4df5-845a-13e4091ad5cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:04.705009 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ccf8d-ea54-4df5-845a-13e4091ad5cc None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:04.737481 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f7ff0-6ecc-4545-a9be-19aa289aa32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:04.738365 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f7ff0-6ecc-4545-a9be-19aa289aa32f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:04.738654 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f7ff0-6ecc-4545-a9be-19aa289aa32f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:04.738934 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f7ff0-6ecc-4545-a9be-19aa289aa32f None admin] PATH_INFO: `/v3/groups/5a87635480bc471ba12ebaa5e97a7fb7` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:04.740204 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f7ff0-6ecc-4545-a9be-19aa289aa32f None admin] RBAC: Authorizing `identity:get_group(group_id=5a87635480bc471ba12ebaa5e97a7fb7)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:04.741682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f7ff0-6ecc-4545-a9be-19aa289aa32f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:04.743365 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 231/450] 10.222.0.85 () {56 vars in 1180 bytes} [Thu Jun 16 14:43:04 2022] GET /identity/v3/groups/5a87635480bc471ba12ebaa5e97a7fb7 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:04.749702 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f7ff0-6ecc-4545-a9be-19aa289aa32f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:04.811059 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:04.830899 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 220/451] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:04.836791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ccf8d-ea54-4df5-845a-13e4091ad5cc None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:04.873182 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f7ff0-6ecc-4545-a9be-19aa289aa32f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:04.913590 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9fa27-836c-47d4-b097-7db9fec18553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:04.914563 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9fa27-836c-47d4-b097-7db9fec18553 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:04.915018 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9fa27-836c-47d4-b097-7db9fec18553 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:04.915494 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9fa27-836c-47d4-b097-7db9fec18553 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:04.917041 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e9fa27-836c-47d4-b097-7db9fec18553 None admin] RBAC: Adding query filter params (group.id=5a87635480bc471ba12ebaa5e97a7fb7, role.id=2f7fa8924ea9447aab26981f0329ad43, scope.project.id=2626df1e7e3e430790b7db426c06948f) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:04.917563 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e9fa27-836c-47d4-b097-7db9fec18553 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:04.919036 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e9fa27-836c-47d4-b097-7db9fec18553 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:04.925932 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 232/452] 10.222.0.85 () {56 vars in 1376 bytes} [Thu Jun 16 14:43:04 2022] GET /identity/v3/role_assignments?group.id=5a87635480bc471ba12ebaa5e97a7fb7&scope.project.id=2626df1e7e3e430790b7db426c06948f&role.id=2f7fa8924ea9447aab26981f0329ad43 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:04.960522 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ccf8d-ea54-4df5-845a-13e4091ad5cc None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:04.998766 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486cb77-5108-496b-9562-13c470ff4081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:04.999655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486cb77-5108-496b-9562-13c470ff4081 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:04.999966 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486cb77-5108-496b-9562-13c470ff4081 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:05.000248 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486cb77-5108-496b-9562-13c470ff4081 None admin] PATH_INFO: `/v3/projects/d8f4fd10bac54b6ca305e8af48785eb7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:05.001502 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486cb77-5108-496b-9562-13c470ff4081 None admin] RBAC: Authorizing `identity:get_project(project_id=d8f4fd10bac54b6ca305e8af48785eb7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:05.003019 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486cb77-5108-496b-9562-13c470ff4081 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:05.004937 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 221/453] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:04 2022] GET /identity/v3/projects/d8f4fd10bac54b6ca305e8af48785eb7 => generated 344 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:05.010999 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9fa27-836c-47d4-b097-7db9fec18553 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:05.045092 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:05.127573 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9fa27-836c-47d4-b097-7db9fec18553 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:05.165679 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ef982-27c7-490b-99ea-84fe4eef77f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:05.166682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ef982-27c7-490b-99ea-84fe4eef77f0 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:05.166967 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ef982-27c7-490b-99ea-84fe4eef77f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:05.167239 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ef982-27c7-490b-99ea-84fe4eef77f0 None admin] PATH_INFO: `/v3/groups/1669774be26f4f0088a9f8d4679c2a3b` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:05.168545 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ef982-27c7-490b-99ea-84fe4eef77f0 None admin] RBAC: Authorizing `identity:get_group(group_id=1669774be26f4f0088a9f8d4679c2a3b)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:05.170023 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ef982-27c7-490b-99ea-84fe4eef77f0 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:05.172017 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 233/454] 10.222.0.85 () {56 vars in 1180 bytes} [Thu Jun 16 14:43:05 2022] GET /identity/v3/groups/1669774be26f4f0088a9f8d4679c2a3b => generated 229 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:05.178340 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486cb77-5108-496b-9562-13c470ff4081 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:05.237392 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:05.286281 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486cb77-5108-496b-9562-13c470ff4081 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:05.322775 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f6e47-32e3-4cdd-bf2b-d2358ecca2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:05.323512 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f6e47-32e3-4cdd-bf2b-d2358ecca2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:05.323804 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f6e47-32e3-4cdd-bf2b-d2358ecca2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:05.324098 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f6e47-32e3-4cdd-bf2b-d2358ecca2a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:05.324933 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f6e47-32e3-4cdd-bf2b-d2358ecca2a3 None admin] RBAC: Adding query filter params (group.id=1669774be26f4f0088a9f8d4679c2a3b, role.id=95dcfa6c726a4d01a41d2642554fd338, scope.project.id=d8f4fd10bac54b6ca305e8af48785eb7) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:05.325246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f6e47-32e3-4cdd-bf2b-d2358ecca2a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:05.326798 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f6e47-32e3-4cdd-bf2b-d2358ecca2a3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:05.332736 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 222/455] 10.222.0.85 () {56 vars in 1376 bytes} [Thu Jun 16 14:43:05 2022] GET /identity/v3/role_assignments?group.id=1669774be26f4f0088a9f8d4679c2a3b&scope.project.id=d8f4fd10bac54b6ca305e8af48785eb7&role.id=95dcfa6c726a4d01a41d2642554fd338 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:08.252354 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8ad42-a63a-4d16-bf08-52a73bd032eb None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:08.253423 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8ad42-a63a-4d16-bf08-52a73bd032eb None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:08.253910 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8ad42-a63a-4d16-bf08-52a73bd032eb None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:08.255893 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 234/456] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:08.262051 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02a5e2-3952-4df5-b329-ac9cc6790642 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:08.263020 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02a5e2-3952-4df5-b329-ac9cc6790642 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:08.263497 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02a5e2-3952-4df5-b329-ac9cc6790642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:08.293164 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1c02a5e2-3952-4df5-b329-ac9cc6790642 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:08.295148 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1c02a5e2-3952-4df5-b329-ac9cc6790642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:08.353120 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0289a-ddea-4ad1-a162-06fb75e42a71 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:08.353819 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0289a-ddea-4ad1-a162-06fb75e42a71 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:08.354298 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0289a-ddea-4ad1-a162-06fb75e42a71 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:08.356417 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 235/457] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:08.378702 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506075b5-fea6-4df7-8a6d-31f5f4793642 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:08.378990 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506075b5-fea6-4df7-8a6d-31f5f4793642 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:08.379434 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506075b5-fea6-4df7-8a6d-31f5f4793642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:08.388042 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 223/458] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:08.414110 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02a5e2-3952-4df5-b329-ac9cc6790642 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:08.417123 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-506075b5-fea6-4df7-8a6d-31f5f4793642 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:08.418588 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-506075b5-fea6-4df7-8a6d-31f5f4793642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:08.474114 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:08.494388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 236/459] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:08.496215 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fc940-e546-42bc-85f9-3b705947bef8 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:08.496640 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fc940-e546-42bc-85f9-3b705947bef8 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:08.497058 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fc940-e546-42bc-85f9-3b705947bef8 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:08.499412 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 237/460] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:08.504876 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9af77e-dc60-4c4e-811d-cd4f60e41efb None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:08.505470 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9af77e-dc60-4c4e-811d-cd4f60e41efb None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:08.505885 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9af77e-dc60-4c4e-811d-cd4f60e41efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:08.528593 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-ed9af77e-dc60-4c4e-811d-cd4f60e41efb None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:08.530219 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ed9af77e-dc60-4c4e-811d-cd4f60e41efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:08.549584 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02a5e2-3952-4df5-b329-ac9cc6790642 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:08.550905 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:08.600943 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da533f3-4957-4ec9-808b-3a3b9f8b6d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:08.602829 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da533f3-4957-4ec9-808b-3a3b9f8b6d12 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:08.603468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da533f3-4957-4ec9-808b-3a3b9f8b6d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:08.604155 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da533f3-4957-4ec9-808b-3a3b9f8b6d12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:08.621719 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da533f3-4957-4ec9-808b-3a3b9f8b6d12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:08.622414 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 238/461] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:08.623553 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9af77e-dc60-4c4e-811d-cd4f60e41efb None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:08.629058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da533f3-4957-4ec9-808b-3a3b9f8b6d12 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:08.661447 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-2da533f3-4957-4ec9-808b-3a3b9f8b6d12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:08.661447 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:08.661447 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:08.661447 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:08.661447 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:08.661447 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:08.661447 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:08.661447 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:08.661447 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:08.661447 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:08.661447 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:08.661447 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:08.661447 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:08.661447 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:08.661447 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:08.662573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:08.662573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:08.662573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:08.662573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:08.662573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:08.662573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:08.662573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:08.662573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:08.662573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:08.662573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:08.662573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:08.662573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:08.662573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:08.662573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:08.662573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:08.662573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:08.662573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:08.669315 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:08.669315 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:08.669315 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:08.669315 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:08.669315 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 224/462] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:43:08.669315 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da533f3-4957-4ec9-808b-3a3b9f8b6d12 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:08.748698 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9af77e-dc60-4c4e-811d-cd4f60e41efb None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:08.784852 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3686571-ba8d-4140-af0b-243e781b8783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:08.785693 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3686571-ba8d-4140-af0b-243e781b8783 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:08.785974 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3686571-ba8d-4140-af0b-243e781b8783 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:08.786253 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3686571-ba8d-4140-af0b-243e781b8783 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:08.792521 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:08.797888 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da533f3-4957-4ec9-808b-3a3b9f8b6d12 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:08.800200 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3686571-ba8d-4140-af0b-243e781b8783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:08.801728 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3686571-ba8d-4140-af0b-243e781b8783 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:08.821868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-b3686571-ba8d-4140-af0b-243e781b8783 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:08.821868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:08.821868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:08.821868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:08.821868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:08.821868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:08.821868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:08.821868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:08.821868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:08.821868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:08.821868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:08.821868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:08.821868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:08.821868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:08.821868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:08.822817 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:08.822817 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:08.822817 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:08.822817 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:08.822817 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:08.822817 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:08.822817 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:08.822817 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:08.822817 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:08.822817 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:08.822817 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:08.822817 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:08.822817 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:08.822817 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:08.822817 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:08.822817 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:08.822817 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:08.823673 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:08.823673 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:08.823673 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:08.823673 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:08.823673 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 239/463] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:08.824960 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a039f-875d-4eb7-a4b0-647aeb82b372 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:08.825243 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a039f-875d-4eb7-a4b0-647aeb82b372 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:08.825515 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a039f-875d-4eb7-a4b0-647aeb82b372 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:08.826953 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 240/464] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:08.827455 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a039f-875d-4eb7-a4b0-647aeb82b372 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:08.840137 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:08.851044 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6100caa2-0c86-49fe-a88b-83d362347f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:08.852656 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100caa2-0c86-49fe-a88b-83d362347f5d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:08.853124 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100caa2-0c86-49fe-a88b-83d362347f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:08.853696 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100caa2-0c86-49fe-a88b-83d362347f5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:08.866927 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6100caa2-0c86-49fe-a88b-83d362347f5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:08.868722 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6100caa2-0c86-49fe-a88b-83d362347f5d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:08.889159 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-6100caa2-0c86-49fe-a88b-83d362347f5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:08.889159 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:08.889159 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:08.889159 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:08.889159 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:08.889159 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:08.889159 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:08.889159 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:08.889159 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:08.889159 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:08.889159 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:08.889159 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:08.889159 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:08.889159 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:08.889159 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:08.890054 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:08.890054 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:08.890054 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:08.890054 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:08.890054 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:08.890054 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:08.890054 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:08.890054 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:08.890054 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:08.890054 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:08.890054 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:08.890054 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:08.890054 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:08.890054 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:08.890054 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:08.890054 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:08.890054 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:08.890902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:08.890902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:08.890902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:08.890902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:08.892553 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 225/465] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:08.893552 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6100caa2-0c86-49fe-a88b-83d362347f5d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:08.953626 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a039f-875d-4eb7-a4b0-647aeb82b372 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:08.989432 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634b65e-f117-4219-b4e3-8b29d13ad0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:08.990109 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634b65e-f117-4219-b4e3-8b29d13ad0ef None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:08.990395 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634b65e-f117-4219-b4e3-8b29d13ad0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:08.990672 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634b65e-f117-4219-b4e3-8b29d13ad0ef None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:08.991406 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634b65e-f117-4219-b4e3-8b29d13ad0ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:08.991714 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634b65e-f117-4219-b4e3-8b29d13ad0ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:08.993227 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634b65e-f117-4219-b4e3-8b29d13ad0ef None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:09.010372 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 241/466] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:09.010569 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6100caa2-0c86-49fe-a88b-83d362347f5d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:09.010694 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c865a17-0ef6-4581-b62d-05c4acddbb3f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:09.010694 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c865a17-0ef6-4581-b62d-05c4acddbb3f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:09.010694 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c865a17-0ef6-4581-b62d-05c4acddbb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:09.026763 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-6c865a17-0ef6-4581-b62d-05c4acddbb3f None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:09.028009 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6c865a17-0ef6-4581-b62d-05c4acddbb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:09.048355 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64f6a2-ad0e-4a46-9a55-d37bbd32fcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:09.048941 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64f6a2-ad0e-4a46-9a55-d37bbd32fcc3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:09.049223 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64f6a2-ad0e-4a46-9a55-d37bbd32fcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:09.049496 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64f6a2-ad0e-4a46-9a55-d37bbd32fcc3 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:09.050222 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64f6a2-ad0e-4a46-9a55-d37bbd32fcc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:09.050528 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64f6a2-ad0e-4a46-9a55-d37bbd32fcc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:09.051996 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64f6a2-ad0e-4a46-9a55-d37bbd32fcc3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:09.068566 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 226/467] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:09.068566 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64f6a2-ad0e-4a46-9a55-d37bbd32fcc3 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:09.081066 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:09.099090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:09.107622 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 242/468] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:09.108587 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c865a17-0ef6-4581-b62d-05c4acddbb3f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:09.189691 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64f6a2-ad0e-4a46-9a55-d37bbd32fcc3 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:09.227429 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c865a17-0ef6-4581-b62d-05c4acddbb3f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:09.229052 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a4e0c-106d-43bb-accb-04d90658944a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:09.229999 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a4e0c-106d-43bb-accb-04d90658944a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:09.231212 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a4e0c-106d-43bb-accb-04d90658944a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:09.231504 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a4e0c-106d-43bb-accb-04d90658944a None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:09.232286 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a4e0c-106d-43bb-accb-04d90658944a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:09.232598 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a4e0c-106d-43bb-accb-04d90658944a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:09.234039 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a4e0c-106d-43bb-accb-04d90658944a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:09.253961 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 227/469] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:09.253961 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a4e0c-106d-43bb-accb-04d90658944a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:09.269265 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b2274-dfac-41f7-80e3-f2abc600b4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:09.270310 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b2274-dfac-41f7-80e3-f2abc600b4c4 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:09.270596 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b2274-dfac-41f7-80e3-f2abc600b4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:09.270871 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b2274-dfac-41f7-80e3-f2abc600b4c4 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:09.271603 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b2274-dfac-41f7-80e3-f2abc600b4c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:09.273108 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b2274-dfac-41f7-80e3-f2abc600b4c4 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:09.293272 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 243/470] 10.222.0.85 () {60 vars in 1132 bytes} [Thu Jun 16 14:43:09 2022] POST /identity/v3/users => generated 246 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:43:09.293272 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b2274-dfac-41f7-80e3-f2abc600b4c4 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:09.352312 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:09.359436 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:09.390849 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a4e0c-106d-43bb-accb-04d90658944a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:09.418225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b2274-dfac-41f7-80e3-f2abc600b4c4 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:09.429489 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546566f-d932-4c18-8eb3-2958c5d01ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:09.430301 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546566f-d932-4c18-8eb3-2958c5d01ec1 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:09.430585 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546566f-d932-4c18-8eb3-2958c5d01ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:09.430908 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546566f-d932-4c18-8eb3-2958c5d01ec1 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:09.431639 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546566f-d932-4c18-8eb3-2958c5d01ec1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:09.433351 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546566f-d932-4c18-8eb3-2958c5d01ec1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:09.456293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361b8a2-476f-4aa2-8b2b-4598a80f71fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:09.457114 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361b8a2-476f-4aa2-8b2b-4598a80f71fe None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:09.457404 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361b8a2-476f-4aa2-8b2b-4598a80f71fe None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:09.457679 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361b8a2-476f-4aa2-8b2b-4598a80f71fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:09.468119 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 228/471] 10.222.0.85 () {60 vars in 1132 bytes} [Thu Jun 16 14:43:09 2022] POST /identity/v3/users => generated 248 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:43:09.469181 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546566f-d932-4c18-8eb3-2958c5d01ec1 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:09.471353 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361b8a2-476f-4aa2-8b2b-4598a80f71fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:09.473085 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361b8a2-476f-4aa2-8b2b-4598a80f71fe None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:09.496671 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-6361b8a2-476f-4aa2-8b2b-4598a80f71fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:09.496671 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:09.496671 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:09.496671 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:09.496671 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:09.496671 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:09.496671 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:09.496671 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:09.496671 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:09.496671 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:09.496671 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:09.496671 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:09.496671 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:09.496671 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:09.496671 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:09.497626 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:09.497626 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:09.497626 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:09.497626 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:09.497626 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:09.497626 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:09.497626 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:09.497626 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:09.497626 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:09.497626 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:09.497626 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:09.497626 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:09.497626 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:09.497626 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:09.497626 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:09.497626 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:09.497626 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:09.498657 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:09.498657 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:09.498657 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:09.498657 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:09.498657 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 244/472] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:09.499647 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090071e-a40d-4d3d-a488-0b8273598345 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:09.504054 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090071e-a40d-4d3d-a488-0b8273598345 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:09.504953 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090071e-a40d-4d3d-a488-0b8273598345 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:09.506325 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 245/473] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:09.507208 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090071e-a40d-4d3d-a488-0b8273598345 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:09.621075 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546566f-d932-4c18-8eb3-2958c5d01ec1 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:09.650622 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:09.657076 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090071e-a40d-4d3d-a488-0b8273598345 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:09.659967 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:09.664240 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b663773-9bb4-46b6-a110-0725c0dc938f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:09.665360 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b663773-9bb4-46b6-a110-0725c0dc938f None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:09.665832 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b663773-9bb4-46b6-a110-0725c0dc938f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:09.666364 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b663773-9bb4-46b6-a110-0725c0dc938f None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:09.667352 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b663773-9bb4-46b6-a110-0725c0dc938f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:09.668897 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b663773-9bb4-46b6-a110-0725c0dc938f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:09.692235 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 229/474] 10.222.0.85 () {60 vars in 1132 bytes} [Thu Jun 16 14:43:09 2022] POST /identity/v3/users => generated 248 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:43:09.694152 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e85262-f115-4122-83ec-93000da12eb7 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:09.694654 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e85262-f115-4122-83ec-93000da12eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:09.695128 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e85262-f115-4122-83ec-93000da12eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:09.717452 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f6e85262-f115-4122-83ec-93000da12eb7 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:09.718267 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b70832-ea72-4823-9f09-19a4e3b26b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:09.718701 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f6e85262-f115-4122-83ec-93000da12eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:09.719997 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b70832-ea72-4823-9f09-19a4e3b26b9c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:09.720581 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b70832-ea72-4823-9f09-19a4e3b26b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:09.721315 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b70832-ea72-4823-9f09-19a4e3b26b9c None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:09.722402 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b70832-ea72-4823-9f09-19a4e3b26b9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:09.723483 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b70832-ea72-4823-9f09-19a4e3b26b9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:09.725008 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b70832-ea72-4823-9f09-19a4e3b26b9c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:09.739806 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 246/475] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:09.746185 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b70832-ea72-4823-9f09-19a4e3b26b9c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:09.820730 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 230/476] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:09.871810 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e85262-f115-4122-83ec-93000da12eb7 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:09.923801 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b70832-ea72-4823-9f09-19a4e3b26b9c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:09.980301 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b9a6b-91d2-4a41-9465-cf8d923042a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:09.980998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b9a6b-91d2-4a41-9465-cf8d923042a1 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:09.981275 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b9a6b-91d2-4a41-9465-cf8d923042a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:09.981545 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b9a6b-91d2-4a41-9465-cf8d923042a1 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:09.982275 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b9a6b-91d2-4a41-9465-cf8d923042a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:09.984049 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b9a6b-91d2-4a41-9465-cf8d923042a1 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:10.018140 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 247/477] 10.222.0.85 () {60 vars in 1132 bytes} [Thu Jun 16 14:43:09 2022] POST /identity/v3/users => generated 249 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:43:10.035660 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e85262-f115-4122-83ec-93000da12eb7 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:10.052085 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:10.081940 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16ff48-11e2-43a9-babc-c3b0a4746881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:10.082683 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16ff48-11e2-43a9-babc-c3b0a4746881 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:10.082962 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16ff48-11e2-43a9-babc-c3b0a4746881 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:10.083236 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16ff48-11e2-43a9-babc-c3b0a4746881 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:10.084024 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d16ff48-11e2-43a9-babc-c3b0a4746881 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:10.085544 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d16ff48-11e2-43a9-babc-c3b0a4746881 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:10.093751 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.sql.core [None req-7d16ff48-11e2-43a9-babc-c3b0a4746881 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 14:43:10.093751 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 16 14:43:10.093751 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [parameters: {'id': 'db281d012c814ed79703a3d6bcc3ef9a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 16 14:43:10.093751 dv-cinder-837165-3-smb devstack@keystone.service[80175]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80175) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 14:43:10.115958 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-7d16ff48-11e2-43a9-babc-c3b0a4746881 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 16 14:43:10.115958 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:10.115958 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 14:43:10.115958 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 14:43:10.115958 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 14:43:10.115958 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 14:43:10.115958 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 14:43:10.115958 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 14:43:10.115958 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 14:43:10.115958 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application conn.query(q) Jun 16 14:43:10.115958 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 14:43:10.115958 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 14:43:10.115958 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 14:43:10.115958 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application result.read() Jun 16 14:43:10.115958 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 14:43:10.116897 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 14:43:10.116897 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 14:43:10.116897 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 14:43:10.116897 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 14:43:10.116897 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 14:43:10.116897 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 14:43:10.116897 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 14:43:10.116897 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 14:43:10.116897 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:10.116897 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 14:43:10.116897 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:10.116897 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:10.116897 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 14:43:10.116897 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 14:43:10.116897 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 16 14:43:10.116897 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return ref.to_dict() Jun 16 14:43:10.116897 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 14:43:10.116897 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application next(self.gen) Jun 16 14:43:10.118326 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 14:43:10.118326 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application yield resource Jun 16 14:43:10.118326 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 14:43:10.118326 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application next(self.gen) Jun 16 14:43:10.118326 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 14:43:10.118326 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 14:43:10.118326 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:43:10.118326 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 14:43:10.118326 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:43:10.118326 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise self.value Jun 16 14:43:10.118326 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 14:43:10.118326 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 14:43:10.118326 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 14:43:10.118326 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application session.commit() Jun 16 14:43:10.118326 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 14:43:10.118326 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 14:43:10.118326 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 14:43:10.119894 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 14:43:10.119894 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 14:43:10.119894 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self.session.flush() Jun 16 14:43:10.119894 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 14:43:10.119894 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 14:43:10.119894 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 14:43:10.119894 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 14:43:10.119894 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 14:43:10.119894 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application compat.raise_( Jun 16 14:43:10.119894 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 14:43:10.119894 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception Jun 16 14:43:10.119894 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 14:43:10.119894 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 14:43:10.119894 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 14:43:10.119894 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 14:43:10.119894 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 14:43:10.119894 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 14:43:10.120791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 14:43:10.120791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 14:43:10.120791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 16 14:43:10.120791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 16 14:43:10.120791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 14:43:10.120791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 14:43:10.120791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 14:43:10.120791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 14:43:10.120791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 14:43:10.120791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 14:43:10.120791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 14:43:10.120791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 14:43:10.120791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 14:43:10.120791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 14:43:10.120791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 14:43:10.120791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception Jun 16 14:43:10.121601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 14:43:10.121601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 14:43:10.121601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 14:43:10.121601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 14:43:10.121601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 14:43:10.121601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 14:43:10.121601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 14:43:10.121601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application conn.query(q) Jun 16 14:43:10.121601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 14:43:10.121601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 14:43:10.121601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 14:43:10.121601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application result.read() Jun 16 14:43:10.121601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 14:43:10.121601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 14:43:10.121601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 14:43:10.121601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 14:43:10.122764 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 14:43:10.122764 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 14:43:10.122764 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 14:43:10.122764 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 14:43:10.122764 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 14:43:10.122764 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 16 14:43:10.122764 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [parameters: {'id': 'db281d012c814ed79703a3d6bcc3ef9a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 16 14:43:10.122764 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 14:43:10.122764 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:10.122764 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:43:10.122764 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:10.122764 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:10.122764 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:10.122764 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:10.122764 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:10.122764 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:10.124413 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:10.124413 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:10.124413 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:10.124413 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:10.124413 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:10.124413 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:10.124413 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 16 14:43:10.124413 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 16 14:43:10.124413 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:10.124413 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:10.124413 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 16 14:43:10.124413 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 16 14:43:10.124413 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 14:43:10.124413 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 14:43:10.124413 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 16 14:43:10.124413 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:10.125249 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 231/478] 10.222.0.85 () {60 vars in 1131 bytes} [Thu Jun 16 14:43:09 2022] POST /identity/v3/roles => generated 144 bytes in 247 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:43:10.128010 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b9a6b-91d2-4a41-9465-cf8d923042a1 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:10.167337 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:10.283670 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b9a6b-91d2-4a41-9465-cf8d923042a1 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:10.324208 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628527b-f098-42ce-a877-cd6301c5281e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:10.325092 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628527b-f098-42ce-a877-cd6301c5281e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:10.325375 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628527b-f098-42ce-a877-cd6301c5281e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:10.325644 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628527b-f098-42ce-a877-cd6301c5281e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:10.340910 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628527b-f098-42ce-a877-cd6301c5281e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:10.349118 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-9628527b-f098-42ce-a877-cd6301c5281e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:43:10.349118 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:10.349118 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:10.349118 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:10.349118 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:10.349118 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:10.349118 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:10.349118 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:10.349118 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:10.349118 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:10.349118 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:10.349118 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:10.349118 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:10.349118 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:10.349118 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:10.349118 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:10.350032 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:10.350032 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:10.350032 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:10.350032 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:10.350032 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:10.350032 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:10.350032 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:10.350032 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:10.350032 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:10.350032 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:10.350032 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:10.350032 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:10.350032 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:10.350032 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:10.350032 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:10.350032 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:10.350808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:10.350808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:10.350808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:10.350808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:10.350808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:10.350808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:10.350808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:10.350808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:10.350808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:10.350808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:10.350808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:43:10.350808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:10.350808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 248/479] 10.222.0.85 () {56 vars in 1114 bytes} [Thu Jun 16 14:43:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:10.358485 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16ff48-11e2-43a9-babc-c3b0a4746881 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:10.474664 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16ff48-11e2-43a9-babc-c3b0a4746881 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:10.528336 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f7f82-e296-4640-8ccb-f630491ee711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:10.529965 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f7f82-e296-4640-8ccb-f630491ee711 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:10.530726 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f7f82-e296-4640-8ccb-f630491ee711 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:10.531466 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f7f82-e296-4640-8ccb-f630491ee711 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:10.533074 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f7f82-e296-4640-8ccb-f630491ee711 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:10.533633 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f7f82-e296-4640-8ccb-f630491ee711 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:10.535426 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f7f82-e296-4640-8ccb-f630491ee711 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:10.549416 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 232/480] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:11.926319 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fc7a4-72e5-4484-be40-18e646fc2ace None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:11.926820 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fc7a4-72e5-4484-be40-18e646fc2ace None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:11.926820 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fc7a4-72e5-4484-be40-18e646fc2ace None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:11.929059 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 249/481] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:11.935198 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cea431-747e-4f22-acde-e5574db609a9 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:11.936136 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cea431-747e-4f22-acde-e5574db609a9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:11.936685 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cea431-747e-4f22-acde-e5574db609a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:11.964490 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e2cea431-747e-4f22-acde-e5574db609a9 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:11.966244 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e2cea431-747e-4f22-acde-e5574db609a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:12.012781 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:12.071663 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 233/482] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:43:12.121518 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fc7a4-72e5-4484-be40-18e646fc2ace None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:12.258257 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:12.301741 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fc7a4-72e5-4484-be40-18e646fc2ace None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:12.356759 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa88342-7fc9-4f22-bef2-1064c963105c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:12.358222 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa88342-7fc9-4f22-bef2-1064c963105c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:12.358731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa88342-7fc9-4f22-bef2-1064c963105c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:12.359180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa88342-7fc9-4f22-bef2-1064c963105c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:12.383576 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa88342-7fc9-4f22-bef2-1064c963105c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:12.396272 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a35cd7-aee9-4e69-95fa-5d7ed547669e None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:12.396570 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a35cd7-aee9-4e69-95fa-5d7ed547669e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:12.396849 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a35cd7-aee9-4e69-95fa-5d7ed547669e None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:12.398577 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 234/483] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:12.398763 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-4aa88342-7fc9-4f22-bef2-1064c963105c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:12.398763 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:12.398763 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:12.398763 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:12.398763 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:12.398763 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:12.398763 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:12.398763 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:12.398763 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:12.398763 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:12.398763 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:12.398763 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:12.398763 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:12.398763 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:12.398763 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:12.398763 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:12.399591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:12.399591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:12.399591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:12.399591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:12.399591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:12.399591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:12.399591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:12.399591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:12.399591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:12.399591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:12.399591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:12.399591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:12.399591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:12.399591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:12.399591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:12.399591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:12.400465 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:12.400465 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:12.400465 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:12.400465 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:12.400465 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:12.400465 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:12.400465 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:12.400465 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:12.400465 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:12.400465 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:12.400465 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:12.400465 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:12.405487 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 250/484] 10.222.0.85 () {56 vars in 1102 bytes} [Thu Jun 16 14:43:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:12.409653 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a8a07-8d6f-4770-af76-64776a6365a7 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:12.409947 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a8a07-8d6f-4770-af76-64776a6365a7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:12.410225 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a8a07-8d6f-4770-af76-64776a6365a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:12.414972 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa88342-7fc9-4f22-bef2-1064c963105c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:12.432900 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-2b5a8a07-8d6f-4770-af76-64776a6365a7 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:12.435013 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2b5a8a07-8d6f-4770-af76-64776a6365a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:12.524154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 235/485] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:12.553839 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a8a07-8d6f-4770-af76-64776a6365a7 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:12.624620 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa88342-7fc9-4f22-bef2-1064c963105c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:12.665448 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d5de8-365d-4bc8-8416-3f32a063cbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:12.667019 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d5de8-365d-4bc8-8416-3f32a063cbb0 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:12.667543 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d5de8-365d-4bc8-8416-3f32a063cbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:12.668038 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d5de8-365d-4bc8-8416-3f32a063cbb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:12.669067 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d5de8-365d-4bc8-8416-3f32a063cbb0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:12.669639 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d5de8-365d-4bc8-8416-3f32a063cbb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:12.671266 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d5de8-365d-4bc8-8416-3f32a063cbb0 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:12.686616 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 251/486] 10.222.0.85 () {56 vars in 1103 bytes} [Thu Jun 16 14:43:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:12.688420 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb4a9f-5739-422e-88e2-3e300be7ac8c None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:12.688994 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb4a9f-5739-422e-88e2-3e300be7ac8c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:12.689461 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb4a9f-5739-422e-88e2-3e300be7ac8c None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:12.691246 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 252/487] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:12.692250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb4a9f-5739-422e-88e2-3e300be7ac8c None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:12.695486 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:12.705456 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:12.712603 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a8a07-8d6f-4770-af76-64776a6365a7 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:12.762875 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69701e54-5893-421a-8eba-2bcee15927ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:12.763702 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69701e54-5893-421a-8eba-2bcee15927ff None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:12.764012 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69701e54-5893-421a-8eba-2bcee15927ff None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:12.764287 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69701e54-5893-421a-8eba-2bcee15927ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:12.780510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69701e54-5893-421a-8eba-2bcee15927ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:12.789770 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-69701e54-5893-421a-8eba-2bcee15927ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:12.789770 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:12.789770 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:12.789770 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:12.789770 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:12.789770 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:12.789770 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:12.789770 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:12.789770 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:12.789770 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:12.789770 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:12.789770 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:12.789770 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:12.789770 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:12.789770 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:12.789770 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:12.791250 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:12.791250 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:12.791250 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:12.791250 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:12.791250 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:12.791250 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:12.791250 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:12.791250 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:12.791250 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:12.791250 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:12.791250 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:12.791250 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:12.791250 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:12.791250 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:12.791250 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:12.791250 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:12.793512 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:12.793512 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:12.793512 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:12.793512 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:12.793512 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:12.793512 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:12.793512 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:12.793512 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:12.793512 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:12.793512 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:12.793512 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:12.793512 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:12.793512 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 236/488] 10.222.0.85 () {56 vars in 1102 bytes} [Thu Jun 16 14:43:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:43:12.793512 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee8c73-e054-4705-b0ee-7c6c3eedf4c9 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:12.794566 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee8c73-e054-4705-b0ee-7c6c3eedf4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:12.794566 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee8c73-e054-4705-b0ee-7c6c3eedf4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:12.814718 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-28ee8c73-e054-4705-b0ee-7c6c3eedf4c9 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:12.816060 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-28ee8c73-e054-4705-b0ee-7c6c3eedf4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:12.842074 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb4a9f-5739-422e-88e2-3e300be7ac8c None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:12.886225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8f5ec-4cd0-4ae0-b86f-89b1c4af630f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:12.887043 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8f5ec-4cd0-4ae0-b86f-89b1c4af630f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:12.887335 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8f5ec-4cd0-4ae0-b86f-89b1c4af630f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:12.887691 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8f5ec-4cd0-4ae0-b86f-89b1c4af630f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:12.901207 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8f5ec-4cd0-4ae0-b86f-89b1c4af630f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:12.903406 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8f5ec-4cd0-4ae0-b86f-89b1c4af630f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:12.926241 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 237/489] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:12.927735 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-44b8f5ec-4cd0-4ae0-b86f-89b1c4af630f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:12.927735 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:12.927735 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:12.927735 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:12.927735 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:12.927735 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:12.927735 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:12.927735 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:12.927735 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:12.927735 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:12.927735 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:12.927735 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:12.927735 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:12.927735 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:12.927735 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:12.929766 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:12.929766 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:12.929766 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:12.929766 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:12.929766 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:12.929766 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:12.929766 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:12.929766 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:12.929766 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:12.929766 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:12.929766 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:12.929766 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:12.929766 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:12.929766 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:12.929766 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:12.929766 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:12.929766 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:12.931388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:12.931388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:12.931388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:12.931388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:12.933182 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee8c73-e054-4705-b0ee-7c6c3eedf4c9 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:12.933909 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 253/490] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:12.935256 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8f5ec-4cd0-4ae0-b86f-89b1c4af630f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:13.027689 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:13.060424 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:13.076274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee8c73-e054-4705-b0ee-7c6c3eedf4c9 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:13.092995 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8f5ec-4cd0-4ae0-b86f-89b1c4af630f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:13.116679 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef652cf-ed43-486e-8401-0b1c03a5ce8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:13.117430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef652cf-ed43-486e-8401-0b1c03a5ce8d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:13.117816 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef652cf-ed43-486e-8401-0b1c03a5ce8d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:13.118096 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef652cf-ed43-486e-8401-0b1c03a5ce8d None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:13.118886 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef652cf-ed43-486e-8401-0b1c03a5ce8d None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:13.119194 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef652cf-ed43-486e-8401-0b1c03a5ce8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:13.120748 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef652cf-ed43-486e-8401-0b1c03a5ce8d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:13.130195 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 238/491] 10.222.0.85 () {56 vars in 1103 bytes} [Thu Jun 16 14:43:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:13.130804 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef652cf-ed43-486e-8401-0b1c03a5ce8d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:13.139780 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627c566-92c0-4c89-9fce-75ddb8f76580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:13.140552 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627c566-92c0-4c89-9fce-75ddb8f76580 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:13.140833 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627c566-92c0-4c89-9fce-75ddb8f76580 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:13.141109 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627c566-92c0-4c89-9fce-75ddb8f76580 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:13.141840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627c566-92c0-4c89-9fce-75ddb8f76580 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:13.142144 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627c566-92c0-4c89-9fce-75ddb8f76580 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:13.143621 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627c566-92c0-4c89-9fce-75ddb8f76580 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:13.156847 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 254/492] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:13.158217 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f910551-f789-4b48-9776-ad02c49a5642 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:13.158524 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f910551-f789-4b48-9776-ad02c49a5642 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:13.158822 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f910551-f789-4b48-9776-ad02c49a5642 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:13.160353 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 255/493] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:13.164977 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f910551-f789-4b48-9776-ad02c49a5642 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:13.274842 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef652cf-ed43-486e-8401-0b1c03a5ce8d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:13.277683 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f910551-f789-4b48-9776-ad02c49a5642 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:13.294001 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:13.316473 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29254e4-4d40-4ac1-931d-305a4aa61c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:13.317606 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29254e4-4d40-4ac1-931d-305a4aa61c7b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:13.318035 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29254e4-4d40-4ac1-931d-305a4aa61c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:13.318499 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29254e4-4d40-4ac1-931d-305a4aa61c7b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:13.320864 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898e9ee-3b7c-4014-81b2-0497479676fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:13.321663 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898e9ee-3b7c-4014-81b2-0497479676fb None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:13.321928 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898e9ee-3b7c-4014-81b2-0497479676fb None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:13.322361 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898e9ee-3b7c-4014-81b2-0497479676fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:13.330185 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29254e4-4d40-4ac1-931d-305a4aa61c7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:13.333719 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898e9ee-3b7c-4014-81b2-0497479676fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:13.335203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898e9ee-3b7c-4014-81b2-0497479676fb None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:13.338652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-b29254e4-4d40-4ac1-931d-305a4aa61c7b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:13.338652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:13.338652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:13.338652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:13.338652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:13.338652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:13.338652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:13.338652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:13.338652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:13.338652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:13.338652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:13.338652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:13.338652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:13.338652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:13.338652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:13.338652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:13.339577 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:13.339577 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:13.339577 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:13.339577 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:13.339577 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:13.339577 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:13.339577 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:13.339577 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:13.339577 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:13.339577 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:13.339577 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:13.339577 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:13.339577 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:13.339577 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:13.339577 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:13.339577 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:13.341093 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:13.341093 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:13.341093 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:13.341093 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:13.341093 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:13.341093 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:13.341093 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:13.341093 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:13.341093 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:13.341093 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:13.341093 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:13.341093 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:13.341093 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 239/494] 10.222.0.85 () {56 vars in 1102 bytes} [Thu Jun 16 14:43:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:13.341093 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29254e4-4d40-4ac1-931d-305a4aa61c7b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:13.355059 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:13.355829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-4898e9ee-3b7c-4014-81b2-0497479676fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:13.355829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:13.355829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:13.355829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:13.355829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:13.355829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:13.355829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:13.355829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:13.355829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:13.355829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:13.355829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:13.355829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:13.355829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:13.355829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:13.355829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:13.356839 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:13.356839 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:13.356839 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:13.356839 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:13.356839 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:13.356839 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:13.356839 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:13.356839 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:13.356839 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:13.356839 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:13.356839 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:13.356839 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:13.356839 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:13.356839 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:13.356839 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:13.356839 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:13.356839 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:13.357825 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:13.357825 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:13.357825 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:13.357825 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:13.357825 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 256/495] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:13.358314 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f690709-3343-4997-96e4-6b62a9835401 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:13.358585 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f690709-3343-4997-96e4-6b62a9835401 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:13.358905 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f690709-3343-4997-96e4-6b62a9835401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:13.377734 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-1f690709-3343-4997-96e4-6b62a9835401 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:13.378928 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1f690709-3343-4997-96e4-6b62a9835401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:13.467903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 257/496] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:13.467903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f690709-3343-4997-96e4-6b62a9835401 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:13.485474 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29254e4-4d40-4ac1-931d-305a4aa61c7b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:13.530550 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28a63b-98c4-4672-bd4c-792c5ac7e7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:13.531593 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28a63b-98c4-4672-bd4c-792c5ac7e7fb None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:13.532049 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28a63b-98c4-4672-bd4c-792c5ac7e7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:13.532460 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28a63b-98c4-4672-bd4c-792c5ac7e7fb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:13.540845 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b28a63b-98c4-4672-bd4c-792c5ac7e7fb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:13.542682 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b28a63b-98c4-4672-bd4c-792c5ac7e7fb None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:13.559994 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-6b28a63b-98c4-4672-bd4c-792c5ac7e7fb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:43:13.559994 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:13.559994 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:13.559994 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:13.559994 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:13.559994 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:13.559994 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:13.559994 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:13.559994 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:13.559994 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:13.559994 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:13.559994 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:13.559994 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:43:13.559994 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:43:13.559994 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:43:13.559994 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:43:13.560973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:13.560973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:13.560973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:43:13.560973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:13.560973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:43:13.560973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:13.560973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:13.560973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:13.560973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:13.560973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:13.560973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:13.560973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:13.560973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:13.560973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:13.560973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:13.560973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:13.560973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:13.560973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:13.568049 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:13.568049 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:13.568049 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:43:13.568049 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:43:13.568049 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:43:13.568049 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:43:13.568049 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:43:13.568049 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:43:13.568049 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:43:13.568049 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:13.568049 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 240/497] 10.222.0.85 () {56 vars in 1093 bytes} [Thu Jun 16 14:43:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:13.568049 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28a63b-98c4-4672-bd4c-792c5ac7e7fb None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:13.588936 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:13.596478 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f690709-3343-4997-96e4-6b62a9835401 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:13.635471 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf054a-1973-404f-a538-83cc880e88a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:13.635471 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf054a-1973-404f-a538-83cc880e88a6 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:13.635968 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf054a-1973-404f-a538-83cc880e88a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:13.636146 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf054a-1973-404f-a538-83cc880e88a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:13.636868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf054a-1973-404f-a538-83cc880e88a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:13.637169 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf054a-1973-404f-a538-83cc880e88a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:13.638583 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf054a-1973-404f-a538-83cc880e88a6 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:13.646950 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 258/498] 10.222.0.85 () {56 vars in 1103 bytes} [Thu Jun 16 14:43:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:13.647749 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf054a-1973-404f-a538-83cc880e88a6 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:13.647918 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:13.696594 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28a63b-98c4-4672-bd4c-792c5ac7e7fb None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:13.741837 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23173c98-5ebd-4e6e-be4d-11face15adcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:13.742516 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23173c98-5ebd-4e6e-be4d-11face15adcf None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:13.742837 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23173c98-5ebd-4e6e-be4d-11face15adcf None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:13.743116 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23173c98-5ebd-4e6e-be4d-11face15adcf None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:13.743955 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23173c98-5ebd-4e6e-be4d-11face15adcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:13.744320 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23173c98-5ebd-4e6e-be4d-11face15adcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:13.745725 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23173c98-5ebd-4e6e-be4d-11face15adcf None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:13.761255 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 241/499] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:13.762330 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23173c98-5ebd-4e6e-be4d-11face15adcf None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:13.770791 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf054a-1973-404f-a538-83cc880e88a6 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:13.824113 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcfbe81-7610-40ab-ae82-dad5695a509c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:13.825207 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfbe81-7610-40ab-ae82-dad5695a509c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:13.825661 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfbe81-7610-40ab-ae82-dad5695a509c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:13.826106 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfbe81-7610-40ab-ae82-dad5695a509c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:13.842540 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcfbe81-7610-40ab-ae82-dad5695a509c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:13.855662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-abcfbe81-7610-40ab-ae82-dad5695a509c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:13.855662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:13.855662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:13.855662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:13.855662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:13.855662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:13.855662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:13.855662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:13.855662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:13.855662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:13.855662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:13.855662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:13.855662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:13.855662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:13.855662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:13.855662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:13.864165 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:13.864165 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:13.864165 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:13.864165 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:13.864165 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:13.864165 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:13.864165 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:13.864165 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:13.864165 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:13.864165 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:13.864165 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:13.864165 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:13.864165 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:13.864165 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:13.864165 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:13.864165 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:13.865801 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:13.865801 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:13.865801 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:13.865801 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:13.865801 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:13.865801 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:13.865801 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:13.865801 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:13.865801 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:13.865801 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:13.865801 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:13.865801 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:13.865801 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 259/500] 10.222.0.85 () {56 vars in 1102 bytes} [Thu Jun 16 14:43:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:13.865801 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5328e-521a-406c-8af9-859a70a5272d None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:13.867734 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5328e-521a-406c-8af9-859a70a5272d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:13.867734 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5328e-521a-406c-8af9-859a70a5272d None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:13.867734 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 260/501] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:13.867734 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5328e-521a-406c-8af9-859a70a5272d None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:13.884761 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:13.899712 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23173c98-5ebd-4e6e-be4d-11face15adcf None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:13.931779 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:13.938482 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328ef10-60a5-4563-bcd6-01bcb5ca1838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:13.939190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328ef10-60a5-4563-bcd6-01bcb5ca1838 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:13.939468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328ef10-60a5-4563-bcd6-01bcb5ca1838 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:13.939746 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328ef10-60a5-4563-bcd6-01bcb5ca1838 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:13.940683 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328ef10-60a5-4563-bcd6-01bcb5ca1838 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:13.940990 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328ef10-60a5-4563-bcd6-01bcb5ca1838 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:13.942437 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328ef10-60a5-4563-bcd6-01bcb5ca1838 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:13.970568 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5328e-521a-406c-8af9-859a70a5272d None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:13.982364 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 242/502] 10.222.0.85 () {56 vars in 1133 bytes} [Thu Jun 16 14:43:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:13.983240 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328ef10-60a5-4563-bcd6-01bcb5ca1838 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:14.015445 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1907e-1f0b-46f8-971b-97b43d0a8057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:14.017493 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1907e-1f0b-46f8-971b-97b43d0a8057 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:14.017493 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1907e-1f0b-46f8-971b-97b43d0a8057 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:14.017493 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1907e-1f0b-46f8-971b-97b43d0a8057 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:14.028290 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e1907e-1f0b-46f8-971b-97b43d0a8057 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:14.029807 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e1907e-1f0b-46f8-971b-97b43d0a8057 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:14.048042 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-b1e1907e-1f0b-46f8-971b-97b43d0a8057 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:14.048042 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:14.048042 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:14.048042 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:14.048042 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:14.048042 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:14.048042 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:14.048042 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:14.048042 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:14.048042 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:14.048042 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:14.048042 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:14.048042 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:14.048042 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:14.048042 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:14.048998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:14.048998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:14.048998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:14.048998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:14.048998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:14.048998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:14.048998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:14.048998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:14.048998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:14.048998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:14.048998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:14.048998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:14.048998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:14.048998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:14.048998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:14.048998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:14.048998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:14.049824 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:14.049824 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:14.049824 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:14.049824 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:14.049824 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 261/503] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:14.051896 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1907e-1f0b-46f8-971b-97b43d0a8057 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:14.093946 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328ef10-60a5-4563-bcd6-01bcb5ca1838 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:14.121381 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:14.128820 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087ccf0-cebe-4931-80c8-798676fcb5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:14.129627 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087ccf0-cebe-4931-80c8-798676fcb5cc None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:14.129898 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087ccf0-cebe-4931-80c8-798676fcb5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:14.130163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087ccf0-cebe-4931-80c8-798676fcb5cc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:14.137592 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e087ccf0-cebe-4931-80c8-798676fcb5cc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:14.139089 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e087ccf0-cebe-4931-80c8-798676fcb5cc None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:14.154200 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-e087ccf0-cebe-4931-80c8-798676fcb5cc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 14:43:14.154200 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:14.154200 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:14.154200 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:14.154200 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:14.154200 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:14.154200 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:14.154200 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:14.154200 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:14.154200 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:14.154200 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:14.154200 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:14.154200 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:43:14.154200 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:43:14.154200 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:43:14.154200 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:43:14.155262 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:14.155262 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:14.155262 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:43:14.155262 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:14.155262 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:43:14.155262 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:14.155262 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:14.155262 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:14.155262 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:14.155262 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:14.155262 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:14.155262 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:14.155262 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:14.155262 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:14.155262 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:14.155262 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:14.155262 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:14.155262 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:14.156194 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:14.156194 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:14.156194 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:43:14.156194 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:43:14.156194 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:43:14.156194 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:43:14.156194 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:43:14.156194 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:43:14.156194 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 14:43:14.156194 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:14.156194 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 243/504] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:14.156741 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1907e-1f0b-46f8-971b-97b43d0a8057 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:14.156818 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822cc24-f7b5-4803-b8f9-04a327f6c75b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:14.157295 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822cc24-f7b5-4803-b8f9-04a327f6c75b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:14.157295 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822cc24-f7b5-4803-b8f9-04a327f6c75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:14.174761 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1822cc24-f7b5-4803-b8f9-04a327f6c75b None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:14.176017 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1822cc24-f7b5-4803-b8f9-04a327f6c75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:14.196269 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6a8e1-2025-4efe-94cc-15a5c037cb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:14.197007 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6a8e1-2025-4efe-94cc-15a5c037cb8c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:14.197282 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6a8e1-2025-4efe-94cc-15a5c037cb8c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:14.197551 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6a8e1-2025-4efe-94cc-15a5c037cb8c None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:14.198332 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b6a8e1-2025-4efe-94cc-15a5c037cb8c None admin] RBAC: Adding query filter params (name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:14.198731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b6a8e1-2025-4efe-94cc-15a5c037cb8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:14.200421 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b6a8e1-2025-4efe-94cc-15a5c037cb8c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:14.215461 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 262/505] 10.222.0.85 () {56 vars in 1103 bytes} [Thu Jun 16 14:43:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:14.217140 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6a8e1-2025-4efe-94cc-15a5c037cb8c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:14.229329 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:14.266877 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 244/506] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:14.266877 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1822cc24-f7b5-4803-b8f9-04a327f6c75b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:14.352557 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6a8e1-2025-4efe-94cc-15a5c037cb8c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:14.382765 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:14.386589 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1822cc24-f7b5-4803-b8f9-04a327f6c75b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:14.390350 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804abb4-8e0a-4632-a263-68f7f2720174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:14.391013 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804abb4-8e0a-4632-a263-68f7f2720174 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:14.391294 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804abb4-8e0a-4632-a263-68f7f2720174 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:14.391568 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804abb4-8e0a-4632-a263-68f7f2720174 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:14.423596 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac18492-7d5f-4616-871b-490bc12d0dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:14.424431 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac18492-7d5f-4616-871b-490bc12d0dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:14.424763 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac18492-7d5f-4616-871b-490bc12d0dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:14.425094 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac18492-7d5f-4616-871b-490bc12d0dc9 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:14.425972 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac18492-7d5f-4616-871b-490bc12d0dc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:14.426418 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac18492-7d5f-4616-871b-490bc12d0dc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:14.428292 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac18492-7d5f-4616-871b-490bc12d0dc9 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:14.440402 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 245/507] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:14.441246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac18492-7d5f-4616-871b-490bc12d0dc9 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:14.468591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f804abb4-8e0a-4632-a263-68f7f2720174 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:14.470094 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f804abb4-8e0a-4632-a263-68f7f2720174 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:14.487822 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:14.549894 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac18492-7d5f-4616-871b-490bc12d0dc9 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:14.581316 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 263/508] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:14.582179 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804abb4-8e0a-4632-a263-68f7f2720174 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:14.589164 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab5d07-a426-4c76-b19d-070197cb035b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:14.589848 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab5d07-a426-4c76-b19d-070197cb035b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:14.590127 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab5d07-a426-4c76-b19d-070197cb035b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:14.590402 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab5d07-a426-4c76-b19d-070197cb035b None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:14.591236 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab5d07-a426-4c76-b19d-070197cb035b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:14.591533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab5d07-a426-4c76-b19d-070197cb035b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:14.593030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab5d07-a426-4c76-b19d-070197cb035b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:14.610496 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 246/509] 10.222.0.85 () {56 vars in 1137 bytes} [Thu Jun 16 14:43:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:14.611315 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab5d07-a426-4c76-b19d-070197cb035b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:14.617031 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:14.684565 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804abb4-8e0a-4632-a263-68f7f2720174 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:14.708725 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:14.715094 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab5d07-a426-4c76-b19d-070197cb035b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:14.718094 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1cad2d-f16f-48a4-9c57-02c6f1c288c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:14.718890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cad2d-f16f-48a4-9c57-02c6f1c288c8 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:14.719165 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cad2d-f16f-48a4-9c57-02c6f1c288c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:14.719435 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cad2d-f16f-48a4-9c57-02c6f1c288c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:14.729377 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1cad2d-f16f-48a4-9c57-02c6f1c288c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:14.730824 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1cad2d-f16f-48a4-9c57-02c6f1c288c8 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:14.748290 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6d9bd-caf1-4daa-89cc-e1d25e91e84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:14.748458 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-0f1cad2d-f16f-48a4-9c57-02c6f1c288c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:14.748458 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:14.748458 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:14.748458 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:14.748458 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:14.748458 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:14.748458 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:14.748458 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:14.748458 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:14.748458 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:14.748458 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:14.748458 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:14.748458 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:14.748458 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:14.748458 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:14.749429 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:14.749429 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:14.749429 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:14.749429 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:14.749429 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:14.749429 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:14.749429 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:14.749429 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:14.749429 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:14.749429 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:14.749429 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:14.749429 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:14.749429 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:14.749429 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:14.749429 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:14.749429 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:14.749429 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:14.750273 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:14.750273 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:14.750273 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:14.750273 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:14.750490 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6d9bd-caf1-4daa-89cc-e1d25e91e84d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:14.750490 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6d9bd-caf1-4daa-89cc-e1d25e91e84d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:14.750605 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 264/510] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:14.750666 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6d9bd-caf1-4daa-89cc-e1d25e91e84d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:14.750742 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1cad2d-f16f-48a4-9c57-02c6f1c288c8 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:14.761259 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b6d9bd-caf1-4daa-89cc-e1d25e91e84d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:14.762757 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b6d9bd-caf1-4daa-89cc-e1d25e91e84d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:14.780294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-62b6d9bd-caf1-4daa-89cc-e1d25e91e84d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:14.780294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:14.780294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:14.780294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:14.780294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:14.780294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:14.780294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:14.780294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:14.780294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:14.780294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:14.780294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:14.780294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:14.780294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:14.780294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:14.780294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:14.781190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:14.781190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:14.781190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:14.781190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:14.781190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:14.781190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:14.781190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:14.781190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:14.781190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:14.781190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:14.781190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:14.781190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:14.781190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:14.781190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:14.781190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:14.781190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:14.781190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:14.782015 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:14.782015 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:14.782015 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:14.782015 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:14.782015 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 247/511] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:14.782281 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6d9bd-caf1-4daa-89cc-e1d25e91e84d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:14.842752 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:14.858825 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1cad2d-f16f-48a4-9c57-02c6f1c288c8 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:14.882223 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6d9bd-caf1-4daa-89cc-e1d25e91e84d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:14.892727 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655a839-6669-4ed9-92c7-f3e228c6d842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:14.893520 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655a839-6669-4ed9-92c7-f3e228c6d842 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:14.893800 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655a839-6669-4ed9-92c7-f3e228c6d842 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:14.894073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655a839-6669-4ed9-92c7-f3e228c6d842 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:14.901277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c655a839-6669-4ed9-92c7-f3e228c6d842 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:14.902741 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c655a839-6669-4ed9-92c7-f3e228c6d842 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:14.918579 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-c655a839-6669-4ed9-92c7-f3e228c6d842 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 14:43:14.918579 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:14.918579 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:14.918579 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:14.918579 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:14.918579 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:14.918579 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:14.918579 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:14.918579 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:14.918579 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:14.918579 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:14.918579 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:14.918579 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:43:14.918579 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:43:14.918579 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:43:14.918579 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:43:14.921231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:14.921231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:14.921231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:43:14.921231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:14.921231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:43:14.921231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:14.921231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:14.921231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:14.921231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:14.921231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:14.921231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:14.921231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:14.921231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:14.921231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:14.921231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:14.921231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:14.921231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:14.921231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:14.923936 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:14.923936 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:14.923936 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:43:14.923936 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:43:14.923936 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:43:14.923936 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:43:14.923936 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:43:14.923936 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:43:14.923936 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 14:43:14.923936 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:14.925557 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0bdaa-c591-47cf-9e16-a6ca8ce95740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:14.925557 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0bdaa-c591-47cf-9e16-a6ca8ce95740 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:14.925557 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0bdaa-c591-47cf-9e16-a6ca8ce95740 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:14.925933 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 265/512] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:14.926042 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0bdaa-c591-47cf-9e16-a6ca8ce95740 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:14.926257 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655a839-6669-4ed9-92c7-f3e228c6d842 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:14.936754 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0bdaa-c591-47cf-9e16-a6ca8ce95740 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:14.938256 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0bdaa-c591-47cf-9e16-a6ca8ce95740 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:14.947625 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:14.958043 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-38d0bdaa-c591-47cf-9e16-a6ca8ce95740 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:14.958043 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:14.958043 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:14.958043 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:14.958043 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:14.958043 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:14.958043 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:14.958043 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:14.958043 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:14.958043 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:14.958043 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:14.958043 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:14.958043 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:14.958043 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:14.958043 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:14.958903 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:14.958903 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:14.958903 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:14.958903 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:14.958903 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:14.958903 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:14.958903 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:14.958903 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:14.958903 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:14.958903 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:14.958903 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:14.958903 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:14.958903 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:14.958903 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:14.958903 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:14.958903 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:14.958903 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:14.965874 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:14.965874 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:14.965874 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:14.965874 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:14.965874 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 248/513] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:14.965874 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0bdaa-c591-47cf-9e16-a6ca8ce95740 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:15.032107 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655a839-6669-4ed9-92c7-f3e228c6d842 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:15.063385 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0bdaa-c591-47cf-9e16-a6ca8ce95740 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:15.068312 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77283989-528e-4597-a4c4-96af0fd5c0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:15.068993 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77283989-528e-4597-a4c4-96af0fd5c0cc None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:15.069277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77283989-528e-4597-a4c4-96af0fd5c0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:15.069578 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77283989-528e-4597-a4c4-96af0fd5c0cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:15.086174 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:15.098771 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebccd192-27ad-4b47-85bf-2c9ada39c0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:15.099399 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccd192-27ad-4b47-85bf-2c9ada39c0b6 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:15.099652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccd192-27ad-4b47-85bf-2c9ada39c0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:15.100008 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccd192-27ad-4b47-85bf-2c9ada39c0b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:15.100668 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebccd192-27ad-4b47-85bf-2c9ada39c0b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:15.100966 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebccd192-27ad-4b47-85bf-2c9ada39c0b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:15.102380 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebccd192-27ad-4b47-85bf-2c9ada39c0b6 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:15.115803 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 249/514] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:15.117176 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebccd192-27ad-4b47-85bf-2c9ada39c0b6 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:15.143687 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77283989-528e-4597-a4c4-96af0fd5c0cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:15.145129 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77283989-528e-4597-a4c4-96af0fd5c0cc None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:15.184413 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:15.230100 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebccd192-27ad-4b47-85bf-2c9ada39c0b6 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:15.249839 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 266/515] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:15.250711 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77283989-528e-4597-a4c4-96af0fd5c0cc None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:15.269070 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a042e6-8145-47a5-b83f-60a9bf7581df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:15.269742 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a042e6-8145-47a5-b83f-60a9bf7581df None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:15.270019 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a042e6-8145-47a5-b83f-60a9bf7581df None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:15.270295 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a042e6-8145-47a5-b83f-60a9bf7581df None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:15.271012 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a042e6-8145-47a5-b83f-60a9bf7581df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:15.271316 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a042e6-8145-47a5-b83f-60a9bf7581df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:15.272727 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a042e6-8145-47a5-b83f-60a9bf7581df None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:15.284696 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 250/516] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:15.285517 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a042e6-8145-47a5-b83f-60a9bf7581df None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:15.303128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:15.365219 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77283989-528e-4597-a4c4-96af0fd5c0cc None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:15.394554 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a042e6-8145-47a5-b83f-60a9bf7581df None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:15.400096 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef06312-e1cf-4d39-aa05-c79333a38616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:15.401350 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef06312-e1cf-4d39-aa05-c79333a38616 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:15.401616 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef06312-e1cf-4d39-aa05-c79333a38616 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:15.401911 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef06312-e1cf-4d39-aa05-c79333a38616 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:15.402716 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef06312-e1cf-4d39-aa05-c79333a38616 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:15.403026 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef06312-e1cf-4d39-aa05-c79333a38616 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:15.404511 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef06312-e1cf-4d39-aa05-c79333a38616 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:15.415088 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:15.430765 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc00e0-00fc-4a44-8229-69cea751bf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:15.431506 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc00e0-00fc-4a44-8229-69cea751bf6c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:15.432307 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc00e0-00fc-4a44-8229-69cea751bf6c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:15.432307 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc00e0-00fc-4a44-8229-69cea751bf6c None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:15.434540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc00e0-00fc-4a44-8229-69cea751bf6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:15.434540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc00e0-00fc-4a44-8229-69cea751bf6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:15.434540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc00e0-00fc-4a44-8229-69cea751bf6c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:15.442420 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 267/517] 10.222.0.85 () {56 vars in 1137 bytes} [Thu Jun 16 14:43:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:15.443261 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef06312-e1cf-4d39-aa05-c79333a38616 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:15.451480 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 251/518] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:15.452569 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc00e0-00fc-4a44-8229-69cea751bf6c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:15.546268 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef06312-e1cf-4d39-aa05-c79333a38616 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:15.548147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:15.554962 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc00e0-00fc-4a44-8229-69cea751bf6c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:15.584440 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0cc3e-b8c0-4836-a003-3620eefa172c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:15.585252 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0cc3e-b8c0-4836-a003-3620eefa172c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:15.585534 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0cc3e-b8c0-4836-a003-3620eefa172c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:15.585808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0cc3e-b8c0-4836-a003-3620eefa172c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:15.589053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3180b-3a99-4ebb-bfe0-420f24efbe42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:15.589889 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3180b-3a99-4ebb-bfe0-420f24efbe42 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:15.590180 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3180b-3a99-4ebb-bfe0-420f24efbe42 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:15.590454 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3180b-3a99-4ebb-bfe0-420f24efbe42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:15.593251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0cc3e-b8c0-4836-a003-3620eefa172c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:15.594521 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0cc3e-b8c0-4836-a003-3620eefa172c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:15.601202 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3180b-3a99-4ebb-bfe0-420f24efbe42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:15.602630 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3180b-3a99-4ebb-bfe0-420f24efbe42 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:15.609068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-e9a0cc3e-b8c0-4836-a003-3620eefa172c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 14:43:15.609068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:15.609068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:15.609068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:15.609068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:15.609068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:15.609068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:15.609068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:15.609068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:15.609068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:15.609068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:15.609068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:15.609068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:43:15.609068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:43:15.609068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:43:15.609068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:43:15.609988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:15.609988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:15.609988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:43:15.609988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:15.609988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:43:15.609988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:15.609988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:15.609988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:15.609988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:15.609988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:15.609988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:15.609988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:15.609988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:15.609988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:15.609988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:15.609988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:15.609988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:15.609988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:15.610879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:15.610879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:15.610879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:43:15.610879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:43:15.610879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:43:15.610879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:43:15.610879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:43:15.610879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:43:15.610879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 14:43:15.610879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:15.610879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 268/519] 10.222.0.85 () {56 vars in 1102 bytes} [Thu Jun 16 14:43:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:15.611522 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0cc3e-b8c0-4836-a003-3620eefa172c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:15.624707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-85d3180b-3a99-4ebb-bfe0-420f24efbe42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:15.624707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:15.624707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:15.624707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:15.624707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:15.624707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:15.624707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:15.624707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:15.624707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:15.624707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:15.624707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:15.624707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:15.624707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:15.624707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:15.624707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:15.625743 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:15.625743 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:15.625743 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:15.625743 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:15.625743 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:15.625743 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:15.625743 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:15.625743 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:15.625743 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:15.625743 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:15.625743 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:15.625743 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:15.625743 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:15.625743 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:15.625743 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:15.625743 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:15.625743 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:15.626790 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:15.626790 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:15.626790 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:15.626790 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:15.626790 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 252/520] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:15.626790 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3180b-3a99-4ebb-bfe0-420f24efbe42 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:15.657366 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:15.724901 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0cc3e-b8c0-4836-a003-3620eefa172c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:15.741980 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3180b-3a99-4ebb-bfe0-420f24efbe42 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:15.762350 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad5186-8d34-40d8-96ef-04768f13cea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:15.763028 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad5186-8d34-40d8-96ef-04768f13cea6 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:15.763306 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad5186-8d34-40d8-96ef-04768f13cea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:15.763579 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad5186-8d34-40d8-96ef-04768f13cea6 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:15.764329 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad5186-8d34-40d8-96ef-04768f13cea6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:15.765801 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad5186-8d34-40d8-96ef-04768f13cea6 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:15.782883 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ef1ba-81ac-4c58-b144-8d25a41a43a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:15.783536 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ef1ba-81ac-4c58-b144-8d25a41a43a7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:15.783823 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ef1ba-81ac-4c58-b144-8d25a41a43a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:15.784127 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ef1ba-81ac-4c58-b144-8d25a41a43a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:15.785562 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 269/521] 10.222.0.85 () {60 vars in 1132 bytes} [Thu Jun 16 14:43:15 2022] POST /identity/v3/users => generated 247 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:43:15.786361 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad5186-8d34-40d8-96ef-04768f13cea6 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:15.819131 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:15.868204 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ef1ba-81ac-4c58-b144-8d25a41a43a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:15.869863 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ef1ba-81ac-4c58-b144-8d25a41a43a7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:15.906116 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:15.911434 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad5186-8d34-40d8-96ef-04768f13cea6 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:15.952304 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be137aa0-2464-4c4d-9f3a-a3771737a9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:15.953117 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be137aa0-2464-4c4d-9f3a-a3771737a9b5 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:15.953399 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be137aa0-2464-4c4d-9f3a-a3771737a9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:15.953666 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be137aa0-2464-4c4d-9f3a-a3771737a9b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:15.961286 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be137aa0-2464-4c4d-9f3a-a3771737a9b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:15.962807 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be137aa0-2464-4c4d-9f3a-a3771737a9b5 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:15.978727 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-be137aa0-2464-4c4d-9f3a-a3771737a9b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:15.978727 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:15.978727 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:15.978727 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:15.978727 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:15.978727 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:15.978727 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:15.978727 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:15.978727 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:15.978727 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:15.978727 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:15.978727 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:15.978727 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:43:15.978727 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:43:15.978727 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:43:15.979838 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:43:15.979838 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:15.979838 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:15.979838 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:15.979838 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:15.979838 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:15.979838 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:15.979838 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:15.979838 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:15.979838 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:15.979838 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:15.979838 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:15.979838 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:15.979838 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:15.979838 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:15.979838 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:15.979838 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:15.980769 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:43:15.980769 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:43:15.980769 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:43:15.980769 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:43:15.980769 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:43:15.980769 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:43:15.980769 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:15.980769 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:15.980769 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 270/522] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:15.982458 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be137aa0-2464-4c4d-9f3a-a3771737a9b5 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:15.997820 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 253/523] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:15.998704 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ef1ba-81ac-4c58-b144-8d25a41a43a7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:16.071376 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:16.094671 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be137aa0-2464-4c4d-9f3a-a3771737a9b5 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:16.124158 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ef1ba-81ac-4c58-b144-8d25a41a43a7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:16.132078 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3bf9a-71b1-448d-9d75-a4c2ad6d8012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:16.132943 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3bf9a-71b1-448d-9d75-a4c2ad6d8012 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:16.133476 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3bf9a-71b1-448d-9d75-a4c2ad6d8012 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:16.133955 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3bf9a-71b1-448d-9d75-a4c2ad6d8012 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:16.135146 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3bf9a-71b1-448d-9d75-a4c2ad6d8012 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:16.137450 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3bf9a-71b1-448d-9d75-a4c2ad6d8012 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:16.137450 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3bf9a-71b1-448d-9d75-a4c2ad6d8012 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:16.156932 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:16.157950 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 271/524] 10.222.0.85 () {56 vars in 1139 bytes} [Thu Jun 16 14:43:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:16.158767 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3bf9a-71b1-448d-9d75-a4c2ad6d8012 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:16.166675 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23234469-7960-4eab-9bba-9a022b6ac90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:16.167285 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23234469-7960-4eab-9bba-9a022b6ac90b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:16.167564 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23234469-7960-4eab-9bba-9a022b6ac90b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:16.167839 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23234469-7960-4eab-9bba-9a022b6ac90b None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:16.168599 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23234469-7960-4eab-9bba-9a022b6ac90b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:16.168906 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23234469-7960-4eab-9bba-9a022b6ac90b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:16.170305 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23234469-7960-4eab-9bba-9a022b6ac90b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:16.183011 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 254/525] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:16.183840 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23234469-7960-4eab-9bba-9a022b6ac90b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:16.269023 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3bf9a-71b1-448d-9d75-a4c2ad6d8012 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:16.286290 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23234469-7960-4eab-9bba-9a022b6ac90b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:16.309037 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ca4dc-b9c6-4a4e-bc2e-b55d6bc02060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:16.310142 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ca4dc-b9c6-4a4e-bc2e-b55d6bc02060 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:16.310738 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ca4dc-b9c6-4a4e-bc2e-b55d6bc02060 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:16.311157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ca4dc-b9c6-4a4e-bc2e-b55d6bc02060 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:16.312252 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ca4dc-b9c6-4a4e-bc2e-b55d6bc02060 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:16.312704 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ca4dc-b9c6-4a4e-bc2e-b55d6bc02060 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:16.314390 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ca4dc-b9c6-4a4e-bc2e-b55d6bc02060 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:16.318878 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:16.321029 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72437be7-45d1-472e-8f4f-7faedbb43315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:16.321178 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72437be7-45d1-472e-8f4f-7faedbb43315 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:16.321459 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72437be7-45d1-472e-8f4f-7faedbb43315 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:16.321678 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72437be7-45d1-472e-8f4f-7faedbb43315 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:16.334615 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72437be7-45d1-472e-8f4f-7faedbb43315 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:16.340722 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 272/526] 10.222.0.85 () {56 vars in 1148 bytes} [Thu Jun 16 14:43:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:16.340849 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72437be7-45d1-472e-8f4f-7faedbb43315 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:16.340924 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ca4dc-b9c6-4a4e-bc2e-b55d6bc02060 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:16.360347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-72437be7-45d1-472e-8f4f-7faedbb43315 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:16.360347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:16.360347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:16.360347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:16.360347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:16.360347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:16.360347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:16.360347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:16.360347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:16.360347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:16.360347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:16.360347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:16.360347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:16.360347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:16.360347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:16.361276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:16.361276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:16.361276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:16.361276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:16.361276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:16.361276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:16.361276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:16.361276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:16.361276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:16.361276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:16.361276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:16.361276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:16.361276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:16.361276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:16.361276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:16.361276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:16.361276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:16.366883 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:16.366883 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:16.366883 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:16.366883 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:16.366883 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 255/527] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:16.366883 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72437be7-45d1-472e-8f4f-7faedbb43315 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:16.410451 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:16.464832 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ca4dc-b9c6-4a4e-bc2e-b55d6bc02060 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:16.481903 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72437be7-45d1-472e-8f4f-7faedbb43315 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:16.502636 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54e53a-3f79-4e33-8725-25f925e810a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:16.503295 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54e53a-3f79-4e33-8725-25f925e810a5 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:16.503584 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54e53a-3f79-4e33-8725-25f925e810a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:16.503862 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54e53a-3f79-4e33-8725-25f925e810a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:16.529099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1b6f4-6f12-4995-8f93-14168bfb3788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:16.530325 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1b6f4-6f12-4995-8f93-14168bfb3788 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:16.530741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1b6f4-6f12-4995-8f93-14168bfb3788 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:16.531291 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1b6f4-6f12-4995-8f93-14168bfb3788 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:16.540333 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1b6f4-6f12-4995-8f93-14168bfb3788 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:16.542309 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1b6f4-6f12-4995-8f93-14168bfb3788 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:16.560538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-c3f1b6f4-6f12-4995-8f93-14168bfb3788 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:16.560538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:16.560538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:16.560538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:16.560538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:16.560538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:16.560538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:16.560538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:16.560538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:16.560538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:16.560538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:16.560538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:16.560538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:43:16.560538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:43:16.560538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:43:16.561486 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:43:16.561486 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:16.561486 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:16.561486 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:16.561486 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:16.561486 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:16.561486 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:16.561486 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:16.561486 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:16.561486 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:16.561486 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:16.561486 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:16.561486 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:16.561486 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:16.561486 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:16.561486 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:16.561486 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:16.562334 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:43:16.562334 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:43:16.562334 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:43:16.562334 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:43:16.562334 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:43:16.562334 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:43:16.562334 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:16.562334 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:16.562334 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 256/528] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:16.562789 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1b6f4-6f12-4995-8f93-14168bfb3788 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:16.583809 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:16.594775 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54e53a-3f79-4e33-8725-25f925e810a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:16.596346 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54e53a-3f79-4e33-8725-25f925e810a5 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:16.682225 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1b6f4-6f12-4995-8f93-14168bfb3788 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:16.685778 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:16.707612 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 273/529] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:16.708337 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54e53a-3f79-4e33-8725-25f925e810a5 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:16.723580 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f4b40-c7a9-4498-849b-084e989acb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:16.724222 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f4b40-c7a9-4498-849b-084e989acb71 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:16.724504 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f4b40-c7a9-4498-849b-084e989acb71 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:16.724778 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f4b40-c7a9-4498-849b-084e989acb71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:16.725620 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f4b40-c7a9-4498-849b-084e989acb71 None admin] RBAC: Adding query filter params (role.id=17fa92022f834aa5bf5cb9e3a506a478, scope.project.id=80e309a3b3784ba9943734a41949b222, user.id=c74e4d1bdaa64ed280cc5f4c8e79b842) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:16.725937 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f4b40-c7a9-4498-849b-084e989acb71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:16.727401 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f4b40-c7a9-4498-849b-084e989acb71 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:16.733425 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 257/530] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:16 2022] GET /identity/v3/role_assignments?user.id=c74e4d1bdaa64ed280cc5f4c8e79b842&scope.project.id=80e309a3b3784ba9943734a41949b222&role.id=17fa92022f834aa5bf5cb9e3a506a478 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:16.741510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f4b40-c7a9-4498-849b-084e989acb71 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:16.816161 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:16.824412 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54e53a-3f79-4e33-8725-25f925e810a5 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:16.866455 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8358b-5379-4955-98ac-3e338fcf8448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:16.867047 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8358b-5379-4955-98ac-3e338fcf8448 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:16.867422 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8358b-5379-4955-98ac-3e338fcf8448 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:16.867774 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8358b-5379-4955-98ac-3e338fcf8448 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:16.868691 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8358b-5379-4955-98ac-3e338fcf8448 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:16.869324 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8358b-5379-4955-98ac-3e338fcf8448 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:16.870840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8358b-5379-4955-98ac-3e338fcf8448 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:16.884636 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 274/531] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:16.885579 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8358b-5379-4955-98ac-3e338fcf8448 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:16.897339 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f4b40-c7a9-4498-849b-084e989acb71 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:16.936806 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1c6af-efe6-4993-9cdd-3d60e97697e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:16.937501 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1c6af-efe6-4993-9cdd-3d60e97697e0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:16.937784 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1c6af-efe6-4993-9cdd-3d60e97697e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:16.938065 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1c6af-efe6-4993-9cdd-3d60e97697e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:16.938892 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1c6af-efe6-4993-9cdd-3d60e97697e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:16.939201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1c6af-efe6-4993-9cdd-3d60e97697e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:16.940721 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1c6af-efe6-4993-9cdd-3d60e97697e0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:16.966262 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 258/532] 10.222.0.85 () {56 vars in 1148 bytes} [Thu Jun 16 14:43:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:16.967213 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1c6af-efe6-4993-9cdd-3d60e97697e0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:17.005451 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:17.028437 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8358b-5379-4955-98ac-3e338fcf8448 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:17.074950 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980dd1a-8cae-40c0-a317-85967782f1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:17.076779 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980dd1a-8cae-40c0-a317-85967782f1ac None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:17.077166 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980dd1a-8cae-40c0-a317-85967782f1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:17.077542 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980dd1a-8cae-40c0-a317-85967782f1ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:17.089682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980dd1a-8cae-40c0-a317-85967782f1ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:17.091304 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980dd1a-8cae-40c0-a317-85967782f1ac None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:17.091675 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1c6af-efe6-4993-9cdd-3d60e97697e0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:17.109130 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-8980dd1a-8cae-40c0-a317-85967782f1ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:17.109130 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:17.109130 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:17.109130 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:17.109130 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:17.109130 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:17.109130 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:17.109130 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:17.109130 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:17.109130 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:17.109130 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:17.109130 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:17.109130 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:17.109130 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:17.109130 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:17.110220 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:17.110220 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:17.110220 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:17.110220 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:17.110220 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:17.110220 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:17.110220 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:17.110220 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:17.110220 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:17.110220 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:17.110220 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:17.110220 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:17.110220 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:17.110220 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:17.110220 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:17.110220 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:17.110220 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:17.111283 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:17.111283 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:17.111283 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:17.111283 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:17.117220 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 275/533] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:17.118179 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980dd1a-8cae-40c0-a317-85967782f1ac None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:17.130066 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:17.139175 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a89f2b-6f5a-47e4-89f8-f45a0634cc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:17.140961 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a89f2b-6f5a-47e4-89f8-f45a0634cc1f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:17.141388 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a89f2b-6f5a-47e4-89f8-f45a0634cc1f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:17.141824 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a89f2b-6f5a-47e4-89f8-f45a0634cc1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:17.152654 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a89f2b-6f5a-47e4-89f8-f45a0634cc1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:17.155018 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a89f2b-6f5a-47e4-89f8-f45a0634cc1f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:17.174374 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-b9a89f2b-6f5a-47e4-89f8-f45a0634cc1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:17.174374 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:17.174374 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:17.174374 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:17.174374 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:17.174374 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:17.174374 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:17.174374 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:17.174374 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:17.174374 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:17.174374 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:17.174374 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:17.174374 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:43:17.174374 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:43:17.174374 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:43:17.175446 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:43:17.175446 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:17.175446 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:17.175446 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:17.175446 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:17.175446 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:17.175446 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:17.175446 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:17.175446 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:17.175446 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:17.175446 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:17.175446 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:17.175446 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:17.175446 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:17.175446 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:17.175446 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:17.175446 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:17.176540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:43:17.176540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:43:17.176540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:43:17.176540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:43:17.176540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:43:17.176540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:43:17.176540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:17.176540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:17.178641 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 259/534] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:17.179561 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a89f2b-6f5a-47e4-89f8-f45a0634cc1f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:17.234544 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980dd1a-8cae-40c0-a317-85967782f1ac None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:17.270746 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34a45f-0fcc-4dd7-a51a-22cc5c0e0447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:17.271472 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34a45f-0fcc-4dd7-a51a-22cc5c0e0447 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:17.271893 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34a45f-0fcc-4dd7-a51a-22cc5c0e0447 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:17.272278 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34a45f-0fcc-4dd7-a51a-22cc5c0e0447 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:17.273216 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34a45f-0fcc-4dd7-a51a-22cc5c0e0447 None admin] RBAC: Adding query filter params (role.id=17fa92022f834aa5bf5cb9e3a506a478, scope.project.id=80e309a3b3784ba9943734a41949b222, user.id=1d0ac98d9520470483c348644566d9ea) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:17.273626 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34a45f-0fcc-4dd7-a51a-22cc5c0e0447 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:17.275397 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34a45f-0fcc-4dd7-a51a-22cc5c0e0447 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:17.288559 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 276/535] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:17 2022] GET /identity/v3/role_assignments?user.id=1d0ac98d9520470483c348644566d9ea&scope.project.id=80e309a3b3784ba9943734a41949b222&role.id=17fa92022f834aa5bf5cb9e3a506a478 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:17.289438 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34a45f-0fcc-4dd7-a51a-22cc5c0e0447 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:17.296208 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:17.314111 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a89f2b-6f5a-47e4-89f8-f45a0634cc1f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:17.356003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe7aba-ddba-4adf-b50d-e0182e42da8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:17.357038 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe7aba-ddba-4adf-b50d-e0182e42da8c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:17.357970 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe7aba-ddba-4adf-b50d-e0182e42da8c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:17.358426 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe7aba-ddba-4adf-b50d-e0182e42da8c None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:17.359496 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe7aba-ddba-4adf-b50d-e0182e42da8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:17.360091 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe7aba-ddba-4adf-b50d-e0182e42da8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:17.361881 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe7aba-ddba-4adf-b50d-e0182e42da8c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:17.377697 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 260/536] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:17.384228 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe7aba-ddba-4adf-b50d-e0182e42da8c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:17.421003 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:17.454783 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34a45f-0fcc-4dd7-a51a-22cc5c0e0447 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:17.491345 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf419a2-18f4-434f-aca0-69d466fa1ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:17.492232 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf419a2-18f4-434f-aca0-69d466fa1ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:17.492618 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf419a2-18f4-434f-aca0-69d466fa1ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:17.492992 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf419a2-18f4-434f-aca0-69d466fa1ec1 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:17.494332 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf419a2-18f4-434f-aca0-69d466fa1ec1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:17.494751 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf419a2-18f4-434f-aca0-69d466fa1ec1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:17.504021 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf419a2-18f4-434f-aca0-69d466fa1ec1 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:17.509959 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 277/537] 10.222.0.85 () {56 vars in 1148 bytes} [Thu Jun 16 14:43:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:17.523933 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf419a2-18f4-434f-aca0-69d466fa1ec1 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:17.550243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe7aba-ddba-4adf-b50d-e0182e42da8c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:17.650871 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf419a2-18f4-434f-aca0-69d466fa1ec1 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:17.684287 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:17.692499 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b17467-7023-4c78-8b14-20711455826d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:17.693303 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b17467-7023-4c78-8b14-20711455826d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:17.693684 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b17467-7023-4c78-8b14-20711455826d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:17.694080 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b17467-7023-4c78-8b14-20711455826d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:17.695033 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b17467-7023-4c78-8b14-20711455826d None admin] RBAC: Adding query filter params (role.id=17fa92022f834aa5bf5cb9e3a506a478, scope.project.id=80e309a3b3784ba9943734a41949b222, user.id=5819a7d47f644bc18e6d07a125826d76) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:17.695442 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b17467-7023-4c78-8b14-20711455826d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:17.697150 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b17467-7023-4c78-8b14-20711455826d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:17.703666 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 278/538] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:17 2022] GET /identity/v3/role_assignments?user.id=5819a7d47f644bc18e6d07a125826d76&scope.project.id=80e309a3b3784ba9943734a41949b222&role.id=17fa92022f834aa5bf5cb9e3a506a478 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:17.720781 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816560a-0777-4173-839c-b4e852cf8153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:17.721633 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816560a-0777-4173-839c-b4e852cf8153 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:17.721918 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816560a-0777-4173-839c-b4e852cf8153 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:17.722194 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816560a-0777-4173-839c-b4e852cf8153 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:17.740929 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816560a-0777-4173-839c-b4e852cf8153 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:17.742428 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816560a-0777-4173-839c-b4e852cf8153 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:17.772693 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-6816560a-0777-4173-839c-b4e852cf8153 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:17.772693 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:17.772693 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:17.772693 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:17.772693 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:17.772693 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:17.772693 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:17.772693 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:17.772693 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:17.772693 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:17.772693 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:17.772693 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:17.772693 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:43:17.772693 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:43:17.772693 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:43:17.773811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:43:17.773811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:17.773811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:17.773811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:17.773811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:17.773811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:17.773811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:17.773811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:17.773811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:17.773811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:17.773811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:17.773811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:17.773811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:17.773811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:17.773811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:17.773811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:17.773811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:17.774896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:43:17.774896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:43:17.774896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:43:17.774896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:43:17.774896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:43:17.774896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:43:17.774896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:17.774896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:17.778581 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 261/539] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:17.779970 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b17467-7023-4c78-8b14-20711455826d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:17.939803 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b17467-7023-4c78-8b14-20711455826d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:17.978358 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97931280-3acf-439c-8f2f-6ce185916bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:17.979040 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97931280-3acf-439c-8f2f-6ce185916bab None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:17.979323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97931280-3acf-439c-8f2f-6ce185916bab None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:17.979600 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97931280-3acf-439c-8f2f-6ce185916bab None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:17.980499 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97931280-3acf-439c-8f2f-6ce185916bab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:17.980807 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97931280-3acf-439c-8f2f-6ce185916bab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:17.982321 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97931280-3acf-439c-8f2f-6ce185916bab None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:17.996104 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 279/540] 10.222.0.85 () {56 vars in 1148 bytes} [Thu Jun 16 14:43:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:18.003995 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816560a-0777-4173-839c-b4e852cf8153 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:18.029745 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:18.083840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838305f-14fd-46e1-9832-4c965367da8d None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:18.084395 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838305f-14fd-46e1-9832-4c965367da8d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:18.084499 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838305f-14fd-46e1-9832-4c965367da8d None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:18.085962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 280/541] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:43:18.091360 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3898134-e698-408f-ba51-14bcf1cae50b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:18.091651 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3898134-e698-408f-ba51-14bcf1cae50b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:18.091968 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3898134-e698-408f-ba51-14bcf1cae50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:18.122917 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816560a-0777-4173-839c-b4e852cf8153 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:18.128996 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-e3898134-e698-408f-ba51-14bcf1cae50b None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:18.130218 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e3898134-e698-408f-ba51-14bcf1cae50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:18.158248 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a474863-b173-4677-91a3-dc8d3f83d20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:18.159016 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a474863-b173-4677-91a3-dc8d3f83d20b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:18.159302 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a474863-b173-4677-91a3-dc8d3f83d20b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:18.159582 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a474863-b173-4677-91a3-dc8d3f83d20b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:18.160451 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a474863-b173-4677-91a3-dc8d3f83d20b None admin] RBAC: Adding query filter params (role.id=17fa92022f834aa5bf5cb9e3a506a478, scope.project.id=80e309a3b3784ba9943734a41949b222, user.id=3d3d59fabcf94718bbc005519cec6f6c) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:18.160768 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a474863-b173-4677-91a3-dc8d3f83d20b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:18.162341 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a474863-b173-4677-91a3-dc8d3f83d20b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:18.169580 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 262/542] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:18 2022] GET /identity/v3/role_assignments?user.id=3d3d59fabcf94718bbc005519cec6f6c&scope.project.id=80e309a3b3784ba9943734a41949b222&role.id=17fa92022f834aa5bf5cb9e3a506a478 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:18.226419 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:18.252065 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 281/543] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:43:18.290378 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a474863-b173-4677-91a3-dc8d3f83d20b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:18.387979 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:18.420365 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a474863-b173-4677-91a3-dc8d3f83d20b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:18.456972 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7948e-c64f-4be0-af61-bb8424bd233c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:18.457790 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7948e-c64f-4be0-af61-bb8424bd233c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:18.458137 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7948e-c64f-4be0-af61-bb8424bd233c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:18.458417 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7948e-c64f-4be0-af61-bb8424bd233c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:18.470172 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d7948e-c64f-4be0-af61-bb8424bd233c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:18.477978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-41d7948e-c64f-4be0-af61-bb8424bd233c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:18.477978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:18.477978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:18.477978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:18.477978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:18.477978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:18.477978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:18.477978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:18.477978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:18.477978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:18.477978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:18.477978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:18.477978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:18.477978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:18.477978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:18.477978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:18.478886 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:18.478886 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:18.478886 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:18.478886 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:18.478886 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:18.478886 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:18.478886 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:18.478886 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:18.478886 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:18.478886 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:18.478886 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:18.478886 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:18.478886 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:18.478886 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:18.478886 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:18.478886 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:18.479954 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:18.479954 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:18.479954 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:18.479954 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:18.479954 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:18.479954 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:18.479954 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:18.479954 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:18.479954 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:18.479954 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:18.479954 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:18.479954 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:18.479954 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 263/544] 10.222.0.85 () {56 vars in 1102 bytes} [Thu Jun 16 14:43:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:18.485772 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3898134-e698-408f-ba51-14bcf1cae50b None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:18.651124 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3898134-e698-408f-ba51-14bcf1cae50b None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:18.705153 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c0d5e-c4e2-414f-a6b1-e4247c0fced9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:18.705847 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c0d5e-c4e2-414f-a6b1-e4247c0fced9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:18.706122 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c0d5e-c4e2-414f-a6b1-e4247c0fced9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:18.706399 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c0d5e-c4e2-414f-a6b1-e4247c0fced9 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:18.707165 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c0d5e-c4e2-414f-a6b1-e4247c0fced9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:18.707467 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c0d5e-c4e2-414f-a6b1-e4247c0fced9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:18.708902 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c0d5e-c4e2-414f-a6b1-e4247c0fced9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:18.724550 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 282/545] 10.222.0.85 () {56 vars in 1103 bytes} [Thu Jun 16 14:43:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:18.729816 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7948e-c64f-4be0-af61-bb8424bd233c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:18.908220 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7948e-c64f-4be0-af61-bb8424bd233c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:18.948345 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:18.956703 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370db916-a7a9-46c1-bb77-f9a63b22b170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:18.957772 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370db916-a7a9-46c1-bb77-f9a63b22b170 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:18.958248 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370db916-a7a9-46c1-bb77-f9a63b22b170 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:18.958717 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370db916-a7a9-46c1-bb77-f9a63b22b170 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:18.977341 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370db916-a7a9-46c1-bb77-f9a63b22b170 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:18.979243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370db916-a7a9-46c1-bb77-f9a63b22b170 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:19.000407 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-370db916-a7a9-46c1-bb77-f9a63b22b170 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:19.000407 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:19.000407 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:19.000407 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:19.000407 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:19.000407 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:19.000407 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:19.000407 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:19.000407 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:19.000407 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:19.000407 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:19.000407 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:19.000407 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:19.000407 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:19.000407 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:19.001273 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:19.001273 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:19.001273 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:19.001273 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:19.001273 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:19.001273 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:19.001273 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:19.001273 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:19.001273 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:19.001273 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:19.001273 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:19.001273 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:19.001273 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:19.001273 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:19.001273 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:19.001273 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:19.001273 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:19.002114 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:19.002114 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:19.002114 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:19.002114 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:19.007969 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 264/546] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:19.011763 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c0d5e-c4e2-414f-a6b1-e4247c0fced9 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:19.100498 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:19.173182 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f399ff-d6d2-477c-9d9f-8b204fcec33f None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:19.174132 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f399ff-d6d2-477c-9d9f-8b204fcec33f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:19.174682 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f399ff-d6d2-477c-9d9f-8b204fcec33f None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:19.179896 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c0d5e-c4e2-414f-a6b1-e4247c0fced9 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:19.180165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 265/547] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:19.193449 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0114f4-19dd-4cce-9a34-f703f0fdd46d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:19.193737 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0114f4-19dd-4cce-9a34-f703f0fdd46d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:19.194005 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0114f4-19dd-4cce-9a34-f703f0fdd46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:19.232288 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1e0114f4-19dd-4cce-9a34-f703f0fdd46d None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:19.233506 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1e0114f4-19dd-4cce-9a34-f703f0fdd46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:19.241201 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776a352-af8e-45c6-b783-01a6bad8a93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:19.241876 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776a352-af8e-45c6-b783-01a6bad8a93a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:19.242157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776a352-af8e-45c6-b783-01a6bad8a93a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:19.242430 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776a352-af8e-45c6-b783-01a6bad8a93a None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:19.243158 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776a352-af8e-45c6-b783-01a6bad8a93a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:19.243464 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776a352-af8e-45c6-b783-01a6bad8a93a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:19.249078 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776a352-af8e-45c6-b783-01a6bad8a93a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:19.275305 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 283/548] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:19.281925 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776a352-af8e-45c6-b783-01a6bad8a93a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:19.377516 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 266/549] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:19.420229 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0114f4-19dd-4cce-9a34-f703f0fdd46d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:19.442679 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776a352-af8e-45c6-b783-01a6bad8a93a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:19.463243 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:19.513001 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e7942-866f-4a1b-951c-b5613447a326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:19.513806 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e7942-866f-4a1b-951c-b5613447a326 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:19.514090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e7942-866f-4a1b-951c-b5613447a326 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:19.514365 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e7942-866f-4a1b-951c-b5613447a326 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:19.524351 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e7942-866f-4a1b-951c-b5613447a326 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:19.526013 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e7942-866f-4a1b-951c-b5613447a326 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:19.546251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-bb4e7942-866f-4a1b-951c-b5613447a326 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 14:43:19.546251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:19.546251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:19.546251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:19.546251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:19.546251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:19.546251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:19.546251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:19.546251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:19.546251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:19.546251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:19.546251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:19.546251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:43:19.546251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:43:19.546251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:43:19.546251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:43:19.548417 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:19.548417 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:19.548417 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:43:19.548417 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:19.548417 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:43:19.548417 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:19.548417 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:19.548417 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:19.548417 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:19.548417 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:19.548417 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:19.548417 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:19.548417 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:19.548417 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:19.548417 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:19.548417 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:19.548417 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:19.548417 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:19.549826 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:19.549826 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:19.549826 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:43:19.549826 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:43:19.549826 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:43:19.549826 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:43:19.549826 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:43:19.549826 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:43:19.549826 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 14:43:19.549826 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:19.549826 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 284/550] 10.222.0.85 () {56 vars in 1096 bytes} [Thu Jun 16 14:43:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:19.560077 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e7942-866f-4a1b-951c-b5613447a326 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:19.585146 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0114f4-19dd-4cce-9a34-f703f0fdd46d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:19.615434 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:19.660408 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52050a2-50e0-4239-8f7a-49da91137003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:19.661233 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52050a2-50e0-4239-8f7a-49da91137003 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:19.661514 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52050a2-50e0-4239-8f7a-49da91137003 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:19.661791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52050a2-50e0-4239-8f7a-49da91137003 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:19.679932 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52050a2-50e0-4239-8f7a-49da91137003 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:19.687468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-e52050a2-50e0-4239-8f7a-49da91137003 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:19.687468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:19.687468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:19.687468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:19.687468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:19.687468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:19.687468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:19.687468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:19.687468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:19.687468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:19.687468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:19.687468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:19.687468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:19.687468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:19.687468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:19.687468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:19.688430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:19.688430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:19.688430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:19.688430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:19.688430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:19.688430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:19.688430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:19.688430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:19.688430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:19.688430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:19.688430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:19.688430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:19.688430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:19.688430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:19.688430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:19.688430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:19.689880 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:19.689880 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:19.689880 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:19.689880 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:19.689880 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:19.689880 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:19.689880 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:19.689880 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:19.689880 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:19.689880 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:19.689880 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:19.689880 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:19.689880 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 267/551] 10.222.0.85 () {56 vars in 1102 bytes} [Thu Jun 16 14:43:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:43:19.695202 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52050a2-50e0-4239-8f7a-49da91137003 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:19.784450 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e7942-866f-4a1b-951c-b5613447a326 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:19.809032 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52050a2-50e0-4239-8f7a-49da91137003 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:19.846144 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a58de-fc7b-4347-90bc-c02105619849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:19.846836 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a58de-fc7b-4347-90bc-c02105619849 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:19.847121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a58de-fc7b-4347-90bc-c02105619849 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:19.847400 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a58de-fc7b-4347-90bc-c02105619849 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:19.848186 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a58de-fc7b-4347-90bc-c02105619849 None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:19.848498 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a58de-fc7b-4347-90bc-c02105619849 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:19.849888 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a58de-fc7b-4347-90bc-c02105619849 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:19.859169 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 268/552] 10.222.0.85 () {56 vars in 1103 bytes} [Thu Jun 16 14:43:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:19.864633 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a58de-fc7b-4347-90bc-c02105619849 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:19.888240 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650541e3-cc1b-4cd5-9d4c-7c7661b7670d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:19.888929 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650541e3-cc1b-4cd5-9d4c-7c7661b7670d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:19.889210 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650541e3-cc1b-4cd5-9d4c-7c7661b7670d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:19.889487 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650541e3-cc1b-4cd5-9d4c-7c7661b7670d None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:19.890332 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650541e3-cc1b-4cd5-9d4c-7c7661b7670d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:19.890647 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650541e3-cc1b-4cd5-9d4c-7c7661b7670d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:19.892256 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650541e3-cc1b-4cd5-9d4c-7c7661b7670d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:19.907003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:19.916705 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 285/553] 10.222.0.85 () {56 vars in 1135 bytes} [Thu Jun 16 14:43:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:19.918535 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ec165-b0f1-49c0-8a0f-0a7ef29c268f None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:19.918927 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ec165-b0f1-49c0-8a0f-0a7ef29c268f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:19.919301 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ec165-b0f1-49c0-8a0f-0a7ef29c268f None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:19.920927 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 286/554] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:19.924809 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ec165-b0f1-49c0-8a0f-0a7ef29c268f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:19.964324 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:19.980402 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a58de-fc7b-4347-90bc-c02105619849 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:20.015719 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24362a8f-b5fd-42ef-bacc-de3fda54cb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:20.016717 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24362a8f-b5fd-42ef-bacc-de3fda54cb1b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:20.017093 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24362a8f-b5fd-42ef-bacc-de3fda54cb1b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:20.017465 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24362a8f-b5fd-42ef-bacc-de3fda54cb1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:20.028639 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24362a8f-b5fd-42ef-bacc-de3fda54cb1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:20.030266 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24362a8f-b5fd-42ef-bacc-de3fda54cb1b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:20.049058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-24362a8f-b5fd-42ef-bacc-de3fda54cb1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:20.049058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:20.049058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:20.049058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:20.049058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:20.049058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:20.049058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:20.049058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:20.049058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:20.049058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:20.049058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:20.049058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:20.049058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:20.049058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:20.049058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:20.050031 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:20.050031 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:20.050031 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:20.050031 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:20.050031 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:20.050031 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:20.050031 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:20.050031 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:20.050031 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:20.050031 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:20.050031 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:20.050031 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:20.050031 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:20.050031 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:20.050031 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:20.050031 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:20.050031 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:20.050906 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:20.050906 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:20.050906 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:20.050906 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:20.055244 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 269/555] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:43:20.056456 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ec165-b0f1-49c0-8a0f-0a7ef29c268f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:20.056781 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5a3d6-cf38-4ef1-a946-927feddd40a9 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:20.057073 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5a3d6-cf38-4ef1-a946-927feddd40a9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:20.057352 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5a3d6-cf38-4ef1-a946-927feddd40a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:20.075145 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c8d5a3d6-cf38-4ef1-a946-927feddd40a9 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:20.076396 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c8d5a3d6-cf38-4ef1-a946-927feddd40a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:20.103073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92bb2b-441b-4c46-ade1-cce762796dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:20.104111 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92bb2b-441b-4c46-ade1-cce762796dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:20.104399 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92bb2b-441b-4c46-ade1-cce762796dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:20.104677 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92bb2b-441b-4c46-ade1-cce762796dd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:20.147069 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 270/556] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:20.148023 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5a3d6-cf38-4ef1-a946-927feddd40a9 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:20.181326 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:20.202225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b92bb2b-441b-4c46-ade1-cce762796dd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:20.203706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b92bb2b-441b-4c46-ade1-cce762796dd5 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:20.231902 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:20.273648 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5a3d6-cf38-4ef1-a946-927feddd40a9 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:20.310447 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 287/557] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:20.311822 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92bb2b-441b-4c46-ade1-cce762796dd5 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:20.321662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f21f9-2597-481a-a602-cf3f44232c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:20.322443 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f21f9-2597-481a-a602-cf3f44232c18 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:20.322725 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f21f9-2597-481a-a602-cf3f44232c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:20.323767 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f21f9-2597-481a-a602-cf3f44232c18 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:20.324616 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f21f9-2597-481a-a602-cf3f44232c18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:20.324929 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f21f9-2597-481a-a602-cf3f44232c18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:20.327140 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f21f9-2597-481a-a602-cf3f44232c18 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:20.348049 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 271/558] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:20.349223 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f21f9-2597-481a-a602-cf3f44232c18 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:20.435899 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92bb2b-441b-4c46-ade1-cce762796dd5 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:20.441545 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:20.464099 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:20.466667 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f21f9-2597-481a-a602-cf3f44232c18 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:20.475174 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a813b88-2cb1-4fbf-bbd8-5a4ce18209d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:20.476705 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a813b88-2cb1-4fbf-bbd8-5a4ce18209d4 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:20.477170 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a813b88-2cb1-4fbf-bbd8-5a4ce18209d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:20.477997 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a813b88-2cb1-4fbf-bbd8-5a4ce18209d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:20.492518 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a813b88-2cb1-4fbf-bbd8-5a4ce18209d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:20.501033 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-6a813b88-2cb1-4fbf-bbd8-5a4ce18209d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:20.501033 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:20.501033 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:20.501033 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:20.501033 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:20.501033 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:20.501033 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:20.501033 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:20.501033 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:20.501033 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:20.501033 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:20.501033 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:20.501033 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:20.501033 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:20.501033 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:20.501033 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:20.502045 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:20.502045 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:20.502045 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:20.502045 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:20.502045 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:20.502045 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:20.502045 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:20.502045 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:20.502045 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:20.502045 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:20.502045 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:20.502045 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:20.502045 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:20.502045 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:20.502045 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:20.502045 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:20.502905 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:20.502905 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:20.502905 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:20.502905 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:20.502905 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:20.502905 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:20.502905 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:20.502905 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:20.502905 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:20.502905 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:20.502905 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:20.502905 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:20.502905 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 288/559] 10.222.0.85 () {56 vars in 1102 bytes} [Thu Jun 16 14:43:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:20.503590 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a813b88-2cb1-4fbf-bbd8-5a4ce18209d4 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:20.504546 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce87d35-0161-4c01-a057-1d4d1e86a6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:20.505354 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce87d35-0161-4c01-a057-1d4d1e86a6c8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:20.505629 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce87d35-0161-4c01-a057-1d4d1e86a6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:20.505898 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce87d35-0161-4c01-a057-1d4d1e86a6c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:20.517404 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce87d35-0161-4c01-a057-1d4d1e86a6c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:20.518865 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce87d35-0161-4c01-a057-1d4d1e86a6c8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:20.536874 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-2ce87d35-0161-4c01-a057-1d4d1e86a6c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:20.536874 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:20.536874 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:20.536874 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:20.536874 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:20.536874 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:20.536874 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:20.536874 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:20.536874 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:20.536874 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:20.536874 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:20.536874 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:20.536874 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:20.536874 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:20.536874 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:20.537930 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:20.537930 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:20.537930 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:20.537930 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:20.537930 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:20.537930 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:20.537930 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:20.537930 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:20.537930 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:20.537930 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:20.537930 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:20.537930 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:20.537930 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:20.537930 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:20.537930 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:20.537930 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:20.537930 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:20.538827 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:20.538827 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:20.538827 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:20.538827 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:20.538827 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 272/560] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:20.539851 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775086e-ffcf-4577-b5f5-fee84f889472 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:20.539851 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775086e-ffcf-4577-b5f5-fee84f889472 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:20.540058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775086e-ffcf-4577-b5f5-fee84f889472 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:20.541430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 273/561] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:20.542094 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775086e-ffcf-4577-b5f5-fee84f889472 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:20.630316 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a813b88-2cb1-4fbf-bbd8-5a4ce18209d4 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:20.659865 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775086e-ffcf-4577-b5f5-fee84f889472 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:20.668548 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4093e6-43b3-4e30-9f6a-137807a6f3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:20.669730 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4093e6-43b3-4e30-9f6a-137807a6f3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:20.670158 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4093e6-43b3-4e30-9f6a-137807a6f3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:20.670602 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4093e6-43b3-4e30-9f6a-137807a6f3e6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:20.680582 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4093e6-43b3-4e30-9f6a-137807a6f3e6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:20.682652 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4093e6-43b3-4e30-9f6a-137807a6f3e6 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:20.692499 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:20.699056 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7551b-2ffa-46b9-87f3-51ebca84f714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:20.699730 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7551b-2ffa-46b9-87f3-51ebca84f714 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:20.700039 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7551b-2ffa-46b9-87f3-51ebca84f714 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:20.700315 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7551b-2ffa-46b9-87f3-51ebca84f714 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:20.701052 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7551b-2ffa-46b9-87f3-51ebca84f714 None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:20.701355 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7551b-2ffa-46b9-87f3-51ebca84f714 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:20.701841 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-3b4093e6-43b3-4e30-9f6a-137807a6f3e6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:43:20.701841 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:20.701841 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:20.701841 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:20.701841 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:20.701841 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:20.701841 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:20.701841 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:20.701841 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:20.701841 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:20.701841 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:20.701841 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:20.701841 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:43:20.701841 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:43:20.701841 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:43:20.701841 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:43:20.703000 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:20.703000 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:20.703000 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:43:20.703000 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:20.703000 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:43:20.703000 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:20.703000 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:20.703000 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:20.703000 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:20.703000 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:20.703000 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:20.703000 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:20.703000 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:20.703000 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:20.703000 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:20.703000 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:20.703000 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:20.703000 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:20.704169 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:20.704169 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:20.704169 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:43:20.704169 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:43:20.704169 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:43:20.704169 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:43:20.704169 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:43:20.704169 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:43:20.704169 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:43:20.704169 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:20.704831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7551b-2ffa-46b9-87f3-51ebca84f714 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:20.706285 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 289/562] 10.222.0.85 () {56 vars in 1093 bytes} [Thu Jun 16 14:43:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:20.707197 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4093e6-43b3-4e30-9f6a-137807a6f3e6 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:20.716149 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 274/563] 10.222.0.85 () {56 vars in 1103 bytes} [Thu Jun 16 14:43:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:20.717489 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddaeccd-ac8e-46f6-9631-2efd42bc89cc None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:20.717776 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddaeccd-ac8e-46f6-9631-2efd42bc89cc None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:20.718048 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddaeccd-ac8e-46f6-9631-2efd42bc89cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:20.737198 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-fddaeccd-ac8e-46f6-9631-2efd42bc89cc None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:20.738374 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fddaeccd-ac8e-46f6-9631-2efd42bc89cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:20.758060 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:20.805929 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 275/564] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:20.807158 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddaeccd-ac8e-46f6-9631-2efd42bc89cc None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:20.812500 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4093e6-43b3-4e30-9f6a-137807a6f3e6 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:20.848448 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d63dcc-d909-40ca-af8c-4a5955122629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:20.849108 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d63dcc-d909-40ca-af8c-4a5955122629 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:20.849383 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d63dcc-d909-40ca-af8c-4a5955122629 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:20.849651 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d63dcc-d909-40ca-af8c-4a5955122629 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:20.850387 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d63dcc-d909-40ca-af8c-4a5955122629 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:20.850669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d63dcc-d909-40ca-af8c-4a5955122629 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:20.852180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d63dcc-d909-40ca-af8c-4a5955122629 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:20.876848 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 290/565] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:20.876848 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d63dcc-d909-40ca-af8c-4a5955122629 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:20.924325 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddaeccd-ac8e-46f6-9631-2efd42bc89cc None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:20.947384 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:20.960546 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fefaae-26c7-49b4-b3a7-6d3a5f600c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:20.961251 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fefaae-26c7-49b4-b3a7-6d3a5f600c66 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:20.961532 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fefaae-26c7-49b4-b3a7-6d3a5f600c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:20.961806 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fefaae-26c7-49b4-b3a7-6d3a5f600c66 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:20.962761 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fefaae-26c7-49b4-b3a7-6d3a5f600c66 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:20.963068 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fefaae-26c7-49b4-b3a7-6d3a5f600c66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:20.964573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fefaae-26c7-49b4-b3a7-6d3a5f600c66 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:20.978547 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d63dcc-d909-40ca-af8c-4a5955122629 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:20.981737 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 276/566] 10.222.0.85 () {56 vars in 1133 bytes} [Thu Jun 16 14:43:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:20.983005 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da7f96-280d-4477-a0ae-5598be5060b0 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:20.983270 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da7f96-280d-4477-a0ae-5598be5060b0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:20.983563 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da7f96-280d-4477-a0ae-5598be5060b0 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:20.985022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 277/567] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:20.985533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da7f96-280d-4477-a0ae-5598be5060b0 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:20.990724 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:21.014919 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4f614-3661-436e-9b4e-e1a0afa653ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:21.015648 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4f614-3661-436e-9b4e-e1a0afa653ca None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:21.015940 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4f614-3661-436e-9b4e-e1a0afa653ca None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:21.016216 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4f614-3661-436e-9b4e-e1a0afa653ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:21.026280 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4f614-3661-436e-9b4e-e1a0afa653ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:21.027738 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4f614-3661-436e-9b4e-e1a0afa653ca None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:21.045746 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-d6c4f614-3661-436e-9b4e-e1a0afa653ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:21.045746 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:21.045746 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:21.045746 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:21.045746 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:21.045746 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:21.045746 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:21.045746 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:21.045746 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:21.045746 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:21.045746 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:21.045746 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:21.045746 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:21.045746 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:21.045746 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:21.046745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:21.046745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:21.046745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:21.046745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:21.046745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:21.046745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:21.046745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:21.046745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:21.046745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:21.046745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:21.046745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:21.046745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:21.046745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:21.046745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:21.046745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:21.046745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:21.046745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:21.048083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:21.048083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:21.048083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:21.048083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:21.048083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 291/568] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:21.048381 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4f614-3661-436e-9b4e-e1a0afa653ca None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:21.093187 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da7f96-280d-4477-a0ae-5598be5060b0 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:21.126823 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d36b3-3ee2-4ea2-ad85-ad7b1e73fea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:21.127630 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d36b3-3ee2-4ea2-ad85-ad7b1e73fea5 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:21.127949 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d36b3-3ee2-4ea2-ad85-ad7b1e73fea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:21.128228 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d36b3-3ee2-4ea2-ad85-ad7b1e73fea5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:21.138569 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d36b3-3ee2-4ea2-ad85-ad7b1e73fea5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:21.146275 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-e64d36b3-3ee2-4ea2-ad85-ad7b1e73fea5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:21.146275 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:21.146275 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:21.146275 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:21.146275 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:21.146275 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:21.146275 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:21.146275 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:21.146275 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:21.146275 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:21.146275 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:21.146275 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:21.146275 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:21.146275 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:21.146275 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:21.146275 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:21.147265 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:21.147265 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:21.147265 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:21.147265 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:21.147265 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:21.147265 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:21.147265 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:21.147265 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:21.147265 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:21.147265 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:21.147265 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:21.147265 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:21.147265 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:21.147265 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:21.147265 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:21.147265 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:21.148142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:21.148142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:21.148142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:21.148142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:21.148142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:21.148142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:21.148142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:21.148142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:21.148142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:21.148142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:21.148142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:21.148142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:21.148142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 278/569] 10.222.0.85 () {56 vars in 1102 bytes} [Thu Jun 16 14:43:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:21.148868 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d36b3-3ee2-4ea2-ad85-ad7b1e73fea5 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:21.156027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4f614-3661-436e-9b4e-e1a0afa653ca None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:21.190529 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:21.194256 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd33f8-5837-435d-a64f-1239921f5647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:21.195068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd33f8-5837-435d-a64f-1239921f5647 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:21.195351 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd33f8-5837-435d-a64f-1239921f5647 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:21.195631 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd33f8-5837-435d-a64f-1239921f5647 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:21.202546 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd33f8-5837-435d-a64f-1239921f5647 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:21.204035 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd33f8-5837-435d-a64f-1239921f5647 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:21.217760 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-bcdd33f8-5837-435d-a64f-1239921f5647 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:21.217760 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:21.217760 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:21.217760 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:21.217760 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:21.217760 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:21.217760 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:21.217760 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:21.217760 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:21.217760 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:21.217760 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:21.217760 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:21.217760 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:43:21.217760 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:43:21.217760 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:43:21.218674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:43:21.218674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:21.218674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:21.218674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:21.218674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:21.218674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:21.218674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:21.218674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:21.218674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:21.218674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:21.218674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:21.218674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:21.218674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:21.218674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:21.218674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:21.218674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:21.218674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:21.219556 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:43:21.219556 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:43:21.219556 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:43:21.219556 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:43:21.219556 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:43:21.219556 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:43:21.219556 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:21.219556 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:21.219556 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 292/570] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:21.220206 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f7bed-f4d6-4f5c-b4da-ebe4faeb3228 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:21.220418 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f7bed-f4d6-4f5c-b4da-ebe4faeb3228 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:21.220704 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f7bed-f4d6-4f5c-b4da-ebe4faeb3228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:21.237240 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-250f7bed-f4d6-4f5c-b4da-ebe4faeb3228 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:21.238424 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-250f7bed-f4d6-4f5c-b4da-ebe4faeb3228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:21.252004 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:21.252686 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d36b3-3ee2-4ea2-ad85-ad7b1e73fea5 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:21.287696 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557b29e-611a-4e5d-ba99-3dc497db88de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:21.288446 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557b29e-611a-4e5d-ba99-3dc497db88de None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:21.288729 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557b29e-611a-4e5d-ba99-3dc497db88de None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:21.289005 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557b29e-611a-4e5d-ba99-3dc497db88de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:21.299818 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557b29e-611a-4e5d-ba99-3dc497db88de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:21.301296 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557b29e-611a-4e5d-ba99-3dc497db88de None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:21.306967 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 293/571] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:21.307831 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f7bed-f4d6-4f5c-b4da-ebe4faeb3228 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:21.318386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-1557b29e-611a-4e5d-ba99-3dc497db88de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:21.318386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:21.318386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:21.318386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:21.318386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:21.318386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:21.318386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:21.318386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:21.318386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:21.318386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:21.318386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:21.318386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:21.318386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:21.318386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:21.318386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:21.319383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:21.319383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:21.319383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:21.319383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:21.319383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:21.319383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:21.319383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:21.319383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:21.319383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:21.319383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:21.319383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:21.319383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:21.319383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:21.319383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:21.319383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:21.319383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:21.319383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:21.320281 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:21.320281 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:21.320281 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:21.320281 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:21.320281 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 279/572] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:21.321090 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557b29e-611a-4e5d-ba99-3dc497db88de None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:21.411303 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:21.420918 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557b29e-611a-4e5d-ba99-3dc497db88de None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:21.422954 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f7bed-f4d6-4f5c-b4da-ebe4faeb3228 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:21.454658 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ab614-6465-4fd6-a981-567db8d88929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:21.455322 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ab614-6465-4fd6-a981-567db8d88929 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:21.455611 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ab614-6465-4fd6-a981-567db8d88929 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:21.455913 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ab614-6465-4fd6-a981-567db8d88929 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:21.456659 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ab614-6465-4fd6-a981-567db8d88929 None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:21.456965 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ab614-6465-4fd6-a981-567db8d88929 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:21.457538 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8612a-0f9c-4ece-9c92-af23a490e006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:21.458218 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8612a-0f9c-4ece-9c92-af23a490e006 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:21.458337 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ab614-6465-4fd6-a981-567db8d88929 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:21.458502 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8612a-0f9c-4ece-9c92-af23a490e006 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:21.458780 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8612a-0f9c-4ece-9c92-af23a490e006 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:21.459515 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8612a-0f9c-4ece-9c92-af23a490e006 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:21.459820 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8612a-0f9c-4ece-9c92-af23a490e006 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:21.461216 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8612a-0f9c-4ece-9c92-af23a490e006 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:21.466364 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 280/573] 10.222.0.85 () {56 vars in 1103 bytes} [Thu Jun 16 14:43:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:21.467149 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ab614-6465-4fd6-a981-567db8d88929 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:21.478129 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 294/574] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:21.478129 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8612a-0f9c-4ece-9c92-af23a490e006 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:21.488732 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:21.576369 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ab614-6465-4fd6-a981-567db8d88929 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:21.576531 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8612a-0f9c-4ece-9c92-af23a490e006 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:21.611105 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a97c7-aa62-4a10-b468-9db760cef598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:21.611771 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a97c7-aa62-4a10-b468-9db760cef598 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:21.612082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a97c7-aa62-4a10-b468-9db760cef598 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:21.612197 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed235d4-f778-4ecd-b868-6ee58c47373e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:21.612358 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a97c7-aa62-4a10-b468-9db760cef598 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:21.612795 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed235d4-f778-4ecd-b868-6ee58c47373e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:21.613079 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a97c7-aa62-4a10-b468-9db760cef598 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:21.613185 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed235d4-f778-4ecd-b868-6ee58c47373e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:21.613357 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed235d4-f778-4ecd-b868-6ee58c47373e None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:21.613449 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a97c7-aa62-4a10-b468-9db760cef598 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:21.614237 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed235d4-f778-4ecd-b868-6ee58c47373e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:21.614556 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed235d4-f778-4ecd-b868-6ee58c47373e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:21.614761 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a97c7-aa62-4a10-b468-9db760cef598 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:21.615990 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed235d4-f778-4ecd-b868-6ee58c47373e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:21.626704 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 295/575] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:21.627815 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a97c7-aa62-4a10-b468-9db760cef598 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:21.628041 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 281/576] 10.222.0.85 () {56 vars in 1148 bytes} [Thu Jun 16 14:43:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:21.628849 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed235d4-f778-4ecd-b868-6ee58c47373e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:21.653033 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:21.702262 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:21.737675 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a97c7-aa62-4a10-b468-9db760cef598 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:21.744291 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed235d4-f778-4ecd-b868-6ee58c47373e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:21.772166 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a3fce-9ab8-45fe-b8d4-21a776914c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:21.772971 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a3fce-9ab8-45fe-b8d4-21a776914c83 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:21.773252 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a3fce-9ab8-45fe-b8d4-21a776914c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:21.773568 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a3fce-9ab8-45fe-b8d4-21a776914c83 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:21.778378 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2169f5-9dd6-4edb-bdb8-8db5ec4ed4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:21.779184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2169f5-9dd6-4edb-bdb8-8db5ec4ed4c0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:21.779465 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2169f5-9dd6-4edb-bdb8-8db5ec4ed4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:21.779737 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2169f5-9dd6-4edb-bdb8-8db5ec4ed4c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:21.783917 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a3fce-9ab8-45fe-b8d4-21a776914c83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:21.789770 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2169f5-9dd6-4edb-bdb8-8db5ec4ed4c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:21.791451 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2169f5-9dd6-4edb-bdb8-8db5ec4ed4c0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:21.791755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-722a3fce-9ab8-45fe-b8d4-21a776914c83 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:21.791755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:21.791755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:21.791755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:21.791755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:21.791755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:21.791755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:21.791755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:21.791755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:21.791755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:21.791755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:21.791755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:21.791755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:21.791755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:21.791755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:21.791755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:21.792890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:21.792890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:21.792890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:21.792890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:21.792890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:21.792890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:21.792890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:21.792890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:21.792890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:21.792890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:21.792890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:21.792890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:21.792890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:21.792890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:21.792890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:21.792890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:21.793910 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:21.793910 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:21.793910 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:21.793910 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:21.793910 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:21.793910 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:21.793910 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:21.793910 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:21.793910 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:21.793910 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:21.793910 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:21.793910 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:21.793910 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 296/577] 10.222.0.85 () {56 vars in 1102 bytes} [Thu Jun 16 14:43:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:21.793910 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a3fce-9ab8-45fe-b8d4-21a776914c83 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:21.811984 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-9c2169f5-9dd6-4edb-bdb8-8db5ec4ed4c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:21.811984 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:21.811984 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:21.811984 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:21.811984 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:21.811984 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:21.811984 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:21.811984 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:21.811984 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:21.811984 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:21.811984 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:21.811984 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:21.811984 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:21.811984 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:21.811984 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:21.812978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:21.812978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:21.812978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:21.812978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:21.812978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:21.812978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:21.812978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:21.812978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:21.812978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:21.812978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:21.812978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:21.812978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:21.812978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:21.812978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:21.812978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:21.812978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:21.812978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:21.813875 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:21.813875 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:21.813875 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:21.813875 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:21.813875 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 282/578] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:21.814346 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2169f5-9dd6-4edb-bdb8-8db5ec4ed4c0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:21.879592 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:21.901071 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a3fce-9ab8-45fe-b8d4-21a776914c83 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:21.916954 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2169f5-9dd6-4edb-bdb8-8db5ec4ed4c0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:21.927999 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:21.938250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddd8c8-1b89-4e50-ba4d-98e2542e036c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:21.939059 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddd8c8-1b89-4e50-ba4d-98e2542e036c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:21.939342 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddd8c8-1b89-4e50-ba4d-98e2542e036c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:21.939635 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddd8c8-1b89-4e50-ba4d-98e2542e036c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:21.948376 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddd8c8-1b89-4e50-ba4d-98e2542e036c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:21.950318 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddd8c8-1b89-4e50-ba4d-98e2542e036c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:21.961298 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8602b36-f60d-4807-9b2b-c848ac9d9bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:21.962114 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8602b36-f60d-4807-9b2b-c848ac9d9bee None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:21.962393 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8602b36-f60d-4807-9b2b-c848ac9d9bee None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:21.962666 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8602b36-f60d-4807-9b2b-c848ac9d9bee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:21.969795 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8602b36-f60d-4807-9b2b-c848ac9d9bee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:21.971236 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8602b36-f60d-4807-9b2b-c848ac9d9bee None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:21.975060 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-01ddd8c8-1b89-4e50-ba4d-98e2542e036c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 14:43:21.975060 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:21.975060 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:21.975060 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:21.975060 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:21.975060 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:21.975060 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:21.975060 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:21.975060 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:21.975060 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:21.975060 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:21.975060 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:21.975060 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:43:21.975060 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:43:21.975060 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:43:21.975060 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:43:21.976070 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:21.976070 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:21.976070 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:43:21.976070 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:21.976070 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:43:21.976070 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:21.976070 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:21.976070 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:21.976070 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:21.976070 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:21.976070 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:21.976070 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:21.976070 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:21.976070 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:21.976070 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:21.976070 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:21.976070 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:21.976070 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:21.977068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:21.977068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:21.977068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:43:21.977068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:43:21.977068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:43:21.977068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:43:21.977068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:43:21.977068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:43:21.977068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 14:43:21.977068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:21.977068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 297/579] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:21.977690 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddd8c8-1b89-4e50-ba4d-98e2542e036c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:21.987132 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-e8602b36-f60d-4807-9b2b-c848ac9d9bee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:21.987132 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:21.987132 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:21.987132 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:21.987132 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:21.987132 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:21.987132 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:21.987132 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:21.987132 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:21.987132 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:21.987132 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:21.987132 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:21.987132 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:43:21.987132 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:43:21.987132 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:43:21.988205 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:43:21.988205 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:21.988205 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:21.988205 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:21.988205 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:21.988205 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:21.988205 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:21.988205 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:21.988205 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:21.988205 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:21.988205 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:21.988205 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:21.988205 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:21.988205 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:21.988205 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:21.988205 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:21.988205 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:21.989088 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:43:21.989088 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:43:21.989088 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:43:21.989088 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:43:21.989088 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:43:21.989088 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:43:21.989088 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:21.989088 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:21.989088 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 283/580] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:21.989676 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8602b36-f60d-4807-9b2b-c848ac9d9bee None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:22.091860 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddd8c8-1b89-4e50-ba4d-98e2542e036c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:22.092111 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8602b36-f60d-4807-9b2b-c848ac9d9bee None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:22.117850 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:22.125202 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9f994-485d-49fc-b3de-e4a93eed4e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:22.125856 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9f994-485d-49fc-b3de-e4a93eed4e45 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:22.126135 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9f994-485d-49fc-b3de-e4a93eed4e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:22.126398 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9f994-485d-49fc-b3de-e4a93eed4e45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:22.127215 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9f994-485d-49fc-b3de-e4a93eed4e45 None admin] RBAC: Adding query filter params (role.id=17fa92022f834aa5bf5cb9e3a506a478, scope.project.id=80e309a3b3784ba9943734a41949b222, user.id=bf9c39de29324b0ca6329c9a171367c4) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:22.127449 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5b9d3-a41f-4cbd-b26f-91d4158a04ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:22.127579 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9f994-485d-49fc-b3de-e4a93eed4e45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:22.128153 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5b9d3-a41f-4cbd-b26f-91d4158a04ff None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:22.128434 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5b9d3-a41f-4cbd-b26f-91d4158a04ff None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:22.128713 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5b9d3-a41f-4cbd-b26f-91d4158a04ff None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:22.129006 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9f994-485d-49fc-b3de-e4a93eed4e45 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:22.129453 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5b9d3-a41f-4cbd-b26f-91d4158a04ff None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:22.129789 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5b9d3-a41f-4cbd-b26f-91d4158a04ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:22.131145 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5b9d3-a41f-4cbd-b26f-91d4158a04ff None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:22.134634 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 298/581] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:21 2022] GET /identity/v3/role_assignments?user.id=bf9c39de29324b0ca6329c9a171367c4&scope.project.id=80e309a3b3784ba9943734a41949b222&role.id=17fa92022f834aa5bf5cb9e3a506a478 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:22.135409 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9f994-485d-49fc-b3de-e4a93eed4e45 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:22.146625 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 284/582] 10.222.0.85 () {56 vars in 1103 bytes} [Thu Jun 16 14:43:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:22.146625 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5b9d3-a41f-4cbd-b26f-91d4158a04ff None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:22.195638 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:22.252804 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9f994-485d-49fc-b3de-e4a93eed4e45 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:22.266025 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5b9d3-a41f-4cbd-b26f-91d4158a04ff None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:22.295823 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4145f4-73ab-4068-9082-31c7b84c083f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:22.296820 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4145f4-73ab-4068-9082-31c7b84c083f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:22.296820 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4145f4-73ab-4068-9082-31c7b84c083f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:22.297419 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4145f4-73ab-4068-9082-31c7b84c083f None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:22.298204 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4145f4-73ab-4068-9082-31c7b84c083f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:22.298513 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4145f4-73ab-4068-9082-31c7b84c083f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:22.299947 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4145f4-73ab-4068-9082-31c7b84c083f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:22.309976 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c49fb-35e6-4431-9059-05224787e40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:22.310672 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c49fb-35e6-4431-9059-05224787e40c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:22.310948 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c49fb-35e6-4431-9059-05224787e40c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:22.311223 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c49fb-35e6-4431-9059-05224787e40c None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:22.312109 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c49fb-35e6-4431-9059-05224787e40c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:22.312421 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c49fb-35e6-4431-9059-05224787e40c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:22.320052 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c49fb-35e6-4431-9059-05224787e40c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:22.322955 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 299/583] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:22.323961 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4145f4-73ab-4068-9082-31c7b84c083f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:22.336661 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 285/584] 10.222.0.85 () {56 vars in 1137 bytes} [Thu Jun 16 14:43:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:22.337799 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c49fb-35e6-4431-9059-05224787e40c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:22.395321 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:22.454501 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4145f4-73ab-4068-9082-31c7b84c083f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:22.455132 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c49fb-35e6-4431-9059-05224787e40c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:22.469456 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:22.492368 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3ab8d-827a-4e58-8aae-7b03ed99f4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:22.493183 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3ab8d-827a-4e58-8aae-7b03ed99f4ef None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:22.493404 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812c7b4-5d0a-49cc-859c-597b4a201544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:22.493516 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3ab8d-827a-4e58-8aae-7b03ed99f4ef None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:22.493791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3ab8d-827a-4e58-8aae-7b03ed99f4ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:22.494492 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812c7b4-5d0a-49cc-859c-597b4a201544 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:22.494609 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812c7b4-5d0a-49cc-859c-597b4a201544 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:22.494850 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812c7b4-5d0a-49cc-859c-597b4a201544 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:22.495642 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812c7b4-5d0a-49cc-859c-597b4a201544 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:22.495982 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812c7b4-5d0a-49cc-859c-597b4a201544 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:22.497429 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812c7b4-5d0a-49cc-859c-597b4a201544 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:22.505098 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3ab8d-827a-4e58-8aae-7b03ed99f4ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:22.506567 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3ab8d-827a-4e58-8aae-7b03ed99f4ef None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:22.510137 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 300/585] 10.222.0.85 () {56 vars in 1148 bytes} [Thu Jun 16 14:43:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:22.511244 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812c7b4-5d0a-49cc-859c-597b4a201544 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:22.526136 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-10b3ab8d-827a-4e58-8aae-7b03ed99f4ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:22.526136 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:22.526136 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:22.526136 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:22.526136 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:22.526136 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:22.526136 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:22.526136 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:22.526136 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:22.526136 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:22.526136 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:22.526136 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:22.526136 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:22.526136 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:22.526136 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:22.527065 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:22.527065 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:22.527065 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:22.527065 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:22.527065 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:22.527065 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:22.527065 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:22.527065 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:22.527065 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:22.527065 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:22.527065 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:22.527065 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:22.527065 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:22.527065 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:22.527065 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:22.527065 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:22.527065 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:22.532647 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:22.532647 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:22.532647 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:22.532647 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:22.532647 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 286/586] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:22.532647 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3ab8d-827a-4e58-8aae-7b03ed99f4ef None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:22.626905 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812c7b4-5d0a-49cc-859c-597b4a201544 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:22.648625 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:22.654301 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3ab8d-827a-4e58-8aae-7b03ed99f4ef None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:22.663716 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529fa750-4a56-46b5-9034-f76867c8a7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:22.664687 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fa750-4a56-46b5-9034-f76867c8a7e4 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:22.665175 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fa750-4a56-46b5-9034-f76867c8a7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:22.665284 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fa750-4a56-46b5-9034-f76867c8a7e4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:22.674697 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529fa750-4a56-46b5-9034-f76867c8a7e4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:22.676168 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529fa750-4a56-46b5-9034-f76867c8a7e4 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:22.691108 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ae01d-364d-419f-850e-3e2834bb938d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:22.691928 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ae01d-364d-419f-850e-3e2834bb938d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:22.692205 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ae01d-364d-419f-850e-3e2834bb938d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:22.692308 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-529fa750-4a56-46b5-9034-f76867c8a7e4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 14:43:22.692308 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:22.692308 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:22.692308 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:22.692308 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:22.692308 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:22.692308 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:22.692308 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:22.692308 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:22.692308 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:22.692308 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:22.692308 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:22.692308 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:43:22.692308 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:43:22.692308 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:43:22.692308 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:43:22.693191 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:22.693191 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:22.693191 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:43:22.693191 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:22.693191 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:43:22.693191 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:22.693191 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:22.693191 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:22.693191 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:22.693191 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:22.693191 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:22.693191 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:22.693191 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:22.693191 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:22.693191 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:22.693191 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:22.693191 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:22.693191 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:22.694147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:22.694147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:22.694147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:43:22.694147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:43:22.694147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:43:22.694147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:43:22.694147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:43:22.694147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:43:22.694147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 14:43:22.694147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:22.694673 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ae01d-364d-419f-850e-3e2834bb938d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:22.694742 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 301/587] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:22.694808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529fa750-4a56-46b5-9034-f76867c8a7e4 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:22.707995 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ae01d-364d-419f-850e-3e2834bb938d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:22.709471 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ae01d-364d-419f-850e-3e2834bb938d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:22.726878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-f14ae01d-364d-419f-850e-3e2834bb938d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:22.726878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:22.726878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:22.726878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:22.726878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:22.726878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:22.726878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:22.726878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:22.726878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:22.726878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:22.726878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:22.726878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:22.726878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:22.726878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:22.726878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:22.727780 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:22.727780 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:22.727780 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:22.727780 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:22.727780 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:22.727780 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:22.727780 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:22.727780 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:22.727780 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:22.727780 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:22.727780 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:22.727780 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:22.727780 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:22.727780 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:22.727780 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:22.727780 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:22.727780 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:22.729136 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:22.729136 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:22.729136 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:22.729136 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:22.729136 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 287/588] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:22.729136 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ae01d-364d-419f-850e-3e2834bb938d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:22.734303 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:22.812972 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529fa750-4a56-46b5-9034-f76867c8a7e4 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:22.840695 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ae01d-364d-419f-850e-3e2834bb938d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:22.848600 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a31aa9-32a9-4530-9489-d6c81eb2360e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:22.849493 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a31aa9-32a9-4530-9489-d6c81eb2360e None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:22.849804 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a31aa9-32a9-4530-9489-d6c81eb2360e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:22.850023 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a31aa9-32a9-4530-9489-d6c81eb2360e None admin] PATH_INFO: `/v3/projects/80e309a3b3784ba9943734a41949b222/users/c74e4d1bdaa64ed280cc5f4c8e79b842/roles/17fa92022f834aa5bf5cb9e3a506a478` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:22.867148 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a31aa9-32a9-4530-9489-d6c81eb2360e None admin] RBAC: Authorizing `identity:create_grant(project_id=80e309a3b3784ba9943734a41949b222, user_id=c74e4d1bdaa64ed280cc5f4c8e79b842, role_id=17fa92022f834aa5bf5cb9e3a506a478)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:22.868944 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a31aa9-32a9-4530-9489-d6c81eb2360e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:22.878341 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ebfd6d-8496-4ae4-b2ed-9911a0305fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:22.879018 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebfd6d-8496-4ae4-b2ed-9911a0305fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:22.879301 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebfd6d-8496-4ae4-b2ed-9911a0305fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:22.879576 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebfd6d-8496-4ae4-b2ed-9911a0305fd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:22.880340 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ebfd6d-8496-4ae4-b2ed-9911a0305fd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:22.880644 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ebfd6d-8496-4ae4-b2ed-9911a0305fd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:22.882017 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ebfd6d-8496-4ae4-b2ed-9911a0305fd5 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:22.883327 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 302/589] 10.222.0.85 () {58 vars in 1439 bytes} [Thu Jun 16 14:43:22 2022] PUT /identity/v3/projects/80e309a3b3784ba9943734a41949b222/users/c74e4d1bdaa64ed280cc5f4c8e79b842/roles/17fa92022f834aa5bf5cb9e3a506a478 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:43:22.888960 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a31aa9-32a9-4530-9489-d6c81eb2360e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:22.900326 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 288/590] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:22.900326 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ebfd6d-8496-4ae4-b2ed-9911a0305fd5 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:22.915788 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:22.997940 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:23.018433 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ebfd6d-8496-4ae4-b2ed-9911a0305fd5 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:23.024645 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a31aa9-32a9-4530-9489-d6c81eb2360e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:23.058910 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafad672-4c14-478b-be8c-9640ef4425f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:23.059597 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafad672-4c14-478b-be8c-9640ef4425f6 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:23.059897 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafad672-4c14-478b-be8c-9640ef4425f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:23.060186 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafad672-4c14-478b-be8c-9640ef4425f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:23.060973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafad672-4c14-478b-be8c-9640ef4425f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:23.061224 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafad672-4c14-478b-be8c-9640ef4425f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:23.062638 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafad672-4c14-478b-be8c-9640ef4425f6 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:23.067268 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d8009-6786-4220-9052-06a52a9b4b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:23.068167 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d8009-6786-4220-9052-06a52a9b4b11 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:23.068452 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d8009-6786-4220-9052-06a52a9b4b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:23.068736 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d8009-6786-4220-9052-06a52a9b4b11 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:23.069583 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d8009-6786-4220-9052-06a52a9b4b11 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:23.069892 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d8009-6786-4220-9052-06a52a9b4b11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:23.071369 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d8009-6786-4220-9052-06a52a9b4b11 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:23.076053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 289/591] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:23.076912 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafad672-4c14-478b-be8c-9640ef4425f6 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:23.091182 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 303/592] 10.222.0.85 () {56 vars in 1137 bytes} [Thu Jun 16 14:43:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:23.092076 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d8009-6786-4220-9052-06a52a9b4b11 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:23.149188 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:23.181683 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafad672-4c14-478b-be8c-9640ef4425f6 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:23.219744 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a69434-1356-4ae2-aec7-c4f1a6226f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:23.220608 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a69434-1356-4ae2-aec7-c4f1a6226f2c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:23.220891 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a69434-1356-4ae2-aec7-c4f1a6226f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:23.221332 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a69434-1356-4ae2-aec7-c4f1a6226f2c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:23.229092 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a69434-1356-4ae2-aec7-c4f1a6226f2c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:23.230685 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a69434-1356-4ae2-aec7-c4f1a6226f2c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:23.233792 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d8009-6786-4220-9052-06a52a9b4b11 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:23.245983 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-60a69434-1356-4ae2-aec7-c4f1a6226f2c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 14:43:23.245983 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:23.245983 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:23.245983 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:23.245983 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:23.245983 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:23.245983 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:23.245983 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:23.245983 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:23.245983 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:23.245983 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:23.245983 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:23.245983 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:43:23.245983 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:43:23.245983 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:43:23.245983 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:43:23.247003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:23.247003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:23.247003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:43:23.247003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:23.247003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:43:23.247003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:23.247003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:23.247003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:23.247003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:23.247003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:23.247003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:23.247003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:23.247003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:23.247003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:23.247003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:23.247003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:23.247003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:23.247003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:23.248601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:23.248601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:23.248601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:43:23.248601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:43:23.248601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:43:23.248601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:43:23.248601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:43:23.248601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:43:23.248601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 14:43:23.248601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:23.248601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 290/593] 10.222.0.85 () {56 vars in 1102 bytes} [Thu Jun 16 14:43:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:23.248601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a69434-1356-4ae2-aec7-c4f1a6226f2c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:23.277079 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2ccdc-345f-4a72-8909-8f0ef1a814ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:23.278416 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2ccdc-345f-4a72-8909-8f0ef1a814ca None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:23.278947 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2ccdc-345f-4a72-8909-8f0ef1a814ca None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:23.279447 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2ccdc-345f-4a72-8909-8f0ef1a814ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:23.287310 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2ccdc-345f-4a72-8909-8f0ef1a814ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:23.289089 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2ccdc-345f-4a72-8909-8f0ef1a814ca None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:23.304844 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-55b2ccdc-345f-4a72-8909-8f0ef1a814ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:23.304844 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:23.304844 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:23.304844 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:23.304844 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:23.304844 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:23.304844 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:23.304844 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:23.304844 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:23.304844 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:23.304844 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:23.304844 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:23.304844 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:43:23.304844 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:43:23.304844 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:43:23.305803 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:43:23.305803 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:23.305803 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:23.305803 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:23.305803 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:23.305803 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:23.305803 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:23.305803 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:23.305803 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:23.305803 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:23.305803 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:23.305803 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:23.305803 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:23.305803 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:23.305803 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:23.305803 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:23.305803 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:23.307448 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:43:23.307448 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:43:23.307448 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:43:23.307448 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:43:23.307448 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:43:23.307448 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:43:23.307448 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:23.307448 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:23.312086 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:23.314902 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 304/594] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:23.315921 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2ccdc-345f-4a72-8909-8f0ef1a814ca None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:23.355911 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a69434-1356-4ae2-aec7-c4f1a6226f2c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:23.385891 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:23.393177 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462b078-7efa-4bd9-9f1d-1b433daa9b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:23.394007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462b078-7efa-4bd9-9f1d-1b433daa9b0b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:23.394285 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462b078-7efa-4bd9-9f1d-1b433daa9b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:23.394559 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462b078-7efa-4bd9-9f1d-1b433daa9b0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:23.409159 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462b078-7efa-4bd9-9f1d-1b433daa9b0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:23.410808 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462b078-7efa-4bd9-9f1d-1b433daa9b0b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:23.425437 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2ccdc-345f-4a72-8909-8f0ef1a814ca None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:23.430938 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-d462b078-7efa-4bd9-9f1d-1b433daa9b0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:23.430938 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:23.430938 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:23.430938 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:23.430938 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:23.430938 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:23.430938 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:23.430938 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:23.430938 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:23.430938 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:23.430938 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:23.430938 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:23.430938 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:23.430938 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:23.430938 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:23.432246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:23.432246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:23.432246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:23.432246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:23.432246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:23.432246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:23.432246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:23.432246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:23.432246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:23.432246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:23.432246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:23.432246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:23.432246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:23.432246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:23.432246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:23.432246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:23.432246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:23.433713 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:23.433713 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:23.433713 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:23.433713 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:23.433713 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 291/595] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:23.433713 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462b078-7efa-4bd9-9f1d-1b433daa9b0b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:23.464460 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bcb040-b4dd-4ee0-b45a-28d82638e57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:23.465496 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcb040-b4dd-4ee0-b45a-28d82638e57b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:23.465978 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcb040-b4dd-4ee0-b45a-28d82638e57b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:23.466450 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcb040-b4dd-4ee0-b45a-28d82638e57b None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:23.467507 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bcb040-b4dd-4ee0-b45a-28d82638e57b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:23.468044 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bcb040-b4dd-4ee0-b45a-28d82638e57b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:23.469787 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bcb040-b4dd-4ee0-b45a-28d82638e57b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:23.488330 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 305/596] 10.222.0.85 () {56 vars in 1139 bytes} [Thu Jun 16 14:43:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:23.489525 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bcb040-b4dd-4ee0-b45a-28d82638e57b None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:23.547817 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462b078-7efa-4bd9-9f1d-1b433daa9b0b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:23.548895 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:23.593129 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bcb040-b4dd-4ee0-b45a-28d82638e57b None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:23.593801 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98045c5a-ef5c-425c-ad29-865f9bc4c89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:23.594479 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98045c5a-ef5c-425c-ad29-865f9bc4c89b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:23.594808 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98045c5a-ef5c-425c-ad29-865f9bc4c89b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:23.595089 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98045c5a-ef5c-425c-ad29-865f9bc4c89b None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:23.595999 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98045c5a-ef5c-425c-ad29-865f9bc4c89b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:23.596312 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98045c5a-ef5c-425c-ad29-865f9bc4c89b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:23.597951 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98045c5a-ef5c-425c-ad29-865f9bc4c89b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:23.616174 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 292/597] 10.222.0.85 () {56 vars in 1148 bytes} [Thu Jun 16 14:43:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:23.616174 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98045c5a-ef5c-425c-ad29-865f9bc4c89b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:23.640749 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061422d-b2b3-4610-b495-8685c7c68d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:23.641478 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061422d-b2b3-4610-b495-8685c7c68d13 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:23.641891 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061422d-b2b3-4610-b495-8685c7c68d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:23.642291 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061422d-b2b3-4610-b495-8685c7c68d13 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:23.643085 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061422d-b2b3-4610-b495-8685c7c68d13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:23.643397 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061422d-b2b3-4610-b495-8685c7c68d13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:23.645301 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061422d-b2b3-4610-b495-8685c7c68d13 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:23.661123 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 306/598] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:23.662296 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061422d-b2b3-4610-b495-8685c7c68d13 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:23.676434 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:23.747290 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98045c5a-ef5c-425c-ad29-865f9bc4c89b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:23.783966 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b03d1-b265-4c2a-8bc5-a8aca03da787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:23.784777 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b03d1-b265-4c2a-8bc5-a8aca03da787 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:23.785059 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b03d1-b265-4c2a-8bc5-a8aca03da787 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:23.785329 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b03d1-b265-4c2a-8bc5-a8aca03da787 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:23.797503 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b03d1-b265-4c2a-8bc5-a8aca03da787 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:23.799019 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b03d1-b265-4c2a-8bc5-a8aca03da787 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:23.802270 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061422d-b2b3-4610-b495-8685c7c68d13 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:23.817243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-647b03d1-b265-4c2a-8bc5-a8aca03da787 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:23.817243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:23.817243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:23.817243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:23.817243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:23.817243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:23.817243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:23.817243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:23.817243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:23.817243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:23.817243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:23.817243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:23.817243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:23.817243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:23.817243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:23.818217 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:23.818217 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:23.818217 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:23.818217 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:23.818217 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:23.818217 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:23.818217 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:23.818217 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:23.818217 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:23.818217 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:23.818217 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:23.818217 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:23.818217 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:23.818217 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:23.818217 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:23.818217 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:23.818217 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:23.819785 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:23.819785 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:23.819785 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:23.819785 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:23.819785 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 293/599] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:23.819785 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b03d1-b265-4c2a-8bc5-a8aca03da787 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:23.826257 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:23.845707 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe5435-530a-4ee3-9a8b-c9e6d12d7d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:23.846606 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe5435-530a-4ee3-9a8b-c9e6d12d7d29 None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:23.846887 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe5435-530a-4ee3-9a8b-c9e6d12d7d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:23.847163 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe5435-530a-4ee3-9a8b-c9e6d12d7d29 None admin] PATH_INFO: `/v3/projects/80e309a3b3784ba9943734a41949b222/users/1d0ac98d9520470483c348644566d9ea/roles/17fa92022f834aa5bf5cb9e3a506a478` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:23.863601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe5435-530a-4ee3-9a8b-c9e6d12d7d29 None admin] RBAC: Authorizing `identity:create_grant(project_id=80e309a3b3784ba9943734a41949b222, user_id=1d0ac98d9520470483c348644566d9ea, role_id=17fa92022f834aa5bf5cb9e3a506a478)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:23.865116 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe5435-530a-4ee3-9a8b-c9e6d12d7d29 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:23.883911 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 307/600] 10.222.0.85 () {58 vars in 1439 bytes} [Thu Jun 16 14:43:23 2022] PUT /identity/v3/projects/80e309a3b3784ba9943734a41949b222/users/1d0ac98d9520470483c348644566d9ea/roles/17fa92022f834aa5bf5cb9e3a506a478 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:43:23.883911 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe5435-530a-4ee3-9a8b-c9e6d12d7d29 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:23.958159 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:23.974658 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b03d1-b265-4c2a-8bc5-a8aca03da787 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:23.991355 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe5435-530a-4ee3-9a8b-c9e6d12d7d29 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:24.028525 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85416da-f1fd-4035-b7a4-05ced179af55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:24.029154 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85416da-f1fd-4035-b7a4-05ced179af55 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:24.029355 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85416da-f1fd-4035-b7a4-05ced179af55 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:24.029690 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85416da-f1fd-4035-b7a4-05ced179af55 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:24.030996 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85416da-f1fd-4035-b7a4-05ced179af55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:24.030996 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85416da-f1fd-4035-b7a4-05ced179af55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:24.032270 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85416da-f1fd-4035-b7a4-05ced179af55 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:24.037120 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d22531-ce6b-4389-9c13-0d2ea241c5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:24.038301 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d22531-ce6b-4389-9c13-0d2ea241c5fd None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:24.038782 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d22531-ce6b-4389-9c13-0d2ea241c5fd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:24.039253 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d22531-ce6b-4389-9c13-0d2ea241c5fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:24.047668 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 308/601] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:24.052776 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d22531-ce6b-4389-9c13-0d2ea241c5fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:24.054587 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d22531-ce6b-4389-9c13-0d2ea241c5fd None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:24.056746 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85416da-f1fd-4035-b7a4-05ced179af55 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:24.086030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-d5d22531-ce6b-4389-9c13-0d2ea241c5fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:24.086030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:24.086030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:24.086030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:24.086030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:24.086030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:24.086030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:24.086030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:24.086030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:24.086030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:24.086030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:24.086030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:24.086030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:43:24.086030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:43:24.086030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:43:24.087022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:43:24.087022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:24.087022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:24.087022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:24.087022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:24.087022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:24.087022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:24.087022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:24.087022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:24.087022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:24.087022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:24.087022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:24.087022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:24.087022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:24.087022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:24.087022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:24.087022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:24.088019 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:43:24.088019 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:43:24.088019 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:43:24.088019 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:43:24.088019 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:43:24.088019 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:43:24.088019 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:24.088019 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:24.092205 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 294/602] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:24.101020 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d22531-ce6b-4389-9c13-0d2ea241c5fd None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:24.133557 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:24.246031 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85416da-f1fd-4035-b7a4-05ced179af55 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:24.278885 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d22531-ce6b-4389-9c13-0d2ea241c5fd None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:24.288029 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb1e6a-4c2a-4d58-afd3-491fea6b2651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:24.288915 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb1e6a-4c2a-4d58-afd3-491fea6b2651 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:24.289270 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb1e6a-4c2a-4d58-afd3-491fea6b2651 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:24.289610 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb1e6a-4c2a-4d58-afd3-491fea6b2651 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:24.297541 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb1e6a-4c2a-4d58-afd3-491fea6b2651 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:24.299761 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb1e6a-4c2a-4d58-afd3-491fea6b2651 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:24.314277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-aadb1e6a-4c2a-4d58-afd3-491fea6b2651 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:24.314277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:24.314277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:24.314277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:24.314277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:24.314277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:24.314277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:24.314277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:24.314277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:24.314277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:24.314277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:24.314277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:24.314277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:43:24.314277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:43:24.314277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:43:24.315181 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:43:24.315181 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:24.315181 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:24.315181 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:24.315181 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:24.315181 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:24.315181 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:24.315181 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:24.315181 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:24.315181 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:24.315181 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:24.315181 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:24.315181 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:24.315181 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:24.315181 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:24.315181 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:24.315181 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:24.316099 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:43:24.316099 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:43:24.316099 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:43:24.316099 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:43:24.316099 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:43:24.316099 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:43:24.316099 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:24.316099 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:24.316099 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 309/603] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:24.317177 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376bdd2-c37d-4f83-bb7f-3ea1651eb0f2 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:24.317463 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376bdd2-c37d-4f83-bb7f-3ea1651eb0f2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:24.317736 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376bdd2-c37d-4f83-bb7f-3ea1651eb0f2 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:24.319216 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 310/604] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:24.323318 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c30cd1-5187-4315-82de-42550e1463ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:24.324309 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c30cd1-5187-4315-82de-42550e1463ba None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:24.324439 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376bdd2-c37d-4f83-bb7f-3ea1651eb0f2 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:24.324911 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c30cd1-5187-4315-82de-42550e1463ba None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:24.325379 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c30cd1-5187-4315-82de-42550e1463ba None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:24.326370 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c30cd1-5187-4315-82de-42550e1463ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:24.327177 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c30cd1-5187-4315-82de-42550e1463ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:24.329885 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c30cd1-5187-4315-82de-42550e1463ba None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:24.342772 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 295/605] 10.222.0.85 () {56 vars in 1148 bytes} [Thu Jun 16 14:43:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:24.344197 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ca991-a169-4fdd-8de6-97d8e48be270 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:24.344483 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ca991-a169-4fdd-8de6-97d8e48be270 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:24.344754 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ca991-a169-4fdd-8de6-97d8e48be270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:24.362368 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-602ca991-a169-4fdd-8de6-97d8e48be270 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:24.364655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-602ca991-a169-4fdd-8de6-97d8e48be270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:24.375331 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:24.426835 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:24.442763 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376bdd2-c37d-4f83-bb7f-3ea1651eb0f2 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:24.456761 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 296/606] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:24.457940 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ca991-a169-4fdd-8de6-97d8e48be270 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:24.501124 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d73c09-07f0-463d-a526-0b69d2569a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:24.501790 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d73c09-07f0-463d-a526-0b69d2569a09 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:24.502069 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d73c09-07f0-463d-a526-0b69d2569a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:24.502397 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d73c09-07f0-463d-a526-0b69d2569a09 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:24.503191 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d73c09-07f0-463d-a526-0b69d2569a09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:24.503601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d73c09-07f0-463d-a526-0b69d2569a09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:24.505102 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d73c09-07f0-463d-a526-0b69d2569a09 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:24.519792 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 311/607] 10.222.0.85 () {56 vars in 1148 bytes} [Thu Jun 16 14:43:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:24.520962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d73c09-07f0-463d-a526-0b69d2569a09 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:24.573279 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ca991-a169-4fdd-8de6-97d8e48be270 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:24.622937 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce16f4c-1ef3-4e39-9af1-99786b5b9f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:24.624741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce16f4c-1ef3-4e39-9af1-99786b5b9f68 None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:24.625201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce16f4c-1ef3-4e39-9af1-99786b5b9f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:24.625643 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce16f4c-1ef3-4e39-9af1-99786b5b9f68 None admin] PATH_INFO: `/v3/projects/80e309a3b3784ba9943734a41949b222/users/5819a7d47f644bc18e6d07a125826d76/roles/17fa92022f834aa5bf5cb9e3a506a478` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:24.647089 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce16f4c-1ef3-4e39-9af1-99786b5b9f68 None admin] RBAC: Authorizing `identity:create_grant(project_id=80e309a3b3784ba9943734a41949b222, user_id=5819a7d47f644bc18e6d07a125826d76, role_id=17fa92022f834aa5bf5cb9e3a506a478)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:24.648836 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce16f4c-1ef3-4e39-9af1-99786b5b9f68 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:24.648954 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d73c09-07f0-463d-a526-0b69d2569a09 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:24.653108 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:24.674707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 297/608] 10.222.0.85 () {58 vars in 1439 bytes} [Thu Jun 16 14:43:24 2022] PUT /identity/v3/projects/80e309a3b3784ba9943734a41949b222/users/5819a7d47f644bc18e6d07a125826d76/roles/17fa92022f834aa5bf5cb9e3a506a478 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:43:24.676355 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce16f4c-1ef3-4e39-9af1-99786b5b9f68 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:24.691527 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2882b-08db-4b93-9719-56da2ee9f4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:24.692382 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2882b-08db-4b93-9719-56da2ee9f4e6 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:24.692971 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2882b-08db-4b93-9719-56da2ee9f4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:24.692971 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2882b-08db-4b93-9719-56da2ee9f4e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:24.705528 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e2882b-08db-4b93-9719-56da2ee9f4e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:24.713808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-91e2882b-08db-4b93-9719-56da2ee9f4e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:24.713808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:24.713808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:24.713808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:24.713808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:24.713808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:24.713808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:24.713808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:24.713808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:24.713808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:24.713808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:24.713808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:24.713808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:24.713808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:24.713808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:24.713808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:24.714963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:24.714963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:24.714963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:24.714963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:24.714963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:24.714963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:24.714963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:24.714963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:24.714963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:24.714963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:24.714963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:24.714963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:24.714963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:24.714963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:24.714963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:24.714963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:24.715795 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:24.715795 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:24.715795 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:24.715795 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:24.715795 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:24.715795 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:24.715795 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:24.715795 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:24.715795 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:24.715795 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:24.715795 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:24.715795 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:24.719864 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 312/609] 10.222.0.85 () {56 vars in 1102 bytes} [Thu Jun 16 14:43:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:24.721421 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2882b-08db-4b93-9719-56da2ee9f4e6 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:24.734584 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:24.803499 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce16f4c-1ef3-4e39-9af1-99786b5b9f68 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:24.833839 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2882b-08db-4b93-9719-56da2ee9f4e6 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:24.842963 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a1aec-455e-4556-9670-3feb6bc7d075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:24.844313 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a1aec-455e-4556-9670-3feb6bc7d075 None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:24.844852 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a1aec-455e-4556-9670-3feb6bc7d075 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:24.845327 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a1aec-455e-4556-9670-3feb6bc7d075 None admin] PATH_INFO: `/v3/projects/80e309a3b3784ba9943734a41949b222/users/3d3d59fabcf94718bbc005519cec6f6c/roles/17fa92022f834aa5bf5cb9e3a506a478` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:24.862692 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a1aec-455e-4556-9670-3feb6bc7d075 None admin] RBAC: Authorizing `identity:create_grant(project_id=80e309a3b3784ba9943734a41949b222, user_id=3d3d59fabcf94718bbc005519cec6f6c, role_id=17fa92022f834aa5bf5cb9e3a506a478)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:24.864662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a1aec-455e-4556-9670-3feb6bc7d075 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:24.873170 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af365d13-a81b-48da-a238-2e3699b0eb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:24.873794 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af365d13-a81b-48da-a238-2e3699b0eb90 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:24.874123 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af365d13-a81b-48da-a238-2e3699b0eb90 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:24.874385 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af365d13-a81b-48da-a238-2e3699b0eb90 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:24.875194 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af365d13-a81b-48da-a238-2e3699b0eb90 None admin] RBAC: Adding query filter params (name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:24.875509 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af365d13-a81b-48da-a238-2e3699b0eb90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:24.876951 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af365d13-a81b-48da-a238-2e3699b0eb90 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:24.882532 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 298/610] 10.222.0.85 () {58 vars in 1439 bytes} [Thu Jun 16 14:43:24 2022] PUT /identity/v3/projects/80e309a3b3784ba9943734a41949b222/users/3d3d59fabcf94718bbc005519cec6f6c/roles/17fa92022f834aa5bf5cb9e3a506a478 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:43:24.891718 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 313/611] 10.222.0.85 () {56 vars in 1103 bytes} [Thu Jun 16 14:43:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:24.893241 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a1aec-455e-4556-9670-3feb6bc7d075 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:24.967320 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:25.035097 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a1aec-455e-4556-9670-3feb6bc7d075 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:25.078665 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d2516-491c-4ad5-82d9-194a0672e46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:25.079497 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d2516-491c-4ad5-82d9-194a0672e46c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:25.079778 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d2516-491c-4ad5-82d9-194a0672e46c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:25.080127 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d2516-491c-4ad5-82d9-194a0672e46c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:25.092045 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d2516-491c-4ad5-82d9-194a0672e46c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:25.093465 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d2516-491c-4ad5-82d9-194a0672e46c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:25.112872 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-ea5d2516-491c-4ad5-82d9-194a0672e46c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:25.112872 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:25.112872 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:25.112872 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:25.112872 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:25.112872 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:25.112872 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:25.112872 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:25.112872 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:25.112872 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:25.112872 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:25.112872 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:25.112872 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:25.112872 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:25.112872 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:25.113861 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:25.113861 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:25.113861 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:25.113861 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:25.113861 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:25.113861 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:25.113861 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:25.113861 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:25.113861 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:25.113861 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:25.113861 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:25.113861 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:25.113861 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:25.113861 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:25.113861 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:25.113861 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:25.113861 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:25.114752 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:25.114752 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:25.114752 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:25.114752 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:25.118874 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 299/612] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:25.120351 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af365d13-a81b-48da-a238-2e3699b0eb90 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:25.199363 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:25.237490 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af365d13-a81b-48da-a238-2e3699b0eb90 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:25.275643 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067457cd-9bb5-4368-9936-6545c85286d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:25.276566 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067457cd-9bb5-4368-9936-6545c85286d0 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:25.276946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067457cd-9bb5-4368-9936-6545c85286d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:25.277341 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067457cd-9bb5-4368-9936-6545c85286d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:25.278173 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067457cd-9bb5-4368-9936-6545c85286d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:25.278575 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067457cd-9bb5-4368-9936-6545c85286d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:25.280076 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067457cd-9bb5-4368-9936-6545c85286d0 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:25.296245 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 314/613] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:25.299065 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d2516-491c-4ad5-82d9-194a0672e46c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:25.394692 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab06b77-f967-4ab9-bcc7-1bff8e2bea27 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:25.395051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab06b77-f967-4ab9-bcc7-1bff8e2bea27 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:25.395420 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab06b77-f967-4ab9-bcc7-1bff8e2bea27 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:25.397240 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 315/614] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:25.402810 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdd9be-bb48-41d2-b1cf-8ffc8f83b517 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:25.403236 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdd9be-bb48-41d2-b1cf-8ffc8f83b517 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:25.403593 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdd9be-bb48-41d2-b1cf-8ffc8f83b517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:25.412262 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:25.418859 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d2516-491c-4ad5-82d9-194a0672e46c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:25.421770 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-68cdd9be-bb48-41d2-b1cf-8ffc8f83b517 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:25.423605 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-68cdd9be-bb48-41d2-b1cf-8ffc8f83b517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:25.467400 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346fe70-558f-46e0-8156-886d01fe1dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:25.468270 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346fe70-558f-46e0-8156-886d01fe1dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:25.468557 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346fe70-558f-46e0-8156-886d01fe1dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:25.468832 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346fe70-558f-46e0-8156-886d01fe1dc3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:25.479913 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0346fe70-558f-46e0-8156-886d01fe1dc3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:25.481423 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0346fe70-558f-46e0-8156-886d01fe1dc3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:25.496821 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 316/615] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:43:25.510383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-0346fe70-558f-46e0-8156-886d01fe1dc3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 14:43:25.510383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:25.510383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:25.510383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:25.510383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:25.510383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:25.510383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:25.510383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:25.510383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:25.510383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:25.510383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:25.510383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:25.510383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:43:25.510383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:43:25.510383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:43:25.510383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:43:25.511491 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:25.511491 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:25.511491 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:43:25.511491 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:25.511491 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:43:25.511491 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:25.511491 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:25.511491 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:25.511491 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:25.511491 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:25.511491 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:25.511491 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:25.511491 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:25.511491 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:25.511491 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:25.511491 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:25.511491 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:25.511491 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:25.512492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:25.512492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:25.512492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:43:25.512492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:43:25.512492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:43:25.512492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:43:25.512492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:43:25.512492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:43:25.512492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 14:43:25.512492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:25.515102 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 300/616] 10.222.0.85 () {56 vars in 1096 bytes} [Thu Jun 16 14:43:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:25.520637 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdd9be-bb48-41d2-b1cf-8ffc8f83b517 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:25.525252 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346fe70-558f-46e0-8156-886d01fe1dc3 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:25.592236 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:25.674254 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdd9be-bb48-41d2-b1cf-8ffc8f83b517 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:25.707703 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346fe70-558f-46e0-8156-886d01fe1dc3 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:25.762589 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54207142-faba-4ef9-aa66-faa74d773e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:25.763413 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54207142-faba-4ef9-aa66-faa74d773e40 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:25.763699 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54207142-faba-4ef9-aa66-faa74d773e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:25.764003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54207142-faba-4ef9-aa66-faa74d773e40 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:25.765159 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a74dc-1d9f-4ef3-8d83-6cd22fabbf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:25.765839 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a74dc-1d9f-4ef3-8d83-6cd22fabbf1f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:25.766117 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a74dc-1d9f-4ef3-8d83-6cd22fabbf1f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:25.766389 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a74dc-1d9f-4ef3-8d83-6cd22fabbf1f None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:25.767236 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a74dc-1d9f-4ef3-8d83-6cd22fabbf1f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:25.767547 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a74dc-1d9f-4ef3-8d83-6cd22fabbf1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:25.770651 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a74dc-1d9f-4ef3-8d83-6cd22fabbf1f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:25.794140 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 317/617] 10.222.0.85 () {56 vars in 1135 bytes} [Thu Jun 16 14:43:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:25.795250 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54207142-faba-4ef9-aa66-faa74d773e40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:25.803431 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-54207142-faba-4ef9-aa66-faa74d773e40 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:25.803431 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:25.803431 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:25.803431 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:25.803431 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:25.803431 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:25.803431 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:25.803431 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:25.803431 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:25.803431 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:25.803431 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:25.803431 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:25.803431 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:25.803431 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:25.803431 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:25.803431 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:25.804419 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:25.804419 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:25.804419 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:25.804419 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:25.804419 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:25.804419 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:25.804419 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:25.804419 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:25.804419 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:25.804419 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:25.804419 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:25.804419 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:25.804419 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:25.804419 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:25.804419 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:25.804419 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:25.805269 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:25.805269 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:25.805269 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:25.805269 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:25.805269 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:25.805269 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:25.805269 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:25.805269 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:25.805269 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:25.805269 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:25.805269 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:25.805269 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:25.809724 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 301/618] 10.222.0.85 () {56 vars in 1102 bytes} [Thu Jun 16 14:43:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:43:25.815894 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a74dc-1d9f-4ef3-8d83-6cd22fabbf1f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:25.834524 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54207142-faba-4ef9-aa66-faa74d773e40 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:25.889894 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:25.930123 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a74dc-1d9f-4ef3-8d83-6cd22fabbf1f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:25.948921 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:25.968103 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb5b1f-9f6e-4553-8b89-99453b2ff0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:25.969444 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb5b1f-9f6e-4553-8b89-99453b2ff0b5 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:25.969964 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb5b1f-9f6e-4553-8b89-99453b2ff0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:25.970439 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb5b1f-9f6e-4553-8b89-99453b2ff0b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:25.982125 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb5b1f-9f6e-4553-8b89-99453b2ff0b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:25.983928 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb5b1f-9f6e-4553-8b89-99453b2ff0b5 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:26.003155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-38cb5b1f-9f6e-4553-8b89-99453b2ff0b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:26.003155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:26.003155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:26.003155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:26.003155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:26.003155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:26.003155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:26.003155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:26.003155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:26.003155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:26.003155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:26.003155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:26.003155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:26.003155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:26.003155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:26.004287 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:26.004287 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:26.004287 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:26.004287 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:26.004287 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:26.004287 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:26.004287 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:26.004287 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:26.004287 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:26.004287 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:26.004287 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:26.004287 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:26.004287 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:26.004287 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:26.004287 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:26.004287 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:26.004287 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:26.005199 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:26.005199 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:26.005199 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:26.005199 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:26.007526 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 318/619] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:26.017029 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb5b1f-9f6e-4553-8b89-99453b2ff0b5 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:26.046047 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54207142-faba-4ef9-aa66-faa74d773e40 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:26.117576 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096c219-8ce2-40db-b704-769b84bea66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:26.118277 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096c219-8ce2-40db-b704-769b84bea66d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:26.118646 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096c219-8ce2-40db-b704-769b84bea66d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:26.119541 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096c219-8ce2-40db-b704-769b84bea66d None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:26.120306 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3096c219-8ce2-40db-b704-769b84bea66d None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:26.120612 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3096c219-8ce2-40db-b704-769b84bea66d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:26.122058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3096c219-8ce2-40db-b704-769b84bea66d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:26.130484 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb5b1f-9f6e-4553-8b89-99453b2ff0b5 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:26.147248 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 302/620] 10.222.0.85 () {56 vars in 1103 bytes} [Thu Jun 16 14:43:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:26.165078 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096c219-8ce2-40db-b704-769b84bea66d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:26.174220 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801dce5-b79f-4d8a-b148-e296ca01da73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:26.175193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801dce5-b79f-4d8a-b148-e296ca01da73 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:26.175675 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801dce5-b79f-4d8a-b148-e296ca01da73 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:26.176171 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801dce5-b79f-4d8a-b148-e296ca01da73 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:26.177119 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b801dce5-b79f-4d8a-b148-e296ca01da73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:26.177635 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b801dce5-b79f-4d8a-b148-e296ca01da73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:26.179231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b801dce5-b79f-4d8a-b148-e296ca01da73 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:26.193708 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 319/621] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:26.201813 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801dce5-b79f-4d8a-b148-e296ca01da73 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:26.266399 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:26.312134 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:26.380929 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096c219-8ce2-40db-b704-769b84bea66d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:26.437100 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8624b-5490-4ff2-aeb0-e46f780021de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:26.437965 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8624b-5490-4ff2-aeb0-e46f780021de None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:26.438250 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8624b-5490-4ff2-aeb0-e46f780021de None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:26.438571 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8624b-5490-4ff2-aeb0-e46f780021de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:26.441819 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801dce5-b79f-4d8a-b148-e296ca01da73 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:26.450011 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd8624b-5490-4ff2-aeb0-e46f780021de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:26.451417 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd8624b-5490-4ff2-aeb0-e46f780021de None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:26.469191 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-cdd8624b-5490-4ff2-aeb0-e46f780021de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:26.469191 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:26.469191 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:26.469191 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:26.469191 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:26.469191 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:26.469191 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:26.469191 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:26.469191 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:26.469191 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:26.469191 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:26.469191 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:26.469191 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:26.469191 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:26.469191 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:26.470160 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:26.470160 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:26.470160 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:26.470160 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:26.470160 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:26.470160 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:26.470160 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:26.470160 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:26.470160 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:26.470160 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:26.470160 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:26.470160 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:26.470160 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:26.470160 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:26.470160 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:26.470160 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:26.470160 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:26.471069 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:26.471069 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:26.471069 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:26.471069 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:26.471069 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 303/622] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:26.479895 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8624b-5490-4ff2-aeb0-e46f780021de None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:26.523586 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a98d0-9b39-4e75-bc1f-107663653fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:26.524423 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a98d0-9b39-4e75-bc1f-107663653fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:26.524711 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a98d0-9b39-4e75-bc1f-107663653fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:26.525018 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a98d0-9b39-4e75-bc1f-107663653fa7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:26.538555 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a98d0-9b39-4e75-bc1f-107663653fa7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:26.540075 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a98d0-9b39-4e75-bc1f-107663653fa7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:26.576474 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-6c2a98d0-9b39-4e75-bc1f-107663653fa7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:26.576474 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:26.576474 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:26.576474 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:26.576474 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:26.576474 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:26.576474 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:26.576474 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:26.576474 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:26.576474 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:26.576474 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:26.576474 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:26.576474 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:43:26.576474 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:43:26.576474 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:43:26.577615 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:43:26.577615 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:26.577615 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:26.577615 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:26.577615 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:26.577615 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:26.577615 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:26.577615 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:26.577615 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:26.577615 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:26.577615 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:26.577615 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:26.577615 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:26.577615 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:26.577615 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:26.577615 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:26.577615 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:26.578693 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:43:26.578693 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:43:26.578693 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:43:26.578693 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:43:26.578693 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:43:26.578693 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:43:26.578693 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:26.578693 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:26.581142 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 320/623] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:26.583806 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a98d0-9b39-4e75-bc1f-107663653fa7 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:26.641246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8624b-5490-4ff2-aeb0-e46f780021de None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:26.680401 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06559f0a-9bc7-4200-acef-2f9dbd4bb186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:26.681274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06559f0a-9bc7-4200-acef-2f9dbd4bb186 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:26.681569 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06559f0a-9bc7-4200-acef-2f9dbd4bb186 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:26.681845 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06559f0a-9bc7-4200-acef-2f9dbd4bb186 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:26.682584 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06559f0a-9bc7-4200-acef-2f9dbd4bb186 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:26.682897 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06559f0a-9bc7-4200-acef-2f9dbd4bb186 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:26.685342 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06559f0a-9bc7-4200-acef-2f9dbd4bb186 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:26.696267 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:26.708605 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 304/624] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:26.710420 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62222cef-1288-4acf-ae51-d3e298108281 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:26.710713 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62222cef-1288-4acf-ae51-d3e298108281 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:26.710992 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62222cef-1288-4acf-ae51-d3e298108281 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:26.712787 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 305/625] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:26.713544 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62222cef-1288-4acf-ae51-d3e298108281 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:26.764207 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:26.778740 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a98d0-9b39-4e75-bc1f-107663653fa7 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:26.823606 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbd6d3-cd46-4d13-ba02-5b72d64423c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:26.824312 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbd6d3-cd46-4d13-ba02-5b72d64423c7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:26.824598 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbd6d3-cd46-4d13-ba02-5b72d64423c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:26.824865 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbd6d3-cd46-4d13-ba02-5b72d64423c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:26.826146 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbbd6d3-cd46-4d13-ba02-5b72d64423c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:26.826468 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbbd6d3-cd46-4d13-ba02-5b72d64423c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:26.828029 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbbd6d3-cd46-4d13-ba02-5b72d64423c7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:26.846903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 321/626] 10.222.0.85 () {56 vars in 1148 bytes} [Thu Jun 16 14:43:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:26.848312 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b6943-5321-4707-b965-737e8723eb2e None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:26.848602 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b6943-5321-4707-b965-737e8723eb2e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:26.848879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b6943-5321-4707-b965-737e8723eb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:26.872627 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-236b6943-5321-4707-b965-737e8723eb2e None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:26.874600 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-236b6943-5321-4707-b965-737e8723eb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:26.890196 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62222cef-1288-4acf-ae51-d3e298108281 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:26.936848 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c58ce-56a7-4c37-a780-abbe91bf4e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:26.938049 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c58ce-56a7-4c37-a780-abbe91bf4e6f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:26.938049 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c58ce-56a7-4c37-a780-abbe91bf4e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:26.938257 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c58ce-56a7-4c37-a780-abbe91bf4e6f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:26.947097 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c58ce-56a7-4c37-a780-abbe91bf4e6f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:26.949326 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c58ce-56a7-4c37-a780-abbe91bf4e6f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:26.955638 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 322/627] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:26.956918 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b6943-5321-4707-b965-737e8723eb2e None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:26.969662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-5e7c58ce-56a7-4c37-a780-abbe91bf4e6f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:43:26.969662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:26.969662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:26.969662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:26.969662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:26.969662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:26.969662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:26.969662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:26.969662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:26.969662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:26.969662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:26.969662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:26.969662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:43:26.969662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:43:26.969662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:43:26.969662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:43:26.970678 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:26.970678 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:26.970678 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:43:26.970678 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:26.970678 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:43:26.970678 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:26.970678 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:26.970678 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:26.970678 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:26.970678 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:26.970678 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:26.970678 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:26.970678 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:26.970678 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:26.970678 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:26.970678 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:26.970678 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:26.970678 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:26.971610 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:26.971610 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:26.971610 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:43:26.971610 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:43:26.971610 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:43:26.971610 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:43:26.971610 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:43:26.971610 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:43:26.971610 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:43:26.971610 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:26.971610 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 306/628] 10.222.0.85 () {56 vars in 1093 bytes} [Thu Jun 16 14:43:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:26.980586 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c58ce-56a7-4c37-a780-abbe91bf4e6f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:27.057599 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:27.068636 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:27.090590 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b6943-5321-4707-b965-737e8723eb2e None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:27.124292 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c58ce-56a7-4c37-a780-abbe91bf4e6f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:27.135710 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010a1e2-bccf-455c-8701-b54588a949d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:27.137556 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010a1e2-bccf-455c-8701-b54588a949d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:27.138160 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010a1e2-bccf-455c-8701-b54588a949d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:27.138620 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010a1e2-bccf-455c-8701-b54588a949d3 None admin] PATH_INFO: `/v3/projects/80e309a3b3784ba9943734a41949b222/users/bf9c39de29324b0ca6329c9a171367c4/roles/17fa92022f834aa5bf5cb9e3a506a478` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:27.160169 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010a1e2-bccf-455c-8701-b54588a949d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=80e309a3b3784ba9943734a41949b222, user_id=bf9c39de29324b0ca6329c9a171367c4, role_id=17fa92022f834aa5bf5cb9e3a506a478)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:27.162003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f830653-3aaa-4b22-a0c4-e7666d8ebc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:27.162409 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010a1e2-bccf-455c-8701-b54588a949d3 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:27.162804 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f830653-3aaa-4b22-a0c4-e7666d8ebc73 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:27.163148 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f830653-3aaa-4b22-a0c4-e7666d8ebc73 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:27.163483 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f830653-3aaa-4b22-a0c4-e7666d8ebc73 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:27.164419 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f830653-3aaa-4b22-a0c4-e7666d8ebc73 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:27.164873 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f830653-3aaa-4b22-a0c4-e7666d8ebc73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:27.166647 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f830653-3aaa-4b22-a0c4-e7666d8ebc73 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:27.180145 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 323/629] 10.222.0.85 () {58 vars in 1439 bytes} [Thu Jun 16 14:43:26 2022] PUT /identity/v3/projects/80e309a3b3784ba9943734a41949b222/users/bf9c39de29324b0ca6329c9a171367c4/roles/17fa92022f834aa5bf5cb9e3a506a478 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:43:27.181843 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010a1e2-bccf-455c-8701-b54588a949d3 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:27.192035 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 307/630] 10.222.0.85 () {56 vars in 1133 bytes} [Thu Jun 16 14:43:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:27.194189 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f830653-3aaa-4b22-a0c4-e7666d8ebc73 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:27.315487 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f830653-3aaa-4b22-a0c4-e7666d8ebc73 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:27.326909 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010a1e2-bccf-455c-8701-b54588a949d3 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:27.328054 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:27.366450 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a9b44-5c38-488c-8bc8-eecc6b9f4548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:27.367731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a9b44-5c38-488c-8bc8-eecc6b9f4548 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:27.368269 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a9b44-5c38-488c-8bc8-eecc6b9f4548 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:27.369023 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:27.369447 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a9b44-5c38-488c-8bc8-eecc6b9f4548 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:27.378499 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d377b3-8eba-4050-a5a7-ab5568fff3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:27.379538 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d377b3-8eba-4050-a5a7-ab5568fff3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:27.379941 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d377b3-8eba-4050-a5a7-ab5568fff3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:27.380371 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d377b3-8eba-4050-a5a7-ab5568fff3f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:27.392231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d377b3-8eba-4050-a5a7-ab5568fff3f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:27.403188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-f6d377b3-8eba-4050-a5a7-ab5568fff3f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:27.403188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:27.403188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:27.403188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:27.403188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:27.403188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:27.403188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:27.403188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:27.403188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:27.403188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:27.403188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:27.403188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:27.403188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:27.403188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:27.403188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:27.403188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:27.404367 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:27.404367 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:27.404367 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:27.404367 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:27.404367 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:27.404367 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:27.404367 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:27.404367 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:27.404367 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:27.404367 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:27.404367 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:27.404367 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:27.404367 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:27.404367 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:27.404367 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:27.404367 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:27.405244 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:27.405244 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:27.405244 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:27.405244 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:27.405244 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:27.405244 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:27.405244 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:27.405244 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:27.405244 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:27.405244 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:27.405244 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:27.405244 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:27.405244 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 324/631] 10.222.0.85 () {56 vars in 1102 bytes} [Thu Jun 16 14:43:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:27.406306 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742106e-464c-401e-bdfb-1d8f5b5d5fa5 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:27.406697 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742106e-464c-401e-bdfb-1d8f5b5d5fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:27.406974 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742106e-464c-401e-bdfb-1d8f5b5d5fa5 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:27.408289 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 325/632] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:27.413080 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742106e-464c-401e-bdfb-1d8f5b5d5fa5 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:27.463060 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a9b44-5c38-488c-8bc8-eecc6b9f4548 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:27.465315 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a9b44-5c38-488c-8bc8-eecc6b9f4548 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:27.538672 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742106e-464c-401e-bdfb-1d8f5b5d5fa5 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:27.598540 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bc27b-b921-431c-88c5-92631ebb0d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:27.599226 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bc27b-b921-431c-88c5-92631ebb0d1d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:27.599506 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bc27b-b921-431c-88c5-92631ebb0d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:27.599776 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bc27b-b921-431c-88c5-92631ebb0d1d None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:27.600710 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259bc27b-b921-431c-88c5-92631ebb0d1d None admin] RBAC: Adding query filter params (name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:27.601022 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259bc27b-b921-431c-88c5-92631ebb0d1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:27.604088 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259bc27b-b921-431c-88c5-92631ebb0d1d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:27.605813 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 308/633] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 14:43:27.612499 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab34ed-44c0-44a1-932f-cb5a6975332c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:27.613068 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab34ed-44c0-44a1-932f-cb5a6975332c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:27.613547 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab34ed-44c0-44a1-932f-cb5a6975332c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:27.614056 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 326/634] 10.222.0.85 () {56 vars in 1103 bytes} [Thu Jun 16 14:43:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:27.614905 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bc27b-b921-431c-88c5-92631ebb0d1d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:27.636766 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-feab34ed-44c0-44a1-932f-cb5a6975332c None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:27.638328 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-feab34ed-44c0-44a1-932f-cb5a6975332c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:27.641242 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:27.681853 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:27.718387 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 309/635] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:27.719654 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab34ed-44c0-44a1-932f-cb5a6975332c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:27.743824 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bc27b-b921-431c-88c5-92631ebb0d1d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:27.789706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd821ad8-a203-4ba5-9386-f4016968a17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:27.790730 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd821ad8-a203-4ba5-9386-f4016968a17e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:27.791068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd821ad8-a203-4ba5-9386-f4016968a17e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:27.791342 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd821ad8-a203-4ba5-9386-f4016968a17e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:27.802907 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd821ad8-a203-4ba5-9386-f4016968a17e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:27.804402 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd821ad8-a203-4ba5-9386-f4016968a17e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:27.824013 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-fd821ad8-a203-4ba5-9386-f4016968a17e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:27.824013 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:27.824013 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:27.824013 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:27.824013 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:27.824013 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:27.824013 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:27.824013 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:27.824013 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:27.824013 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:27.824013 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:27.824013 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:27.824013 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:27.824013 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:27.824013 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:27.824988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:27.824988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:27.824988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:27.824988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:27.824988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:27.824988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:27.824988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:27.824988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:27.824988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:27.824988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:27.824988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:27.824988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:27.824988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:27.824988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:27.824988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:27.824988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:27.824988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:27.825916 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:27.825916 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:27.825916 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:27.825916 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:27.825916 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 327/636] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:27.826771 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123347b9-4422-45c9-aa2f-7f1eb51c08c0 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:27.826771 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123347b9-4422-45c9-aa2f-7f1eb51c08c0 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:27.827030 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123347b9-4422-45c9-aa2f-7f1eb51c08c0 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:27.832008 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 328/637] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:27.832008 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123347b9-4422-45c9-aa2f-7f1eb51c08c0 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:27.846945 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab34ed-44c0-44a1-932f-cb5a6975332c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:27.886194 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc612279-4ce7-4bdb-9ed1-24165e666931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:27.887362 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc612279-4ce7-4bdb-9ed1-24165e666931 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:27.887980 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc612279-4ce7-4bdb-9ed1-24165e666931 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:27.888422 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc612279-4ce7-4bdb-9ed1-24165e666931 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:27.896525 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:27.902129 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc612279-4ce7-4bdb-9ed1-24165e666931 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:27.903666 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc612279-4ce7-4bdb-9ed1-24165e666931 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:27.925821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-cc612279-4ce7-4bdb-9ed1-24165e666931 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:27.925821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:27.925821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:27.925821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:27.925821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:27.925821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:27.925821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:27.925821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:27.925821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:27.925821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:27.925821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:27.925821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:27.925821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:27.925821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:27.925821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:27.926828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:27.926828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:27.926828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:27.926828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:27.926828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:27.926828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:27.926828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:27.926828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:27.926828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:27.926828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:27.926828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:27.926828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:27.926828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:27.926828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:27.926828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:27.926828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:27.926828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:27.927739 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:27.927739 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:27.927739 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:27.927739 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:27.927739 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 310/638] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:27.928538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc612279-4ce7-4bdb-9ed1-24165e666931 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:27.948058 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123347b9-4422-45c9-aa2f-7f1eb51c08c0 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:27.950520 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:27.986704 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec2fba-b441-4775-8e23-f5876d519222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:27.987526 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec2fba-b441-4775-8e23-f5876d519222 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:27.987835 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec2fba-b441-4775-8e23-f5876d519222 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:27.988125 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec2fba-b441-4775-8e23-f5876d519222 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:27.999411 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec2fba-b441-4775-8e23-f5876d519222 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:28.007073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-3fec2fba-b441-4775-8e23-f5876d519222 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:28.007073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:28.007073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:28.007073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:28.007073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:28.007073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:28.007073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:28.007073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:28.007073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:28.007073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:28.007073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:28.007073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:28.007073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:28.007073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:28.007073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:28.007073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:28.008252 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:28.008252 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:28.008252 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:28.008252 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:28.008252 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:28.008252 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:28.008252 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:28.008252 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:28.008252 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:28.008252 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:28.008252 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:28.008252 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:28.008252 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:28.008252 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:28.008252 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:28.008252 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:28.009973 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:28.009973 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:28.009973 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:28.009973 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:28.009973 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:28.009973 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:28.009973 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:28.009973 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:28.009973 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:28.009973 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:28.009973 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:28.009973 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:28.009973 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 329/639] 10.222.0.85 () {56 vars in 1102 bytes} [Thu Jun 16 14:43:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:28.010793 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa4956-b416-4a09-adb2-13e3d642913d None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:28.010793 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa4956-b416-4a09-adb2-13e3d642913d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:28.011112 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa4956-b416-4a09-adb2-13e3d642913d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:28.028623 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-10aa4956-b416-4a09-adb2-13e3d642913d None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:28.029828 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-10aa4956-b416-4a09-adb2-13e3d642913d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:28.057389 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc612279-4ce7-4bdb-9ed1-24165e666931 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:28.101058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b253f67-e006-40fa-b399-77b1f6633a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:28.101682 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b253f67-e006-40fa-b399-77b1f6633a9d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:28.101965 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b253f67-e006-40fa-b399-77b1f6633a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:28.102242 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b253f67-e006-40fa-b399-77b1f6633a9d None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:28.103105 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b253f67-e006-40fa-b399-77b1f6633a9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:28.103419 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b253f67-e006-40fa-b399-77b1f6633a9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:28.104921 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b253f67-e006-40fa-b399-77b1f6633a9d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:28.115897 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 330/640] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:28.115897 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa4956-b416-4a09-adb2-13e3d642913d None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:28.130076 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 311/641] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:28.131026 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b253f67-e006-40fa-b399-77b1f6633a9d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:28.184788 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:28.216180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:28.224501 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa4956-b416-4a09-adb2-13e3d642913d None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:28.240840 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b253f67-e006-40fa-b399-77b1f6633a9d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:28.274671 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720306ed-d357-4f55-9bbc-6d2ee921e355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:28.275452 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720306ed-d357-4f55-9bbc-6d2ee921e355 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:28.275744 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720306ed-d357-4f55-9bbc-6d2ee921e355 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:28.276045 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720306ed-d357-4f55-9bbc-6d2ee921e355 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:28.276841 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720306ed-d357-4f55-9bbc-6d2ee921e355 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:28.277150 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720306ed-d357-4f55-9bbc-6d2ee921e355 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:28.278540 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720306ed-d357-4f55-9bbc-6d2ee921e355 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:28.281040 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8742f-586e-4f1d-a4b1-31b57a913094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:28.281725 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8742f-586e-4f1d-a4b1-31b57a913094 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:28.282027 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8742f-586e-4f1d-a4b1-31b57a913094 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:28.282270 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8742f-586e-4f1d-a4b1-31b57a913094 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:28.283064 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf8742f-586e-4f1d-a4b1-31b57a913094 None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:28.283374 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf8742f-586e-4f1d-a4b1-31b57a913094 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:28.284796 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf8742f-586e-4f1d-a4b1-31b57a913094 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:28.295300 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 331/642] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:28.295300 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720306ed-d357-4f55-9bbc-6d2ee921e355 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:28.304283 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 312/643] 10.222.0.85 () {56 vars in 1103 bytes} [Thu Jun 16 14:43:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:28.304283 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8742f-586e-4f1d-a4b1-31b57a913094 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:28.404737 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720306ed-d357-4f55-9bbc-6d2ee921e355 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:28.416264 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8742f-586e-4f1d-a4b1-31b57a913094 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:28.430789 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:28.443205 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54963d-7b90-481e-b37a-c46ce943ac71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:28.444047 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54963d-7b90-481e-b37a-c46ce943ac71 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:28.444332 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54963d-7b90-481e-b37a-c46ce943ac71 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:28.444675 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54963d-7b90-481e-b37a-c46ce943ac71 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:28.455580 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13189e4-a2bd-47cb-8351-8e8086acda90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:28.456420 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54963d-7b90-481e-b37a-c46ce943ac71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:28.456527 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13189e4-a2bd-47cb-8351-8e8086acda90 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:28.456741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13189e4-a2bd-47cb-8351-8e8086acda90 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:28.457019 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13189e4-a2bd-47cb-8351-8e8086acda90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:28.464275 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-0a54963d-7b90-481e-b37a-c46ce943ac71 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:28.464275 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:28.464275 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:28.464275 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:28.464275 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:28.464275 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:28.464275 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:28.464275 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:28.464275 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:28.464275 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:28.464275 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:28.464275 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:28.464275 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:28.464275 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:28.464275 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:28.464275 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:28.465409 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:28.465409 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:28.465409 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:28.465409 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:28.465409 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:28.465409 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:28.465409 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:28.465409 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:28.465409 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:28.465409 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:28.465409 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:28.465409 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:28.465409 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:28.465409 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:28.465409 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:28.465409 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:28.471428 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:28.471428 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:28.471428 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:28.471428 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:28.471428 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:28.471428 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:28.471428 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:28.471428 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:28.471428 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:28.471428 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:28.471428 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:28.471428 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:28.472140 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13189e4-a2bd-47cb-8351-8e8086acda90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:28.472140 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13189e4-a2bd-47cb-8351-8e8086acda90 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:28.472613 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 332/644] 10.222.0.85 () {56 vars in 1102 bytes} [Thu Jun 16 14:43:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:28.472613 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54963d-7b90-481e-b37a-c46ce943ac71 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:28.488511 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:28.497794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-f13189e4-a2bd-47cb-8351-8e8086acda90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:28.497794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:28.497794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:28.497794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:28.497794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:28.497794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:28.497794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:28.497794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:28.497794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:28.497794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:28.497794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:28.497794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:28.497794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:43:28.497794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:43:28.497794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:43:28.498902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:43:28.498902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:28.498902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:28.498902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:28.498902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:28.498902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:28.498902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:28.498902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:28.498902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:28.498902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:28.498902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:28.498902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:28.498902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:28.498902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:28.498902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:28.498902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:28.498902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:28.500864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:43:28.500864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:43:28.500864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:43:28.500864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:43:28.500864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:43:28.500864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:43:28.500864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:28.500864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:28.500864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 313/645] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:28.500864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13189e4-a2bd-47cb-8351-8e8086acda90 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:28.608412 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54963d-7b90-481e-b37a-c46ce943ac71 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:28.616380 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13189e4-a2bd-47cb-8351-8e8086acda90 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:28.647578 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6cb543-a166-485e-b84d-448654a31498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:28.648426 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6cb543-a166-485e-b84d-448654a31498 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:28.648696 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6cb543-a166-485e-b84d-448654a31498 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:28.648967 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6cb543-a166-485e-b84d-448654a31498 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:28.656365 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16994ba1-b3fa-4122-8af6-b9e60381ecf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:28.657546 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16994ba1-b3fa-4122-8af6-b9e60381ecf3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:28.657994 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16994ba1-b3fa-4122-8af6-b9e60381ecf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:28.658437 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16994ba1-b3fa-4122-8af6-b9e60381ecf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:28.662327 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6cb543-a166-485e-b84d-448654a31498 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:28.664845 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6cb543-a166-485e-b84d-448654a31498 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:28.675834 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16994ba1-b3fa-4122-8af6-b9e60381ecf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:28.678254 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16994ba1-b3fa-4122-8af6-b9e60381ecf3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:28.690080 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-cf6cb543-a166-485e-b84d-448654a31498 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 14:43:28.690080 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:28.690080 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:28.690080 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:28.690080 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:28.690080 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:28.690080 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:28.690080 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:28.690080 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:28.690080 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:28.690080 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:28.690080 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:28.690080 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:43:28.690080 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:43:28.690080 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:43:28.690080 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:43:28.691113 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:28.691113 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:28.691113 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:43:28.691113 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:28.691113 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:43:28.691113 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:28.691113 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:28.691113 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:28.691113 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:28.691113 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:28.691113 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:28.691113 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:28.691113 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:28.691113 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:28.691113 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:28.691113 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:28.691113 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:28.691113 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:28.692622 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:28.692622 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:28.692622 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:43:28.692622 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:43:28.692622 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:43:28.692622 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:43:28.692622 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:43:28.692622 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:43:28.692622 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 14:43:28.692622 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:28.692622 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 333/646] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:28.693472 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6cb543-a166-485e-b84d-448654a31498 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:28.717858 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-16994ba1-b3fa-4122-8af6-b9e60381ecf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:28.717858 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:28.717858 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:28.717858 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:28.717858 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:28.717858 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:28.717858 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:28.717858 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:28.717858 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:28.717858 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:28.717858 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:28.717858 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:28.717858 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:28.717858 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:28.717858 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:28.719813 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:28.719813 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:28.719813 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:28.719813 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:28.719813 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:28.719813 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:28.719813 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:28.719813 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:28.719813 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:28.719813 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:28.719813 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:28.719813 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:28.719813 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:28.719813 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:28.719813 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:28.719813 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:28.719813 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:28.721604 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:28.721604 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:28.721604 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:28.721604 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:28.721604 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 314/647] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:28.721604 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16994ba1-b3fa-4122-8af6-b9e60381ecf3 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:28.761966 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:28.807374 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:28.848132 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6cb543-a166-485e-b84d-448654a31498 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:28.852505 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16994ba1-b3fa-4122-8af6-b9e60381ecf3 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:28.901167 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb3158-6013-49e9-9541-8a9f14cbc5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:28.901167 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb3158-6013-49e9-9541-8a9f14cbc5ae None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:28.901167 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb3158-6013-49e9-9541-8a9f14cbc5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:28.901167 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb3158-6013-49e9-9541-8a9f14cbc5ae None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:28.903294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb3158-6013-49e9-9541-8a9f14cbc5ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:28.903294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb3158-6013-49e9-9541-8a9f14cbc5ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:28.904608 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb3158-6013-49e9-9541-8a9f14cbc5ae None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:28.910262 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f63d3-5002-4adb-8d4f-ff49ed55d9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:28.910862 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f63d3-5002-4adb-8d4f-ff49ed55d9f7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:28.911142 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f63d3-5002-4adb-8d4f-ff49ed55d9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:28.911417 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f63d3-5002-4adb-8d4f-ff49ed55d9f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:28.912213 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f63d3-5002-4adb-8d4f-ff49ed55d9f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:28.912520 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f63d3-5002-4adb-8d4f-ff49ed55d9f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:28.913979 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f63d3-5002-4adb-8d4f-ff49ed55d9f7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:28.928212 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 315/648] 10.222.0.85 () {56 vars in 1148 bytes} [Thu Jun 16 14:43:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:28.928212 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb3158-6013-49e9-9541-8a9f14cbc5ae None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:28.928506 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 334/649] 10.222.0.85 () {56 vars in 1103 bytes} [Thu Jun 16 14:43:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:28.928506 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f63d3-5002-4adb-8d4f-ff49ed55d9f7 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:29.059857 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f63d3-5002-4adb-8d4f-ff49ed55d9f7 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:29.065984 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:29.099233 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8acbbc-7919-411f-948e-15c025795c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:29.100037 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8acbbc-7919-411f-948e-15c025795c6e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:29.100189 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8acbbc-7919-411f-948e-15c025795c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:29.100471 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8acbbc-7919-411f-948e-15c025795c6e None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:29.101206 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8acbbc-7919-411f-948e-15c025795c6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:29.101513 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8acbbc-7919-411f-948e-15c025795c6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:29.103016 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8acbbc-7919-411f-948e-15c025795c6e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:29.104241 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb3158-6013-49e9-9541-8a9f14cbc5ae None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:29.106111 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:29.117200 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 335/650] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:29.118192 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8acbbc-7919-411f-948e-15c025795c6e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:29.152972 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b48ae1-21b5-4256-a9b0-ddb59d970c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:29.153669 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b48ae1-21b5-4256-a9b0-ddb59d970c8e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:29.154005 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b48ae1-21b5-4256-a9b0-ddb59d970c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:29.154262 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b48ae1-21b5-4256-a9b0-ddb59d970c8e None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:29.155149 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b48ae1-21b5-4256-a9b0-ddb59d970c8e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:29.155459 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b48ae1-21b5-4256-a9b0-ddb59d970c8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:29.156967 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b48ae1-21b5-4256-a9b0-ddb59d970c8e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:29.181489 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 316/651] 10.222.0.85 () {56 vars in 1137 bytes} [Thu Jun 16 14:43:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:29.181489 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b48ae1-21b5-4256-a9b0-ddb59d970c8e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:29.247818 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8acbbc-7919-411f-948e-15c025795c6e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:29.292300 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b48ae1-21b5-4256-a9b0-ddb59d970c8e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:29.304119 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9ca17-592b-45a4-88b8-5cb208870baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:29.305271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9ca17-592b-45a4-88b8-5cb208870baf None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:29.305669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9ca17-592b-45a4-88b8-5cb208870baf None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:29.306170 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9ca17-592b-45a4-88b8-5cb208870baf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:29.307691 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9ca17-592b-45a4-88b8-5cb208870baf None admin] RBAC: Adding query filter params (role.id=17fa92022f834aa5bf5cb9e3a506a478, scope.project.id=80e309a3b3784ba9943734a41949b222, user.id=c74e4d1bdaa64ed280cc5f4c8e79b842) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:29.308431 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9ca17-592b-45a4-88b8-5cb208870baf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:29.310985 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9ca17-592b-45a4-88b8-5cb208870baf None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:29.331905 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 336/652] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:29 2022] GET /identity/v3/role_assignments?user.id=c74e4d1bdaa64ed280cc5f4c8e79b842&scope.project.id=80e309a3b3784ba9943734a41949b222&role.id=17fa92022f834aa5bf5cb9e3a506a478 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:29.331905 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9ca17-592b-45a4-88b8-5cb208870baf None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:29.344976 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26f871-ffd7-45da-9b8f-54197222fe0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:29.345960 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26f871-ffd7-45da-9b8f-54197222fe0d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:29.346311 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26f871-ffd7-45da-9b8f-54197222fe0d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:29.346649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26f871-ffd7-45da-9b8f-54197222fe0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:29.362318 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26f871-ffd7-45da-9b8f-54197222fe0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:29.364011 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26f871-ffd7-45da-9b8f-54197222fe0d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:29.366785 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:29.389990 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-3a26f871-ffd7-45da-9b8f-54197222fe0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:29.389990 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:29.389990 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:29.389990 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:29.389990 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:29.389990 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:29.389990 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:29.389990 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:29.389990 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:29.389990 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:29.389990 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:29.389990 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:29.389990 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:29.389990 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:29.389990 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:29.390953 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:29.390953 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:29.390953 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:29.390953 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:29.390953 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:29.390953 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:29.390953 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:29.390953 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:29.390953 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:29.390953 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:29.390953 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:29.390953 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:29.390953 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:29.390953 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:29.390953 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:29.390953 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:29.390953 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:29.391849 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:29.391849 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:29.391849 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:29.391849 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:29.396173 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 317/653] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:29.397204 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26f871-ffd7-45da-9b8f-54197222fe0d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:29.425689 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:29.493492 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9ca17-592b-45a4-88b8-5cb208870baf None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:29.549195 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332c71a-d610-442b-9929-379ba168eecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:29.550081 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332c71a-d610-442b-9929-379ba168eecb None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:29.550397 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332c71a-d610-442b-9929-379ba168eecb None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:29.550720 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332c71a-d610-442b-9929-379ba168eecb None admin] PATH_INFO: `/v3/users/glance` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:29.552029 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26f871-ffd7-45da-9b8f-54197222fe0d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:29.562714 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332c71a-d610-442b-9929-379ba168eecb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:29.564344 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332c71a-d610-442b-9929-379ba168eecb None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:29.582598 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-b332c71a-d610-442b-9929-379ba168eecb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 14:43:29.582598 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:29.582598 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:29.582598 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:29.582598 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:29.582598 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:29.582598 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:29.582598 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:29.582598 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:29.582598 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:29.582598 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:29.582598 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:29.582598 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:43:29.582598 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:43:29.582598 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:43:29.582598 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:43:29.583613 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:29.583613 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:29.583613 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:43:29.583613 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:29.583613 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:43:29.583613 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:29.583613 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:29.583613 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:29.583613 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:29.583613 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:29.583613 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:29.583613 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:29.583613 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:29.583613 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:29.583613 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:29.583613 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:29.583613 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:29.583613 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:29.584592 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:29.584592 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:29.584592 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:43:29.584592 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:43:29.584592 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:43:29.584592 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:43:29.584592 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:43:29.584592 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:43:29.584592 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 14:43:29.584592 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:29.584592 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 337/654] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:29.585200 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332c71a-d610-442b-9929-379ba168eecb None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:29.592782 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021d5c8-4a59-4a1e-9dd0-a405955ca6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:29.594270 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021d5c8-4a59-4a1e-9dd0-a405955ca6ed None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:29.594552 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021d5c8-4a59-4a1e-9dd0-a405955ca6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:29.594826 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021d5c8-4a59-4a1e-9dd0-a405955ca6ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:29.677660 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:29.686763 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021d5c8-4a59-4a1e-9dd0-a405955ca6ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:29.688317 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021d5c8-4a59-4a1e-9dd0-a405955ca6ed None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:29.711918 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332c71a-d610-442b-9929-379ba168eecb None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:29.738256 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:29.752768 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508c99f-3a15-433a-b3f3-14a3cabd8956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:29.753353 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508c99f-3a15-433a-b3f3-14a3cabd8956 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:29.753645 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508c99f-3a15-433a-b3f3-14a3cabd8956 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:29.753904 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508c99f-3a15-433a-b3f3-14a3cabd8956 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:29.754650 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508c99f-3a15-433a-b3f3-14a3cabd8956 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:29.754966 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508c99f-3a15-433a-b3f3-14a3cabd8956 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:29.756434 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508c99f-3a15-433a-b3f3-14a3cabd8956 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:29.779942 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 338/655] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:29.779942 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4b6ce-d733-4e49-986a-48673a743ac3 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:29.779942 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4b6ce-d733-4e49-986a-48673a743ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:29.779942 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4b6ce-d733-4e49-986a-48673a743ac3 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:29.779942 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 339/656] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:29.779942 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4b6ce-d733-4e49-986a-48673a743ac3 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:29.822716 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 318/657] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:29.822716 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c35008-c9de-4249-a1ee-ee11d09af832 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:29.822716 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c35008-c9de-4249-a1ee-ee11d09af832 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:29.822716 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c35008-c9de-4249-a1ee-ee11d09af832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:29.839792 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b5c35008-c9de-4249-a1ee-ee11d09af832 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:29.841154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b5c35008-c9de-4249-a1ee-ee11d09af832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:29.921049 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4b6ce-d733-4e49-986a-48673a743ac3 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:29.932489 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 319/658] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:29.934747 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c35008-c9de-4249-a1ee-ee11d09af832 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:29.960360 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c8c4f-8aa1-46be-b491-df77c727847b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:29.961065 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c8c4f-8aa1-46be-b491-df77c727847b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:29.961346 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c8c4f-8aa1-46be-b491-df77c727847b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:29.961669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c8c4f-8aa1-46be-b491-df77c727847b None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:29.962695 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c8c4f-8aa1-46be-b491-df77c727847b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:29.963126 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c8c4f-8aa1-46be-b491-df77c727847b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:29.964809 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c8c4f-8aa1-46be-b491-df77c727847b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:29.967060 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:29.985778 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 340/659] 10.222.0.85 () {56 vars in 1137 bytes} [Thu Jun 16 14:43:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:29.986888 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c8c4f-8aa1-46be-b491-df77c727847b None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:30.031504 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:30.057780 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c35008-c9de-4249-a1ee-ee11d09af832 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:30.097163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b108e-53a0-4874-81ce-9b214defee27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:30.098317 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b108e-53a0-4874-81ce-9b214defee27 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:30.098766 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b108e-53a0-4874-81ce-9b214defee27 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:30.099174 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b108e-53a0-4874-81ce-9b214defee27 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:30.099734 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c8c4f-8aa1-46be-b491-df77c727847b None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:30.108903 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b108e-53a0-4874-81ce-9b214defee27 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:30.110834 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b108e-53a0-4874-81ce-9b214defee27 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:30.128441 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-c68b108e-53a0-4874-81ce-9b214defee27 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 14:43:30.128441 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:30.128441 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:30.128441 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:30.128441 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:30.128441 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:30.128441 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:30.128441 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:30.128441 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:30.128441 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:30.128441 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:30.128441 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:30.128441 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:43:30.128441 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:43:30.128441 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:43:30.128441 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:43:30.129649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:30.129649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:30.129649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:43:30.129649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:30.129649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:43:30.129649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:30.129649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:30.129649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:30.129649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:30.129649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:30.129649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:30.129649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:30.129649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:30.129649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:30.129649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:30.129649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:30.129649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:30.129649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:30.130810 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:30.130810 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:30.130810 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:43:30.130810 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:43:30.130810 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:43:30.130810 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:43:30.130810 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:43:30.130810 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:43:30.130810 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 14:43:30.130810 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:30.133026 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 320/660] 10.222.0.85 () {56 vars in 1102 bytes} [Thu Jun 16 14:43:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:30.134369 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b108e-53a0-4874-81ce-9b214defee27 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:30.141220 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8c822-5d29-444b-a61a-5085d206d681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:30.142097 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8c822-5d29-444b-a61a-5085d206d681 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:30.142375 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8c822-5d29-444b-a61a-5085d206d681 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:30.142671 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8c822-5d29-444b-a61a-5085d206d681 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:30.155169 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a8c822-5d29-444b-a61a-5085d206d681 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:30.156698 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a8c822-5d29-444b-a61a-5085d206d681 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:30.177543 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-54a8c822-5d29-444b-a61a-5085d206d681 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:30.177543 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:30.177543 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:30.177543 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:30.177543 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:30.177543 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:30.177543 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:30.177543 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:30.177543 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:30.177543 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:30.177543 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:30.177543 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:30.177543 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:30.177543 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:30.177543 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:30.178545 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:30.178545 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:30.178545 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:30.178545 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:30.178545 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:30.178545 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:30.178545 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:30.178545 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:30.178545 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:30.178545 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:30.178545 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:30.178545 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:30.178545 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:30.178545 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:30.178545 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:30.178545 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:30.178545 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:30.179431 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:30.179431 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:30.179431 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:30.179431 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:30.184302 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 341/661] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:30.185184 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8c822-5d29-444b-a61a-5085d206d681 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:30.230907 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:30.250536 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b108e-53a0-4874-81ce-9b214defee27 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:30.289976 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f225d-71d2-4c49-ba46-0146b13ab257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:30.291592 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f225d-71d2-4c49-ba46-0146b13ab257 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:30.291592 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f225d-71d2-4c49-ba46-0146b13ab257 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:30.291592 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f225d-71d2-4c49-ba46-0146b13ab257 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:30.293958 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:30.303725 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f225d-71d2-4c49-ba46-0146b13ab257 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:30.306431 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8c822-5d29-444b-a61a-5085d206d681 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:30.311658 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-828f225d-71d2-4c49-ba46-0146b13ab257 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:30.311658 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:30.311658 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:30.311658 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:30.311658 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:30.311658 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:30.311658 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:30.311658 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:30.311658 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:30.311658 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:30.311658 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:30.311658 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:30.311658 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:30.311658 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:30.311658 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:30.311658 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:30.312672 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:30.312672 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:30.312672 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:30.312672 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:30.312672 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:30.312672 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:30.312672 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:30.312672 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:30.312672 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:30.312672 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:30.312672 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:30.312672 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:30.312672 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:30.312672 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:30.312672 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:30.312672 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:30.313547 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:30.313547 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:30.313547 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:30.313547 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:30.313547 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:30.313547 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:30.313547 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:30.313547 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:30.313547 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:30.313547 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:30.313547 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:30.313547 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:30.313547 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 321/662] 10.222.0.85 () {56 vars in 1102 bytes} [Thu Jun 16 14:43:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:30.314336 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f225d-71d2-4c49-ba46-0146b13ab257 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:30.349411 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5822e-892b-4db1-a04d-8f7d80f63acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:30.350067 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5822e-892b-4db1-a04d-8f7d80f63acd None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:30.350344 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5822e-892b-4db1-a04d-8f7d80f63acd None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:30.350633 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5822e-892b-4db1-a04d-8f7d80f63acd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:30.429865 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5822e-892b-4db1-a04d-8f7d80f63acd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:30.431451 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5822e-892b-4db1-a04d-8f7d80f63acd None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:30.435692 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f225d-71d2-4c49-ba46-0146b13ab257 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:30.479086 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9472b-a957-4917-9bfe-430788935945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:30.479781 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9472b-a957-4917-9bfe-430788935945 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:30.480154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9472b-a957-4917-9bfe-430788935945 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:30.480511 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9472b-a957-4917-9bfe-430788935945 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:30.481333 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9472b-a957-4917-9bfe-430788935945 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:30.481642 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9472b-a957-4917-9bfe-430788935945 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:30.483109 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9472b-a957-4917-9bfe-430788935945 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:30.503183 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 322/663] 10.222.0.85 () {56 vars in 1139 bytes} [Thu Jun 16 14:43:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:30.504076 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9472b-a957-4917-9bfe-430788935945 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:30.506876 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:30.538382 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:30.552067 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 342/664] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:30.552342 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5822e-892b-4db1-a04d-8f7d80f63acd None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:30.632856 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9472b-a957-4917-9bfe-430788935945 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:30.672922 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5822e-892b-4db1-a04d-8f7d80f63acd None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:30.675537 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5778b75-0f0f-44db-bbf3-5fc2f7cb6137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:30.676252 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5778b75-0f0f-44db-bbf3-5fc2f7cb6137 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:30.676530 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5778b75-0f0f-44db-bbf3-5fc2f7cb6137 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:30.676801 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5778b75-0f0f-44db-bbf3-5fc2f7cb6137 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:30.677539 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5778b75-0f0f-44db-bbf3-5fc2f7cb6137 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:30.677841 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5778b75-0f0f-44db-bbf3-5fc2f7cb6137 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:30.679228 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5778b75-0f0f-44db-bbf3-5fc2f7cb6137 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:30.693248 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 323/665] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:30.694107 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5778b75-0f0f-44db-bbf3-5fc2f7cb6137 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:30.720066 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37942d68-35ae-4cb6-9f39-f3bf8bda0029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:30.720756 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37942d68-35ae-4cb6-9f39-f3bf8bda0029 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:30.721039 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37942d68-35ae-4cb6-9f39-f3bf8bda0029 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:30.721320 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37942d68-35ae-4cb6-9f39-f3bf8bda0029 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:30.722096 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37942d68-35ae-4cb6-9f39-f3bf8bda0029 None admin] RBAC: Adding query filter params (name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:30.722406 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37942d68-35ae-4cb6-9f39-f3bf8bda0029 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:30.723819 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37942d68-35ae-4cb6-9f39-f3bf8bda0029 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:30.733135 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 343/666] 10.222.0.85 () {56 vars in 1103 bytes} [Thu Jun 16 14:43:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:30.734010 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37942d68-35ae-4cb6-9f39-f3bf8bda0029 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:30.773833 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:30.790830 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:30.819067 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5778b75-0f0f-44db-bbf3-5fc2f7cb6137 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:30.851035 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37942d68-35ae-4cb6-9f39-f3bf8bda0029 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:30.857581 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e6696-c825-47c6-9e19-880f698713ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:30.858289 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e6696-c825-47c6-9e19-880f698713ca None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:30.859138 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e6696-c825-47c6-9e19-880f698713ca None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:30.859422 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e6696-c825-47c6-9e19-880f698713ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:30.890599 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9215b-ea42-4e34-813f-5393c7bbeba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:30.891415 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9215b-ea42-4e34-813f-5393c7bbeba7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:30.891699 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9215b-ea42-4e34-813f-5393c7bbeba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:30.892166 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9215b-ea42-4e34-813f-5393c7bbeba7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:30.903412 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9215b-ea42-4e34-813f-5393c7bbeba7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:30.904914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9215b-ea42-4e34-813f-5393c7bbeba7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:30.923286 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-8bc9215b-ea42-4e34-813f-5393c7bbeba7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:30.923286 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:30.923286 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:30.923286 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:30.923286 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:30.923286 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:30.923286 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:30.923286 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:30.923286 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:30.923286 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:30.923286 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:30.923286 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:30.923286 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:30.923286 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:30.923286 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:30.924405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:30.924405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:30.924405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:30.924405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:30.924405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:30.924405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:30.924405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:30.924405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:30.924405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:30.924405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:30.924405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:30.924405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:30.924405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:30.924405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:30.924405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:30.924405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:30.924405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:30.925332 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:30.925332 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:30.925332 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:30.925332 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:30.925332 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 344/667] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:30.925822 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9215b-ea42-4e34-813f-5393c7bbeba7 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:30.947935 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e6696-c825-47c6-9e19-880f698713ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:30.949424 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e6696-c825-47c6-9e19-880f698713ca None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:31.015472 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:31.050513 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9215b-ea42-4e34-813f-5393c7bbeba7 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:31.054048 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:31.070286 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 324/668] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:31.070286 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e6696-c825-47c6-9e19-880f698713ca None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:31.095849 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a7280-8762-4fdc-8f43-ddb845f39f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:31.096693 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a7280-8762-4fdc-8f43-ddb845f39f12 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:31.096970 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a7280-8762-4fdc-8f43-ddb845f39f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:31.097240 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a7280-8762-4fdc-8f43-ddb845f39f12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:31.105857 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a7280-8762-4fdc-8f43-ddb845f39f12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:31.107329 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a7280-8762-4fdc-8f43-ddb845f39f12 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:31.123193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-276a7280-8762-4fdc-8f43-ddb845f39f12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:31.123193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:31.123193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:31.123193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:31.123193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:31.123193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:31.123193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:31.123193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:31.123193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:31.123193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:31.123193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:31.123193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:31.123193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:43:31.123193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:43:31.123193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:43:31.124281 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:43:31.124281 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:31.124281 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:31.124281 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:31.124281 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:31.124281 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:31.124281 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:31.124281 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:31.124281 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:31.124281 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:31.124281 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:31.124281 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:31.124281 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:31.124281 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:31.124281 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:31.124281 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:31.124281 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:31.125177 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:43:31.125177 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:43:31.125177 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:43:31.125177 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:43:31.125177 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:43:31.125177 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:43:31.125177 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:31.125177 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:31.125177 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 345/669] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:31.125657 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a7280-8762-4fdc-8f43-ddb845f39f12 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:31.189861 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e6696-c825-47c6-9e19-880f698713ca None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:31.227678 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83343e-1ae2-4432-a4d1-2d5f0378799f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:31.229060 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83343e-1ae2-4432-a4d1-2d5f0378799f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:31.229345 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83343e-1ae2-4432-a4d1-2d5f0378799f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:31.229625 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83343e-1ae2-4432-a4d1-2d5f0378799f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:31.240543 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83343e-1ae2-4432-a4d1-2d5f0378799f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:31.241469 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a7280-8762-4fdc-8f43-ddb845f39f12 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:31.242060 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83343e-1ae2-4432-a4d1-2d5f0378799f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:31.262655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-be83343e-1ae2-4432-a4d1-2d5f0378799f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:31.262655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:31.262655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:31.262655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:31.262655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:31.262655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:31.262655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:31.262655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:31.262655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:31.262655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:31.262655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:31.262655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:31.262655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:31.262655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:31.262655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:31.263765 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:31.263765 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:31.263765 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:31.263765 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:31.263765 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:31.263765 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:31.263765 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:31.263765 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:31.263765 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:31.263765 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:31.263765 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:31.263765 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:31.263765 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:31.263765 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:31.263765 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:31.263765 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:31.263765 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:31.264848 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:31.264848 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:31.264848 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:31.264848 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:31.268647 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 325/670] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:31.269602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83343e-1ae2-4432-a4d1-2d5f0378799f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:31.284645 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7a059-ad3a-45ec-9e20-b6740bc3f770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:31.285813 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7a059-ad3a-45ec-9e20-b6740bc3f770 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:31.286502 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:31.287134 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7a059-ad3a-45ec-9e20-b6740bc3f770 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:31.287565 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7a059-ad3a-45ec-9e20-b6740bc3f770 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:31.288584 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7a059-ad3a-45ec-9e20-b6740bc3f770 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:31.289262 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7a059-ad3a-45ec-9e20-b6740bc3f770 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:31.291612 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7a059-ad3a-45ec-9e20-b6740bc3f770 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:31.306067 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 346/671] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:31.307567 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7a059-ad3a-45ec-9e20-b6740bc3f770 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:31.351384 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:31.411862 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83343e-1ae2-4432-a4d1-2d5f0378799f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:31.447626 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7a059-ad3a-45ec-9e20-b6740bc3f770 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:31.450572 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b8498-dec5-402c-a5af-dfc391bc5c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:31.451396 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b8498-dec5-402c-a5af-dfc391bc5c00 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:31.451717 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b8498-dec5-402c-a5af-dfc391bc5c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:31.452018 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b8498-dec5-402c-a5af-dfc391bc5c00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:31.464613 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b8498-dec5-402c-a5af-dfc391bc5c00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:31.466098 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b8498-dec5-402c-a5af-dfc391bc5c00 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:31.486612 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480cee5-3b36-4649-898e-6997135798d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:31.487281 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480cee5-3b36-4649-898e-6997135798d6 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:31.487632 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480cee5-3b36-4649-898e-6997135798d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:31.487846 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480cee5-3b36-4649-898e-6997135798d6 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:31.488656 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480cee5-3b36-4649-898e-6997135798d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:31.488962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480cee5-3b36-4649-898e-6997135798d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:31.490179 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-6b4b8498-dec5-402c-a5af-dfc391bc5c00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:31.490179 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:31.490179 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:31.490179 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:31.490179 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:31.490179 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:31.490179 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:31.490179 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:31.490179 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:31.490179 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:31.490179 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:31.490179 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:31.490179 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:31.490179 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:31.490179 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:31.491645 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:31.491645 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:31.491645 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:31.491645 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:31.491645 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:31.491645 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:31.491645 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:31.491645 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:31.491645 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:31.491645 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:31.491645 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:31.491645 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:31.491645 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:31.491645 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:31.491645 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:31.491645 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:31.491645 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:31.493116 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:31.493116 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:31.493116 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:31.493116 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:31.493598 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480cee5-3b36-4649-898e-6997135798d6 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:31.493725 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 326/672] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:31.493725 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b8498-dec5-402c-a5af-dfc391bc5c00 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:31.510779 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 347/673] 10.222.0.85 () {56 vars in 1148 bytes} [Thu Jun 16 14:43:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:31.511458 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480cee5-3b36-4649-898e-6997135798d6 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:31.578624 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:31.617226 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:31.618889 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b8498-dec5-402c-a5af-dfc391bc5c00 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:31.644491 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480cee5-3b36-4649-898e-6997135798d6 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:31.662572 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c66ee5-894c-4f03-9ac3-f017ca1955dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:31.663542 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c66ee5-894c-4f03-9ac3-f017ca1955dd None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:31.663820 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c66ee5-894c-4f03-9ac3-f017ca1955dd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:31.664123 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c66ee5-894c-4f03-9ac3-f017ca1955dd None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:31.665044 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c66ee5-894c-4f03-9ac3-f017ca1955dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:31.665632 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c66ee5-894c-4f03-9ac3-f017ca1955dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:31.667594 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c66ee5-894c-4f03-9ac3-f017ca1955dd None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:31.685407 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 327/674] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:31.685407 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c66ee5-894c-4f03-9ac3-f017ca1955dd None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:31.691824 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f7198-9f5a-46dd-9c4a-7943608f23d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:31.692658 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f7198-9f5a-46dd-9c4a-7943608f23d5 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:31.692938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f7198-9f5a-46dd-9c4a-7943608f23d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:31.693208 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f7198-9f5a-46dd-9c4a-7943608f23d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:31.701277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f7198-9f5a-46dd-9c4a-7943608f23d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:31.702776 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f7198-9f5a-46dd-9c4a-7943608f23d5 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:31.717128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-aa4f7198-9f5a-46dd-9c4a-7943608f23d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:31.717128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:31.717128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:31.717128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:31.717128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:31.717128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:31.717128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:31.717128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:31.717128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:31.717128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:31.717128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:31.717128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:31.717128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:43:31.717128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:43:31.717128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:43:31.718133 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:43:31.718133 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:31.718133 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:31.718133 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:31.718133 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:31.718133 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:31.718133 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:31.718133 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:31.718133 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:31.718133 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:31.718133 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:31.718133 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:31.718133 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:31.718133 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:31.718133 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:31.718133 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:31.718133 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:31.719023 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:43:31.719023 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:43:31.719023 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:43:31.719023 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:43:31.719023 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:43:31.719023 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:43:31.719023 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:31.719023 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:31.719023 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 348/675] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:31.719787 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f7198-9f5a-46dd-9c4a-7943608f23d5 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:31.811561 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c66ee5-894c-4f03-9ac3-f017ca1955dd None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:31.836192 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f7198-9f5a-46dd-9c4a-7943608f23d5 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:31.843696 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:31.852537 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea148e2-cc29-435b-874b-ee02a0650e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:31.855237 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea148e2-cc29-435b-874b-ee02a0650e59 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:31.855522 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea148e2-cc29-435b-874b-ee02a0650e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:31.855820 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea148e2-cc29-435b-874b-ee02a0650e59 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:31.856612 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea148e2-cc29-435b-874b-ee02a0650e59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:31.856923 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea148e2-cc29-435b-874b-ee02a0650e59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:31.859397 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea148e2-cc29-435b-874b-ee02a0650e59 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:31.876903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b7e24-b3af-4348-a6a7-4a9c98d488db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:31.877478 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b7e24-b3af-4348-a6a7-4a9c98d488db None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:31.877781 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b7e24-b3af-4348-a6a7-4a9c98d488db None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:31.877940 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 328/676] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:31.878114 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b7e24-b3af-4348-a6a7-4a9c98d488db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:31.879038 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b7e24-b3af-4348-a6a7-4a9c98d488db None admin] RBAC: Adding query filter params (role.id=17fa92022f834aa5bf5cb9e3a506a478, scope.project.id=80e309a3b3784ba9943734a41949b222, user.id=1d0ac98d9520470483c348644566d9ea) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:31.879327 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ccdd7-c5e5-4581-893a-71ad0b4a2064 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:31.879425 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b7e24-b3af-4348-a6a7-4a9c98d488db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:31.879613 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ccdd7-c5e5-4581-893a-71ad0b4a2064 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:31.879896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ccdd7-c5e5-4581-893a-71ad0b4a2064 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:31.880823 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b7e24-b3af-4348-a6a7-4a9c98d488db None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:31.884060 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 329/677] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:31.884060 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ccdd7-c5e5-4581-893a-71ad0b4a2064 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:31.897326 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 349/678] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:31 2022] GET /identity/v3/role_assignments?user.id=1d0ac98d9520470483c348644566d9ea&scope.project.id=80e309a3b3784ba9943734a41949b222&role.id=17fa92022f834aa5bf5cb9e3a506a478 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:31.898311 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b7e24-b3af-4348-a6a7-4a9c98d488db None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:31.919127 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:32.020118 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ccdd7-c5e5-4581-893a-71ad0b4a2064 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:32.033135 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b7e24-b3af-4348-a6a7-4a9c98d488db None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:32.067840 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc61fc4-0071-4668-a4b0-5c03948f636a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:32.068735 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc61fc4-0071-4668-a4b0-5c03948f636a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:32.069021 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc61fc4-0071-4668-a4b0-5c03948f636a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:32.069298 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc61fc4-0071-4668-a4b0-5c03948f636a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:32.078071 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc61fc4-0071-4668-a4b0-5c03948f636a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:32.079624 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc61fc4-0071-4668-a4b0-5c03948f636a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:32.081033 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3800b-007a-4dc5-9d19-02010c193717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:32.081722 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3800b-007a-4dc5-9d19-02010c193717 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:32.082032 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3800b-007a-4dc5-9d19-02010c193717 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:32.082469 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3800b-007a-4dc5-9d19-02010c193717 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:32.083123 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3800b-007a-4dc5-9d19-02010c193717 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:32.083432 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3800b-007a-4dc5-9d19-02010c193717 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:32.084930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3800b-007a-4dc5-9d19-02010c193717 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:32.097694 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-3dc61fc4-0071-4668-a4b0-5c03948f636a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 14:43:32.097694 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:32.097694 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:32.097694 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:32.097694 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:32.097694 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:32.097694 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:32.097694 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:32.097694 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:32.097694 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:32.097694 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:32.097694 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:32.097694 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:43:32.097694 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:43:32.097694 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:43:32.097694 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:43:32.098731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:32.098731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:32.098731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:43:32.098731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:32.098731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:43:32.098731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:32.098731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:32.098731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:32.098731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:32.098731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:32.098731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:32.098731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:32.098731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:32.098731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:32.098731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:32.098731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:32.098731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:32.098731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:32.099791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:32.099791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:32.099791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:43:32.099791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:43:32.099791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:43:32.099791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:43:32.099791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:43:32.099791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:43:32.099791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 14:43:32.099791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:32.099791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 330/679] 10.222.0.85 () {56 vars in 1096 bytes} [Thu Jun 16 14:43:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:32.101359 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc61fc4-0071-4668-a4b0-5c03948f636a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:32.109359 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 350/680] 10.222.0.85 () {56 vars in 1148 bytes} [Thu Jun 16 14:43:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:32.109359 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00ace1-fe24-4dde-a41c-a4ba6594aeab None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:32.109359 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00ace1-fe24-4dde-a41c-a4ba6594aeab None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:32.109359 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00ace1-fe24-4dde-a41c-a4ba6594aeab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:32.130020 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-bd00ace1-fe24-4dde-a41c-a4ba6594aeab None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:32.131142 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-bd00ace1-fe24-4dde-a41c-a4ba6594aeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:32.167495 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:32.212722 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:32.219936 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 351/681] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:32.219936 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00ace1-fe24-4dde-a41c-a4ba6594aeab None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:32.250011 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc61fc4-0071-4668-a4b0-5c03948f636a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:32.305085 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb9cfd-27bd-4900-8c45-ca17ac2cd26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:32.306327 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb9cfd-27bd-4900-8c45-ca17ac2cd26e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:32.306629 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb9cfd-27bd-4900-8c45-ca17ac2cd26e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:32.307062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb9cfd-27bd-4900-8c45-ca17ac2cd26e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:32.322854 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb9cfd-27bd-4900-8c45-ca17ac2cd26e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:32.325346 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb9cfd-27bd-4900-8c45-ca17ac2cd26e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:32.343653 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-eedb9cfd-27bd-4900-8c45-ca17ac2cd26e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:32.343653 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:32.343653 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:32.343653 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:32.343653 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:32.343653 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:32.343653 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:32.343653 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:32.343653 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:32.343653 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:32.343653 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:32.343653 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:32.343653 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:43:32.343653 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:43:32.343653 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:43:32.344779 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:43:32.344779 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:32.344779 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:32.344779 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:32.344779 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:32.344779 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:32.344779 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:32.344779 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:32.344779 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:32.344779 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:32.344779 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:32.344779 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:32.344779 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:32.344779 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:32.344779 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:32.344779 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:32.344779 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:32.345761 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:43:32.345761 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:43:32.345761 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:43:32.345761 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:43:32.345761 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:43:32.345761 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:43:32.345761 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:32.345761 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:32.345761 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 331/682] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:32.346246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb9cfd-27bd-4900-8c45-ca17ac2cd26e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:32.362539 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00ace1-fe24-4dde-a41c-a4ba6594aeab None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:32.410696 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f7d15-ef6e-4d99-a4fc-53a747f9cce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:32.411353 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f7d15-ef6e-4d99-a4fc-53a747f9cce2 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:32.411614 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f7d15-ef6e-4d99-a4fc-53a747f9cce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:32.411883 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f7d15-ef6e-4d99-a4fc-53a747f9cce2 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:32.412775 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f7d15-ef6e-4d99-a4fc-53a747f9cce2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:32.413088 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f7d15-ef6e-4d99-a4fc-53a747f9cce2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:32.414544 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f7d15-ef6e-4d99-a4fc-53a747f9cce2 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:32.439458 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 352/683] 10.222.0.85 () {56 vars in 1135 bytes} [Thu Jun 16 14:43:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:32.440788 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f7d15-ef6e-4d99-a4fc-53a747f9cce2 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:32.486447 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb9cfd-27bd-4900-8c45-ca17ac2cd26e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:32.494739 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:32.514176 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:32.535316 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c70f2-5242-4418-8bd3-e4d903ba708f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:32.536021 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c70f2-5242-4418-8bd3-e4d903ba708f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:32.536303 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c70f2-5242-4418-8bd3-e4d903ba708f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:32.536573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c70f2-5242-4418-8bd3-e4d903ba708f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:32.537980 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c70f2-5242-4418-8bd3-e4d903ba708f None admin] RBAC: Adding query filter params (role.id=17fa92022f834aa5bf5cb9e3a506a478, scope.project.id=80e309a3b3784ba9943734a41949b222, user.id=5819a7d47f644bc18e6d07a125826d76) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:32.538297 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c70f2-5242-4418-8bd3-e4d903ba708f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:32.540346 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c70f2-5242-4418-8bd3-e4d903ba708f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:32.557660 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 332/684] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:32 2022] GET /identity/v3/role_assignments?user.id=5819a7d47f644bc18e6d07a125826d76&scope.project.id=80e309a3b3784ba9943734a41949b222&role.id=17fa92022f834aa5bf5cb9e3a506a478 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:32.557660 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c70f2-5242-4418-8bd3-e4d903ba708f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:32.573750 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f7d15-ef6e-4d99-a4fc-53a747f9cce2 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:32.628429 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99c541-dcba-41aa-993c-447c3fe929ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:32.629280 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99c541-dcba-41aa-993c-447c3fe929ad None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:32.629557 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99c541-dcba-41aa-993c-447c3fe929ad None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:32.629831 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99c541-dcba-41aa-993c-447c3fe929ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:32.642855 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99c541-dcba-41aa-993c-447c3fe929ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:32.654180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-3b99c541-dcba-41aa-993c-447c3fe929ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:32.654180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:32.654180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:32.654180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:32.654180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:32.654180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:32.654180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:32.654180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:32.654180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:32.654180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:32.654180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:32.654180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:32.654180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:32.654180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:32.654180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:32.654180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:32.655231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:32.655231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:32.655231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:32.655231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:32.655231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:32.655231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:32.655231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:32.655231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:32.655231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:32.655231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:32.655231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:32.655231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:32.655231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:32.655231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:32.655231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:32.655231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:32.656116 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:32.656116 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:32.656116 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:32.656116 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:32.656116 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:32.656116 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:32.656116 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:32.656116 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:32.656116 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:32.656116 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:32.656116 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:32.656116 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:32.665233 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 353/685] 10.222.0.85 () {56 vars in 1096 bytes} [Thu Jun 16 14:43:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:32.666686 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99c541-dcba-41aa-993c-447c3fe929ad None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:32.719388 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c70f2-5242-4418-8bd3-e4d903ba708f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:32.760912 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06e0cd-53c2-494e-870b-25a652d20262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:32.761922 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06e0cd-53c2-494e-870b-25a652d20262 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:32.762378 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06e0cd-53c2-494e-870b-25a652d20262 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:32.762828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06e0cd-53c2-494e-870b-25a652d20262 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:32.763847 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06e0cd-53c2-494e-870b-25a652d20262 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:32.764463 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06e0cd-53c2-494e-870b-25a652d20262 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:32.766161 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06e0cd-53c2-494e-870b-25a652d20262 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:32.780234 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 333/686] 10.222.0.85 () {56 vars in 1148 bytes} [Thu Jun 16 14:43:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:32.781398 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06e0cd-53c2-494e-870b-25a652d20262 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:32.803895 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99c541-dcba-41aa-993c-447c3fe929ad None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:32.815430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:32.822750 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:32.855066 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109d296-12c7-4e0e-9904-cc9f1d813ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:32.855817 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109d296-12c7-4e0e-9904-cc9f1d813ecf None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:32.856085 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109d296-12c7-4e0e-9904-cc9f1d813ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:32.856318 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109d296-12c7-4e0e-9904-cc9f1d813ecf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:32.920814 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06e0cd-53c2-494e-870b-25a652d20262 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:32.935335 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e109d296-12c7-4e0e-9904-cc9f1d813ecf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:32.936841 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e109d296-12c7-4e0e-9904-cc9f1d813ecf None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:32.973386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb66ab5-36ff-422a-8a10-6e135a2c9efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:32.974231 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb66ab5-36ff-422a-8a10-6e135a2c9efb None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:32.974522 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb66ab5-36ff-422a-8a10-6e135a2c9efb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:32.974800 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb66ab5-36ff-422a-8a10-6e135a2c9efb None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:32.975567 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb66ab5-36ff-422a-8a10-6e135a2c9efb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:32.975901 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb66ab5-36ff-422a-8a10-6e135a2c9efb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:32.977298 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb66ab5-36ff-422a-8a10-6e135a2c9efb None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:32.992189 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 334/687] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:32.993284 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb66ab5-36ff-422a-8a10-6e135a2c9efb None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:33.046049 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 354/688] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:33.047343 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109d296-12c7-4e0e-9904-cc9f1d813ecf None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:33.069832 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:33.112354 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:33.123405 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb66ab5-36ff-422a-8a10-6e135a2c9efb None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:33.161613 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f3429-2518-4180-9940-abb37a2e9f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:33.162316 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f3429-2518-4180-9940-abb37a2e9f20 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:33.162600 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f3429-2518-4180-9940-abb37a2e9f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:33.162877 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f3429-2518-4180-9940-abb37a2e9f20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:33.163732 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f3429-2518-4180-9940-abb37a2e9f20 None admin] RBAC: Adding query filter params (role.id=17fa92022f834aa5bf5cb9e3a506a478, scope.project.id=80e309a3b3784ba9943734a41949b222, user.id=3d3d59fabcf94718bbc005519cec6f6c) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:33.164070 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f3429-2518-4180-9940-abb37a2e9f20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:33.165801 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f3429-2518-4180-9940-abb37a2e9f20 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:33.173954 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 335/689] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:32 2022] GET /identity/v3/role_assignments?user.id=3d3d59fabcf94718bbc005519cec6f6c&scope.project.id=80e309a3b3784ba9943734a41949b222&role.id=17fa92022f834aa5bf5cb9e3a506a478 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:33.174743 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f3429-2518-4180-9940-abb37a2e9f20 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:33.232380 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109d296-12c7-4e0e-9904-cc9f1d813ecf None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:33.292035 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f3429-2518-4180-9940-abb37a2e9f20 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:33.325784 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867d4c8-c8a3-4578-89c6-5d939fb550a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:33.326870 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867d4c8-c8a3-4578-89c6-5d939fb550a8 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:33.327296 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867d4c8-c8a3-4578-89c6-5d939fb550a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:33.327744 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867d4c8-c8a3-4578-89c6-5d939fb550a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:33.332753 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63919ef1-6a36-45aa-944a-23f46057cfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:33.333576 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63919ef1-6a36-45aa-944a-23f46057cfe7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:33.333856 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63919ef1-6a36-45aa-944a-23f46057cfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:33.334247 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63919ef1-6a36-45aa-944a-23f46057cfe7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:33.347751 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63919ef1-6a36-45aa-944a-23f46057cfe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:33.349306 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63919ef1-6a36-45aa-944a-23f46057cfe7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:33.354747 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867d4c8-c8a3-4578-89c6-5d939fb550a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:33.356978 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867d4c8-c8a3-4578-89c6-5d939fb550a8 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:33.369243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-63919ef1-6a36-45aa-944a-23f46057cfe7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:33.369243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:33.369243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:33.369243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:33.369243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:33.369243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:33.369243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:33.369243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:33.369243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:33.369243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:33.369243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:33.369243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:33.369243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:33.369243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:33.369243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:33.371424 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:33.371424 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:33.371424 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:33.371424 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:33.371424 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:33.371424 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:33.371424 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:33.371424 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:33.371424 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:33.371424 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:33.371424 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:33.371424 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:33.371424 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:33.371424 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:33.371424 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:33.371424 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:33.371424 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:33.373496 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:33.373496 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:33.373496 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:33.373496 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:33.373496 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 336/690] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:33.381196 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63919ef1-6a36-45aa-944a-23f46057cfe7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:33.394101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-c867d4c8-c8a3-4578-89c6-5d939fb550a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:33.394101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:33.394101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:33.394101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:33.394101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:33.394101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:33.394101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:33.394101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:33.394101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:33.394101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:33.394101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:33.394101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:33.394101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:33.394101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:33.394101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:33.396192 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:33.396192 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:33.396192 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:33.396192 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:33.396192 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:33.396192 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:33.396192 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:33.396192 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:33.396192 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:33.396192 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:33.396192 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:33.396192 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:33.396192 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:33.396192 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:33.396192 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:33.396192 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:33.396192 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:33.398298 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:33.398298 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:33.398298 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:33.398298 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:33.402814 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 355/691] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:33.404895 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867d4c8-c8a3-4578-89c6-5d939fb550a8 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:33.405819 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:33.508351 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:33.571761 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63919ef1-6a36-45aa-944a-23f46057cfe7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:33.572192 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867d4c8-c8a3-4578-89c6-5d939fb550a8 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:33.610672 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed452d4-3cbd-4076-9c4f-c3cd2e965d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:33.611373 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed452d4-3cbd-4076-9c4f-c3cd2e965d47 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:33.611659 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed452d4-3cbd-4076-9c4f-c3cd2e965d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:33.611982 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed452d4-3cbd-4076-9c4f-c3cd2e965d47 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:33.612747 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed452d4-3cbd-4076-9c4f-c3cd2e965d47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:33.613072 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed452d4-3cbd-4076-9c4f-c3cd2e965d47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:33.614605 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed452d4-3cbd-4076-9c4f-c3cd2e965d47 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:33.629616 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 337/692] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:33.635760 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed452d4-3cbd-4076-9c4f-c3cd2e965d47 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:33.639718 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f52ee0-958a-410f-a7cb-8193f549d9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:33.640488 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f52ee0-958a-410f-a7cb-8193f549d9fe None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:33.640771 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f52ee0-958a-410f-a7cb-8193f549d9fe None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:33.641044 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f52ee0-958a-410f-a7cb-8193f549d9fe None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:33.641779 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f52ee0-958a-410f-a7cb-8193f549d9fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:33.642081 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f52ee0-958a-410f-a7cb-8193f549d9fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:33.643479 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f52ee0-958a-410f-a7cb-8193f549d9fe None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:33.662247 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 356/693] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:33.665032 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f52ee0-958a-410f-a7cb-8193f549d9fe None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:33.714119 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:33.752711 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed452d4-3cbd-4076-9c4f-c3cd2e965d47 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:33.775399 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f52ee0-958a-410f-a7cb-8193f549d9fe None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:33.801073 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceaef2a-1f44-428a-88d0-da5012e2ba84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:33.802909 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceaef2a-1f44-428a-88d0-da5012e2ba84 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:33.803404 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceaef2a-1f44-428a-88d0-da5012e2ba84 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:33.804350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceaef2a-1f44-428a-88d0-da5012e2ba84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:33.804894 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:33.810405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79dffb2-7a6f-4e9a-a1ec-43247c48fe51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:33.811396 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dffb2-7a6f-4e9a-a1ec-43247c48fe51 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:33.811811 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dffb2-7a6f-4e9a-a1ec-43247c48fe51 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:33.812211 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dffb2-7a6f-4e9a-a1ec-43247c48fe51 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:33.814913 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceaef2a-1f44-428a-88d0-da5012e2ba84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:33.817153 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceaef2a-1f44-428a-88d0-da5012e2ba84 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:33.821332 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79dffb2-7a6f-4e9a-a1ec-43247c48fe51 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:33.823119 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79dffb2-7a6f-4e9a-a1ec-43247c48fe51 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:33.834327 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-0ceaef2a-1f44-428a-88d0-da5012e2ba84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:33.834327 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:33.834327 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:33.834327 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:33.834327 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:33.834327 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:33.834327 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:33.834327 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:33.834327 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:33.834327 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:33.834327 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:33.834327 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:33.834327 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:43:33.834327 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:43:33.834327 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:43:33.835416 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:43:33.835416 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:33.835416 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:33.835416 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:33.835416 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:33.835416 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:33.835416 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:33.835416 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:33.835416 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:33.835416 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:33.835416 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:33.835416 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:33.835416 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:33.835416 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:33.835416 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:33.835416 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:33.835416 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:33.836451 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:43:33.836451 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:43:33.836451 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:43:33.836451 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:43:33.836451 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:43:33.836451 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:43:33.836451 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:33.836451 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:33.838790 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 338/694] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:33.844293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-e79dffb2-7a6f-4e9a-a1ec-43247c48fe51 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:43:33.844293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:33.844293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:33.844293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:33.844293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:33.844293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:33.844293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:33.844293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:33.844293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:33.844293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:33.844293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:33.844293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:33.844293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:43:33.844293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:43:33.844293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:43:33.844293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:43:33.845463 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:33.845463 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:33.845463 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:43:33.845463 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:33.845463 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:43:33.845463 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:33.845463 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:33.845463 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:33.845463 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:33.845463 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:33.845463 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:33.845463 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:33.845463 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:33.845463 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:33.845463 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:33.845463 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:33.845463 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:33.845463 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:33.846767 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:33.846767 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:33.846767 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:43:33.846767 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:43:33.846767 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:43:33.846767 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:43:33.846767 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:43:33.846767 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:43:33.846767 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:43:33.846767 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:33.847953 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceaef2a-1f44-428a-88d0-da5012e2ba84 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:33.851920 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 357/695] 10.222.0.85 () {56 vars in 1093 bytes} [Thu Jun 16 14:43:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:33.855847 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79dffb2-7a6f-4e9a-a1ec-43247c48fe51 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:33.980715 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceaef2a-1f44-428a-88d0-da5012e2ba84 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:34.015074 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:34.026107 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e350141-d72f-4072-9cf2-5587b64d8267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:34.027033 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e350141-d72f-4072-9cf2-5587b64d8267 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:34.027447 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e350141-d72f-4072-9cf2-5587b64d8267 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:34.027853 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e350141-d72f-4072-9cf2-5587b64d8267 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:34.028953 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e350141-d72f-4072-9cf2-5587b64d8267 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:34.029438 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e350141-d72f-4072-9cf2-5587b64d8267 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:34.031633 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e350141-d72f-4072-9cf2-5587b64d8267 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:34.047595 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 339/696] 10.222.0.85 () {56 vars in 1148 bytes} [Thu Jun 16 14:43:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:34.053986 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e350141-d72f-4072-9cf2-5587b64d8267 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:34.099049 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79dffb2-7a6f-4e9a-a1ec-43247c48fe51 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:34.165340 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e350141-d72f-4072-9cf2-5587b64d8267 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:34.181245 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b541327-97e3-4eca-8edc-03c3d74b8aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:34.182052 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b541327-97e3-4eca-8edc-03c3d74b8aca None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:34.182347 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b541327-97e3-4eca-8edc-03c3d74b8aca None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:34.182628 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b541327-97e3-4eca-8edc-03c3d74b8aca None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:34.183487 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b541327-97e3-4eca-8edc-03c3d74b8aca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:34.183800 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b541327-97e3-4eca-8edc-03c3d74b8aca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:34.185303 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b541327-97e3-4eca-8edc-03c3d74b8aca None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:34.205074 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45dd04-c259-4255-aef6-cb4539648af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:34.206036 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45dd04-c259-4255-aef6-cb4539648af4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:34.206468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45dd04-c259-4255-aef6-cb4539648af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:34.206893 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45dd04-c259-4255-aef6-cb4539648af4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:34.207913 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45dd04-c259-4255-aef6-cb4539648af4 None admin] RBAC: Adding query filter params (role.id=17fa92022f834aa5bf5cb9e3a506a478, scope.project.id=80e309a3b3784ba9943734a41949b222, user.id=bf9c39de29324b0ca6329c9a171367c4) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:34.208394 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45dd04-c259-4255-aef6-cb4539648af4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:34.210058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45dd04-c259-4255-aef6-cb4539648af4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:34.219591 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 340/697] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:34 2022] GET /identity/v3/role_assignments?user.id=bf9c39de29324b0ca6329c9a171367c4&scope.project.id=80e309a3b3784ba9943734a41949b222&role.id=17fa92022f834aa5bf5cb9e3a506a478 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:34.223924 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 358/698] 10.222.0.85 () {56 vars in 1133 bytes} [Thu Jun 16 14:43:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:34.227269 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45dd04-c259-4255-aef6-cb4539648af4 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:34.323759 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:34.357518 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45dd04-c259-4255-aef6-cb4539648af4 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:34.398406 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f720b0-4418-4f68-bebe-5b16717d4c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:34.399396 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f720b0-4418-4f68-bebe-5b16717d4c22 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:34.400022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f720b0-4418-4f68-bebe-5b16717d4c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:34.400449 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f720b0-4418-4f68-bebe-5b16717d4c22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:34.479951 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f720b0-4418-4f68-bebe-5b16717d4c22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:34.481842 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f720b0-4418-4f68-bebe-5b16717d4c22 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:34.544293 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:34.598564 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 341/699] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:34.604265 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b541327-97e3-4eca-8edc-03c3d74b8aca None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:34.670018 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:34.736916 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b541327-97e3-4eca-8edc-03c3d74b8aca None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:34.774129 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8bba1-47d2-40fb-a5e0-ae3954797f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:34.775097 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8bba1-47d2-40fb-a5e0-ae3954797f00 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:34.775384 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8bba1-47d2-40fb-a5e0-ae3954797f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:34.775664 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8bba1-47d2-40fb-a5e0-ae3954797f00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:34.779163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd51a96-ed3d-4dd1-86e4-1624ec022477 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:34.779624 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd51a96-ed3d-4dd1-86e4-1624ec022477 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:34.780037 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd51a96-ed3d-4dd1-86e4-1624ec022477 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:34.787092 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a8bba1-47d2-40fb-a5e0-ae3954797f00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:34.788378 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 342/700] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:34 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:34.788619 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a8bba1-47d2-40fb-a5e0-ae3954797f00 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:34.791605 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcb66c-b407-4402-8829-b9c9334f8fe0 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:34.792104 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcb66c-b407-4402-8829-b9c9334f8fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:34.792612 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcb66c-b407-4402-8829-b9c9334f8fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:34.812173 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-d9a8bba1-47d2-40fb-a5e0-ae3954797f00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:34.812173 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:34.812173 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:34.812173 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:34.812173 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:34.812173 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:34.812173 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:34.812173 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:34.812173 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:34.812173 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:34.812173 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:34.812173 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:34.812173 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:34.812173 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:34.812173 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:34.813196 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:34.813196 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:34.813196 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:34.813196 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:34.813196 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:34.813196 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:34.813196 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:34.813196 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:34.813196 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:34.813196 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:34.813196 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:34.813196 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:34.813196 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:34.813196 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:34.813196 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:34.813196 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:34.813196 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:34.814112 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:34.814112 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:34.814112 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:34.814112 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:34.814795 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 359/701] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:34.821251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8bba1-47d2-40fb-a5e0-ae3954797f00 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:34.825747 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-61bcb66c-b407-4402-8829-b9c9334f8fe0 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:34.826973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-61bcb66c-b407-4402-8829-b9c9334f8fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:34.921493 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 343/702] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:43:34.952394 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcb66c-b407-4402-8829-b9c9334f8fe0 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:34.991323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:34.996775 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8bba1-47d2-40fb-a5e0-ae3954797f00 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:35.086924 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:35.097342 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409a985-e04f-471e-b928-41e4c6073832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:35.098029 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409a985-e04f-471e-b928-41e4c6073832 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:35.098307 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409a985-e04f-471e-b928-41e4c6073832 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:35.098586 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409a985-e04f-471e-b928-41e4c6073832 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:35.099313 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409a985-e04f-471e-b928-41e4c6073832 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:35.099618 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409a985-e04f-471e-b928-41e4c6073832 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:35.102049 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409a985-e04f-471e-b928-41e4c6073832 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:35.122045 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 360/703] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:35.122834 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcb66c-b407-4402-8829-b9c9334f8fe0 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:35.128145 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eab1c0-2991-4d9c-b14c-558020baf6a0 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:35.128440 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eab1c0-2991-4d9c-b14c-558020baf6a0 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:35.128700 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eab1c0-2991-4d9c-b14c-558020baf6a0 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:35.130387 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 361/704] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:35.132347 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eab1c0-2991-4d9c-b14c-558020baf6a0 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:35.161312 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06437f-56d2-4d3e-9a6b-cdd0f258e60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:35.162157 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06437f-56d2-4d3e-9a6b-cdd0f258e60b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:35.162437 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06437f-56d2-4d3e-9a6b-cdd0f258e60b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:35.162726 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06437f-56d2-4d3e-9a6b-cdd0f258e60b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:35.163358 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06437f-56d2-4d3e-9a6b-cdd0f258e60b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:35.164883 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06437f-56d2-4d3e-9a6b-cdd0f258e60b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:35.180635 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-7d06437f-56d2-4d3e-9a6b-cdd0f258e60b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 14:43:35.180635 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:35.180635 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:43:35.180635 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:43:35.180635 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:43:35.180635 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:43:35.180635 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:43:35.180635 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:43:35.180635 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 14:43:35.180635 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:35.180635 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:43:35.180635 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:35.180635 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:35.180635 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:35.180635 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:35.180635 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:35.181741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:35.181741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:35.181741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:35.181741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:35.181741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:35.181741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:35.181741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:35.181741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:43:35.181741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:43:35.181741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:43:35.181741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:43:35.181741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:35.181741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:35.181741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:35.181741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:35.181741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:35.182573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:35.182573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:35.182573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:35.182573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:35.182573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:35.182573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:35.182573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:35.182573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:35.182573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:35.182573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:35.182573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:35.182573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:43:35.182573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:43:35.182573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 14:43:35.182573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:35.182573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 344/705] 10.222.0.85 () {56 vars in 1129 bytes} [Thu Jun 16 14:43:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:35.184000 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0559e28-592d-4a0f-93af-1f0287a36542 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:35.188700 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0559e28-592d-4a0f-93af-1f0287a36542 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:35.189008 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0559e28-592d-4a0f-93af-1f0287a36542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:35.209071 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a0559e28-592d-4a0f-93af-1f0287a36542 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:35.210818 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a0559e28-592d-4a0f-93af-1f0287a36542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:35.264379 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eab1c0-2991-4d9c-b14c-558020baf6a0 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:35.307938 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 345/706] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:35.307938 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0559e28-592d-4a0f-93af-1f0287a36542 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:35.316529 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11612088-1dbd-4b71-95bc-0854746cf551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:35.317584 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11612088-1dbd-4b71-95bc-0854746cf551 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:35.318020 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11612088-1dbd-4b71-95bc-0854746cf551 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:35.318438 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11612088-1dbd-4b71-95bc-0854746cf551 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:35.332953 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11612088-1dbd-4b71-95bc-0854746cf551 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:35.334697 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11612088-1dbd-4b71-95bc-0854746cf551 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:35.350204 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-11612088-1dbd-4b71-95bc-0854746cf551 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:35.350204 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:35.350204 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:35.350204 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:35.350204 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:35.350204 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:35.350204 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:35.350204 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:35.350204 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:35.350204 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:35.350204 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:35.350204 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:35.350204 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:43:35.350204 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:43:35.350204 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:43:35.351246 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:43:35.351246 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:35.351246 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:35.351246 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:35.351246 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:35.351246 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:35.351246 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:35.351246 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:35.351246 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:35.351246 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:35.351246 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:35.351246 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:35.351246 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:35.351246 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:35.351246 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:35.351246 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:35.351246 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:35.352225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:43:35.352225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:43:35.352225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:43:35.352225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:43:35.352225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:43:35.352225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:43:35.352225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:35.352225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:35.354957 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 362/707] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:35.356067 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11612088-1dbd-4b71-95bc-0854746cf551 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:35.382265 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:35.429232 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:35.457940 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0559e28-592d-4a0f-93af-1f0287a36542 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:35.475857 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11612088-1dbd-4b71-95bc-0854746cf551 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:35.502290 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5c87e-834d-46a8-89ab-b0a0c187f218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:35.503007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5c87e-834d-46a8-89ab-b0a0c187f218 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:35.503744 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5c87e-834d-46a8-89ab-b0a0c187f218 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:35.504059 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5c87e-834d-46a8-89ab-b0a0c187f218 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:35.504942 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5c87e-834d-46a8-89ab-b0a0c187f218 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:35.505378 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5c87e-834d-46a8-89ab-b0a0c187f218 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:35.507089 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5c87e-834d-46a8-89ab-b0a0c187f218 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:35.519243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 346/708] 10.222.0.85 () {56 vars in 1124 bytes} [Thu Jun 16 14:43:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:35.519243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5c87e-834d-46a8-89ab-b0a0c187f218 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:35.521908 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8139d-b03f-448b-b9ea-6a17fd87019e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:35.523012 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8139d-b03f-448b-b9ea-6a17fd87019e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:35.523494 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8139d-b03f-448b-b9ea-6a17fd87019e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:35.524047 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8139d-b03f-448b-b9ea-6a17fd87019e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:35.537052 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b8139d-b03f-448b-b9ea-6a17fd87019e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:35.539187 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b8139d-b03f-448b-b9ea-6a17fd87019e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:35.564271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-55b8139d-b03f-448b-b9ea-6a17fd87019e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:35.564271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:35.564271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:35.564271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:35.564271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:35.564271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:35.564271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:35.564271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:35.564271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:35.564271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:35.564271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:35.564271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:35.564271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:35.564271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:35.564271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:35.565261 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:35.565261 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:35.565261 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:35.565261 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:35.565261 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:35.565261 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:35.565261 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:35.565261 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:35.565261 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:35.565261 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:35.565261 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:35.565261 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:35.565261 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:35.565261 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:35.565261 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:35.565261 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:35.565261 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:35.566692 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:35.566692 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:35.566692 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:35.566692 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:35.566692 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 363/709] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:35.566986 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8139d-b03f-448b-b9ea-6a17fd87019e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:35.642118 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5c87e-834d-46a8-89ab-b0a0c187f218 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:35.655070 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:35.690284 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b077ef6-ea61-4be0-904c-c770ae26c138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:35.691390 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b077ef6-ea61-4be0-904c-c770ae26c138 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:35.691916 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b077ef6-ea61-4be0-904c-c770ae26c138 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:35.692395 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b077ef6-ea61-4be0-904c-c770ae26c138 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:35.693386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b077ef6-ea61-4be0-904c-c770ae26c138 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:35.693890 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b077ef6-ea61-4be0-904c-c770ae26c138 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:35.695566 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b077ef6-ea61-4be0-904c-c770ae26c138 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:35.696607 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8139d-b03f-448b-b9ea-6a17fd87019e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:35.706865 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:35.716326 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 347/710] 10.222.0.85 () {56 vars in 1148 bytes} [Thu Jun 16 14:43:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:35.717592 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b077ef6-ea61-4be0-904c-c770ae26c138 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:35.744008 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90f72a-9f26-485a-aa53-a52dc4be01ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:35.744751 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90f72a-9f26-485a-aa53-a52dc4be01ea None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:35.745032 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90f72a-9f26-485a-aa53-a52dc4be01ea None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:35.745307 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90f72a-9f26-485a-aa53-a52dc4be01ea None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:35.746537 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90f72a-9f26-485a-aa53-a52dc4be01ea None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:35.746848 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90f72a-9f26-485a-aa53-a52dc4be01ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:35.748807 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90f72a-9f26-485a-aa53-a52dc4be01ea None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:35.763911 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 364/711] 10.222.0.85 () {56 vars in 1124 bytes} [Thu Jun 16 14:43:35 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:35.763911 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90f72a-9f26-485a-aa53-a52dc4be01ea None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:35.888508 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90f72a-9f26-485a-aa53-a52dc4be01ea None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:35.929874 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd0041-9106-4660-b09b-61c8c889ade9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:35.930552 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd0041-9106-4660-b09b-61c8c889ade9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:35.930937 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd0041-9106-4660-b09b-61c8c889ade9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:35.931200 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd0041-9106-4660-b09b-61c8c889ade9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:35.932739 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd0041-9106-4660-b09b-61c8c889ade9 None admin] RBAC: Adding query filter params (role.id=95dcfa6c726a4d01a41d2642554fd338, scope.project.id=80e309a3b3784ba9943734a41949b222, user.id=c74e4d1bdaa64ed280cc5f4c8e79b842) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:35.933068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd0041-9106-4660-b09b-61c8c889ade9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:35.935899 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd0041-9106-4660-b09b-61c8c889ade9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:35.939785 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:35.947816 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 365/712] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:35 2022] GET /identity/v3/role_assignments?user.id=c74e4d1bdaa64ed280cc5f4c8e79b842&scope.project.id=80e309a3b3784ba9943734a41949b222&role.id=95dcfa6c726a4d01a41d2642554fd338 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:35.967430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b077ef6-ea61-4be0-904c-c770ae26c138 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:36.032655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4a394-296f-4d08-bc70-325b460e3acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:36.033343 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4a394-296f-4d08-bc70-325b460e3acf None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:36.033623 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4a394-296f-4d08-bc70-325b460e3acf None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:36.033898 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4a394-296f-4d08-bc70-325b460e3acf None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:36.034774 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4a394-296f-4d08-bc70-325b460e3acf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:36.035078 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4a394-296f-4d08-bc70-325b460e3acf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:36.036601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4a394-296f-4d08-bc70-325b460e3acf None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:36.053625 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 348/713] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:36.061076 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd0041-9106-4660-b09b-61c8c889ade9 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:36.165361 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba97e9-95c7-4e03-bb8d-491b3a2696d2 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:36.165723 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba97e9-95c7-4e03-bb8d-491b3a2696d2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:36.166192 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba97e9-95c7-4e03-bb8d-491b3a2696d2 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:36.168635 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 349/714] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:43:36.176206 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281dc566-9761-4f3b-b827-6b7d7934e714 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:36.176739 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281dc566-9761-4f3b-b827-6b7d7934e714 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:36.177166 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281dc566-9761-4f3b-b827-6b7d7934e714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:36.204637 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-281dc566-9761-4f3b-b827-6b7d7934e714 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:36.206682 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-281dc566-9761-4f3b-b827-6b7d7934e714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:36.215561 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd0041-9106-4660-b09b-61c8c889ade9 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:36.258875 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e3aca-4d14-4393-8e9d-7ad34a2c037a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:36.259624 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e3aca-4d14-4393-8e9d-7ad34a2c037a None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:36.260364 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e3aca-4d14-4393-8e9d-7ad34a2c037a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:36.260364 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e3aca-4d14-4393-8e9d-7ad34a2c037a None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:36.261131 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e3aca-4d14-4393-8e9d-7ad34a2c037a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:36.262610 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e3aca-4d14-4393-8e9d-7ad34a2c037a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:36.282106 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:36.291779 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 350/715] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:36.298519 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 366/716] 10.222.0.85 () {60 vars in 1132 bytes} [Thu Jun 16 14:43:36 2022] POST /identity/v3/users => generated 254 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:43:36.314973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281dc566-9761-4f3b-b827-6b7d7934e714 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:36.436802 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281dc566-9761-4f3b-b827-6b7d7934e714 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:36.476336 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22ab91-bb7a-4234-bed0-6ca34d6d2d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:36.477484 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22ab91-bb7a-4234-bed0-6ca34d6d2d7e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:36.477977 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22ab91-bb7a-4234-bed0-6ca34d6d2d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:36.478462 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22ab91-bb7a-4234-bed0-6ca34d6d2d7e None admin] PATH_INFO: `/v3/services/network` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:36.479277 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f22ab91-bb7a-4234-bed0-6ca34d6d2d7e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:36.480865 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f22ab91-bb7a-4234-bed0-6ca34d6d2d7e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:36.494033 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-8f22ab91-bb7a-4234-bed0-6ca34d6d2d7e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 14:43:36.494033 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:36.494033 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:43:36.494033 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:43:36.494033 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:43:36.494033 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:43:36.494033 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:43:36.494033 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:43:36.494033 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 14:43:36.494033 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:36.494033 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:43:36.494033 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:36.494033 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:36.494033 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:36.494033 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:36.494033 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:36.494033 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:36.495276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:36.495276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:36.495276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:36.495276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:36.495276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:36.495276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:36.495276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:43:36.495276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:43:36.495276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:43:36.495276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:43:36.495276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:36.495276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:36.495276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:36.495276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:36.495276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:36.495276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:36.496350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:36.496350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:36.496350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:36.496350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:36.496350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:36.496350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:36.496350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:36.496350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:36.496350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:36.496350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:36.496350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:43:36.496350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:43:36.496350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 14:43:36.496350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:36.498966 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 351/717] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:36 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:36.506238 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e3aca-4d14-4393-8e9d-7ad34a2c037a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:36.610260 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:36.662802 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e3aca-4d14-4393-8e9d-7ad34a2c037a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:36.702069 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f3353-ef6d-46c8-b38a-951b5ced138b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:36.702749 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f3353-ef6d-46c8-b38a-951b5ced138b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:36.703025 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f3353-ef6d-46c8-b38a-951b5ced138b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:36.703299 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f3353-ef6d-46c8-b38a-951b5ced138b None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:36.704056 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370f3353-ef6d-46c8-b38a-951b5ced138b None admin] RBAC: Adding query filter params (name=network) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:36.704358 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370f3353-ef6d-46c8-b38a-951b5ced138b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:36.705743 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370f3353-ef6d-46c8-b38a-951b5ced138b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:36.710961 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 367/718] 10.222.0.85 () {56 vars in 1112 bytes} [Thu Jun 16 14:43:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:36.716615 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22ab91-bb7a-4234-bed0-6ca34d6d2d7e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:36.789820 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:36.842276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22ab91-bb7a-4234-bed0-6ca34d6d2d7e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:36.879700 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15b9e7-7fe2-4fdb-8597-6d6a5b71c1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:36.880874 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15b9e7-7fe2-4fdb-8597-6d6a5b71c1d8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:36.881363 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15b9e7-7fe2-4fdb-8597-6d6a5b71c1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:36.881837 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15b9e7-7fe2-4fdb-8597-6d6a5b71c1d8 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:36.882754 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15b9e7-7fe2-4fdb-8597-6d6a5b71c1d8 None admin] RBAC: Adding query filter params (type=network) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:36.883318 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15b9e7-7fe2-4fdb-8597-6d6a5b71c1d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:36.885083 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15b9e7-7fe2-4fdb-8597-6d6a5b71c1d8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:36.892430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 352/719] 10.222.0.85 () {56 vars in 1112 bytes} [Thu Jun 16 14:43:36 2022] GET /identity/v3/services?type=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:37.571718 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207031e-12bd-4047-96f0-d11ef33c0c8a None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:37.572389 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207031e-12bd-4047-96f0-d11ef33c0c8a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:37.572389 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207031e-12bd-4047-96f0-d11ef33c0c8a None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:37.573986 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 368/720] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:37.579595 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292980f3-5207-4cf1-b45b-e85d10643deb None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:37.580104 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292980f3-5207-4cf1-b45b-e85d10643deb None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:37.580180 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292980f3-5207-4cf1-b45b-e85d10643deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:37.598154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-292980f3-5207-4cf1-b45b-e85d10643deb None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:37.599361 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-292980f3-5207-4cf1-b45b-e85d10643deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:37.779079 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 353/721] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:43:37.807803 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207031e-12bd-4047-96f0-d11ef33c0c8a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:37.938351 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207031e-12bd-4047-96f0-d11ef33c0c8a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:37.957086 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:37.975497 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c30da-4f96-4689-b9b8-30c5d508fb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:37.976348 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c30da-4f96-4689-b9b8-30c5d508fb53 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:37.976633 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c30da-4f96-4689-b9b8-30c5d508fb53 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:37.976910 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c30da-4f96-4689-b9b8-30c5d508fb53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:37.989783 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c30da-4f96-4689-b9b8-30c5d508fb53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:37.997932 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-af3c30da-4f96-4689-b9b8-30c5d508fb53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:37.997932 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:37.997932 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:37.997932 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:37.997932 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:37.997932 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:37.997932 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:37.997932 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:37.997932 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:37.997932 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:37.997932 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:37.997932 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:37.997932 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:37.997932 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:37.997932 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:37.997932 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:37.998941 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:37.998941 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:37.998941 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:37.998941 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:37.998941 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:37.998941 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:37.998941 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:37.998941 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:37.998941 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:37.998941 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:37.998941 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:37.998941 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:37.998941 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:37.998941 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:37.998941 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:37.998941 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:37.999820 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:37.999820 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:37.999820 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:37.999820 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:37.999820 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:37.999820 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:37.999820 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:37.999820 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:37.999820 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:37.999820 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:37.999820 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:37.999820 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:37.999820 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 369/722] 10.222.0.85 () {56 vars in 1096 bytes} [Thu Jun 16 14:43:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:38.005452 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292980f3-5207-4cf1-b45b-e85d10643deb None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:38.115274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:38.232434 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292980f3-5207-4cf1-b45b-e85d10643deb None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:38.283634 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa9b7a-37fa-48b7-af24-72fff4233b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:38.284348 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa9b7a-37fa-48b7-af24-72fff4233b93 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:38.284634 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa9b7a-37fa-48b7-af24-72fff4233b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:38.284900 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa9b7a-37fa-48b7-af24-72fff4233b93 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:38.285669 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa9b7a-37fa-48b7-af24-72fff4233b93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:38.285976 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa9b7a-37fa-48b7-af24-72fff4233b93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:38.287384 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa9b7a-37fa-48b7-af24-72fff4233b93 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:38.298103 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 354/723] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:38.305020 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c30da-4f96-4689-b9b8-30c5d508fb53 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:38.505460 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c30da-4f96-4689-b9b8-30c5d508fb53 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:38.541056 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87229642-1836-4c6b-92f1-db4cc064bf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:38.541913 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87229642-1836-4c6b-92f1-db4cc064bf6e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:38.542204 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87229642-1836-4c6b-92f1-db4cc064bf6e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:38.542483 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87229642-1836-4c6b-92f1-db4cc064bf6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:38.556210 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87229642-1836-4c6b-92f1-db4cc064bf6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:38.557734 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87229642-1836-4c6b-92f1-db4cc064bf6e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:38.576718 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-87229642-1836-4c6b-92f1-db4cc064bf6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:38.576718 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:38.576718 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:38.576718 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:38.576718 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:38.576718 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:38.576718 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:38.576718 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:38.576718 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:38.576718 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:38.576718 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:38.576718 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:38.576718 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:38.576718 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:38.576718 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:38.578962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:38.578962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:38.578962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:38.578962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:38.578962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:38.578962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:38.578962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:38.578962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:38.578962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:38.578962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:38.578962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:38.578962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:38.578962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:38.578962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:38.578962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:38.578962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:38.578962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:38.581781 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:38.581781 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:38.581781 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:38.581781 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:38.581781 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 370/724] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:38.589168 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa9b7a-37fa-48b7-af24-72fff4233b93 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:38.699802 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e31b77-2adb-418d-89f6-d91712dba3d4 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:38.700220 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e31b77-2adb-418d-89f6-d91712dba3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:38.700477 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e31b77-2adb-418d-89f6-d91712dba3d4 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:38.702054 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 371/725] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:43:38.719116 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa9b7a-37fa-48b7-af24-72fff4233b93 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:38.721692 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa522e-6127-47de-adcd-c2a9dbfc8936 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:38.722038 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa522e-6127-47de-adcd-c2a9dbfc8936 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:38.722310 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa522e-6127-47de-adcd-c2a9dbfc8936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:38.740769 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:38.769147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b4aa522e-6127-47de-adcd-c2a9dbfc8936 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:38.773097 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b4aa522e-6127-47de-adcd-c2a9dbfc8936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:38.802378 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2dccc7-fc51-426c-852e-e736902382db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:38.804085 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dccc7-fc51-426c-852e-e736902382db None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:38.804763 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dccc7-fc51-426c-852e-e736902382db None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:38.806729 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dccc7-fc51-426c-852e-e736902382db None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:38.808129 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2dccc7-fc51-426c-852e-e736902382db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:38.809196 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2dccc7-fc51-426c-852e-e736902382db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:38.812055 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2dccc7-fc51-426c-852e-e736902382db None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:38.846031 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 355/726] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:38.852637 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:38.854275 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2dccc7-fc51-426c-852e-e736902382db None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:38.920708 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 372/727] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:38.923763 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa83853-cd51-4695-a91b-3563d20ce34c None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:38.924561 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa83853-cd51-4695-a91b-3563d20ce34c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:38.925431 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa83853-cd51-4695-a91b-3563d20ce34c None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:38.928495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 373/728] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:38.941431 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55907fa7-f52d-40f1-b056-59441065e4b5 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:38.942047 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55907fa7-f52d-40f1-b056-59441065e4b5 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:38.942543 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55907fa7-f52d-40f1-b056-59441065e4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:38.961862 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-55907fa7-f52d-40f1-b056-59441065e4b5 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:38.963766 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-55907fa7-f52d-40f1-b056-59441065e4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:38.978464 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2dccc7-fc51-426c-852e-e736902382db None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:39.016406 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f07368-0f66-4dda-854d-64f2019756bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:39.017221 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f07368-0f66-4dda-854d-64f2019756bd None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:39.017498 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f07368-0f66-4dda-854d-64f2019756bd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:39.017764 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f07368-0f66-4dda-854d-64f2019756bd None admin] PATH_INFO: `/v3/users/swift` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:39.026922 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f07368-0f66-4dda-854d-64f2019756bd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:39.028441 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f07368-0f66-4dda-854d-64f2019756bd None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:39.043985 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 374/729] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:39.044611 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-d6f07368-0f66-4dda-854d-64f2019756bd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 14:43:39.044611 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:39.044611 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:39.044611 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:39.044611 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:39.044611 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:39.044611 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:39.044611 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:39.044611 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:39.044611 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:39.044611 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:39.044611 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:39.044611 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:43:39.044611 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:43:39.044611 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:43:39.044611 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:43:39.045540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:39.045540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:39.045540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:43:39.045540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:39.045540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:43:39.045540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:39.045540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:39.045540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:39.045540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:39.045540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:39.045540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:39.045540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:39.045540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:39.045540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:39.045540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:39.045540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:39.045540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:39.045540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:39.046505 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:39.046505 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:39.046505 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:43:39.046505 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:43:39.046505 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:43:39.046505 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:43:39.046505 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:43:39.046505 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:43:39.046505 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 14:43:39.046505 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:39.047420 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55907fa7-f52d-40f1-b056-59441065e4b5 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:39.047493 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 356/730] 10.222.0.85 () {56 vars in 1096 bytes} [Thu Jun 16 14:43:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:43:39.057067 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f07368-0f66-4dda-854d-64f2019756bd None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:39.097968 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:39.157498 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:39.169336 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55907fa7-f52d-40f1-b056-59441065e4b5 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:39.174961 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f07368-0f66-4dda-854d-64f2019756bd None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:39.207110 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60d5d5-8adb-424d-9462-909b29edf891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:39.207791 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60d5d5-8adb-424d-9462-909b29edf891 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:39.208129 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60d5d5-8adb-424d-9462-909b29edf891 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:39.208412 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60d5d5-8adb-424d-9462-909b29edf891 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:39.209144 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab60d5d5-8adb-424d-9462-909b29edf891 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:39.210528 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab60d5d5-8adb-424d-9462-909b29edf891 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:39.215399 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab094e-3d82-43f4-a31a-f9c376080bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:39.216440 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab094e-3d82-43f4-a31a-f9c376080bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:39.216910 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab094e-3d82-43f4-a31a-f9c376080bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:39.217186 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab094e-3d82-43f4-a31a-f9c376080bb8 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:39.218052 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab094e-3d82-43f4-a31a-f9c376080bb8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:39.218354 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab094e-3d82-43f4-a31a-f9c376080bb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:39.219776 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab094e-3d82-43f4-a31a-f9c376080bb8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:39.230245 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 375/731] 10.222.0.85 () {60 vars in 1141 bytes} [Thu Jun 16 14:43:39 2022] POST /identity/v3/services => generated 251 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:43:39.231664 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60d5d5-8adb-424d-9462-909b29edf891 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:39.241452 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 357/732] 10.222.0.85 () {56 vars in 1135 bytes} [Thu Jun 16 14:43:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:39.247530 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab094e-3d82-43f4-a31a-f9c376080bb8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:39.349588 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:39.364402 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab094e-3d82-43f4-a31a-f9c376080bb8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:39.383995 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60d5d5-8adb-424d-9462-909b29edf891 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:39.408928 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9cb5b-0a27-45d8-9113-fda308718147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:39.410003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9cb5b-0a27-45d8-9113-fda308718147 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:39.410597 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9cb5b-0a27-45d8-9113-fda308718147 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:39.411072 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9cb5b-0a27-45d8-9113-fda308718147 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:39.445793 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0fbd5-a260-4156-8826-7e195b9fc4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:39.446756 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0fbd5-a260-4156-8826-7e195b9fc4e1 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:39.447027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0fbd5-a260-4156-8826-7e195b9fc4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:39.447299 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0fbd5-a260-4156-8826-7e195b9fc4e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:39.466857 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0fbd5-a260-4156-8826-7e195b9fc4e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:39.479680 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-5ac0fbd5-a260-4156-8826-7e195b9fc4e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:39.479680 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:39.479680 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:39.479680 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:39.479680 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:39.479680 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:39.479680 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:39.479680 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:39.479680 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:39.479680 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:39.479680 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:39.479680 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:39.479680 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:39.479680 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:39.479680 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:39.479680 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:39.482024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:39.482024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:39.482024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:39.482024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:39.482024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:39.482024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:39.482024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:39.482024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:39.482024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:39.482024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:39.482024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:39.482024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:39.482024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:39.482024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:39.482024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:39.482024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:39.482887 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:39.482887 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:39.482887 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:39.482887 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:39.482887 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:39.482887 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:39.482887 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:39.482887 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:39.482887 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:39.482887 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:39.482887 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:39.482887 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:39.492406 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 376/733] 10.222.0.85 () {56 vars in 1096 bytes} [Thu Jun 16 14:43:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:39.493538 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0fbd5-a260-4156-8826-7e195b9fc4e1 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:39.497428 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec9cb5b-0a27-45d8-9113-fda308718147 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:39.499110 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec9cb5b-0a27-45d8-9113-fda308718147 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:39.503451 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:39.601430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:39.614766 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0fbd5-a260-4156-8826-7e195b9fc4e1 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:39.621997 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 358/734] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:39 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 14:43:39.623931 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8706c21-2df8-4b21-a509-498354b57e45 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:39.624220 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8706c21-2df8-4b21-a509-498354b57e45 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:39.624501 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8706c21-2df8-4b21-a509-498354b57e45 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:39.628031 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 359/735] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:39.628895 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8706c21-2df8-4b21-a509-498354b57e45 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:39.663505 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d21cb3-ff3a-4a6f-9142-86b271a6007f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:39.664215 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d21cb3-ff3a-4a6f-9142-86b271a6007f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:39.664493 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d21cb3-ff3a-4a6f-9142-86b271a6007f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:39.664766 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d21cb3-ff3a-4a6f-9142-86b271a6007f None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:39.665668 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d21cb3-ff3a-4a6f-9142-86b271a6007f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:39.665954 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d21cb3-ff3a-4a6f-9142-86b271a6007f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:39.667441 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d21cb3-ff3a-4a6f-9142-86b271a6007f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:39.681656 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 377/736] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:39.681656 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db30685-73e5-4ead-aac8-b3dcf70163c8 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:39.681656 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db30685-73e5-4ead-aac8-b3dcf70163c8 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:39.681656 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db30685-73e5-4ead-aac8-b3dcf70163c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:39.698461 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-1db30685-73e5-4ead-aac8-b3dcf70163c8 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:39.699685 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1db30685-73e5-4ead-aac8-b3dcf70163c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:39.768261 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:39.771792 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8706c21-2df8-4b21-a509-498354b57e45 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:39.781661 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 378/737] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:39 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:39.782691 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db30685-73e5-4ead-aac8-b3dcf70163c8 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:39.813695 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf11e32-9267-4224-99db-a6ac76c6ce9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:39.814811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf11e32-9267-4224-99db-a6ac76c6ce9e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:39.815237 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf11e32-9267-4224-99db-a6ac76c6ce9e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:39.815654 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf11e32-9267-4224-99db-a6ac76c6ce9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:39.828701 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf11e32-9267-4224-99db-a6ac76c6ce9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:39.831272 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf11e32-9267-4224-99db-a6ac76c6ce9e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:39.856620 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-7bf11e32-9267-4224-99db-a6ac76c6ce9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:39.856620 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:39.856620 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:39.856620 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:39.856620 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:39.856620 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:39.856620 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:39.856620 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:39.856620 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:39.856620 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:39.856620 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:39.856620 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:39.856620 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:39.856620 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:39.856620 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:39.857846 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:39.857846 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:39.857846 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:39.857846 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:39.857846 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:39.857846 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:39.857846 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:39.857846 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:39.857846 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:39.857846 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:39.857846 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:39.857846 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:39.857846 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:39.857846 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:39.857846 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:39.857846 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:39.857846 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:39.858961 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:39.858961 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:39.858961 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:39.858961 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:39.860980 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 360/738] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:39.861973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf11e32-9267-4224-99db-a6ac76c6ce9e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:39.911930 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:39.931191 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db30685-73e5-4ead-aac8-b3dcf70163c8 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:39.982074 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5de99a-e044-4b80-bd4c-72b5615cfd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:39.983319 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5de99a-e044-4b80-bd4c-72b5615cfd38 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:39.984107 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5de99a-e044-4b80-bd4c-72b5615cfd38 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:39.984794 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5de99a-e044-4b80-bd4c-72b5615cfd38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:39.986677 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf11e32-9267-4224-99db-a6ac76c6ce9e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:39.999284 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5de99a-e044-4b80-bd4c-72b5615cfd38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:40.001145 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5de99a-e044-4b80-bd4c-72b5615cfd38 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:40.020942 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-cc5de99a-e044-4b80-bd4c-72b5615cfd38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:40.020942 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:40.020942 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:40.020942 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:40.020942 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:40.020942 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:40.020942 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:40.020942 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:40.020942 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:40.020942 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:40.020942 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:40.020942 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:40.020942 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:40.020942 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:40.020942 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:40.021914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:40.021914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:40.021914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:40.021914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:40.021914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:40.021914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:40.021914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:40.021914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:40.021914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:40.021914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:40.021914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:40.021914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:40.021914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:40.021914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:40.021914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:40.021914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:40.021914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:40.022814 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:40.022814 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:40.022814 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:40.022814 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:40.022814 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 379/739] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:40.023964 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5de99a-e044-4b80-bd4c-72b5615cfd38 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:40.028579 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d612b4-d3c5-4fba-9a59-271d0bc725bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:40.029404 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d612b4-d3c5-4fba-9a59-271d0bc725bd None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:40.029686 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d612b4-d3c5-4fba-9a59-271d0bc725bd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:40.029950 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d612b4-d3c5-4fba-9a59-271d0bc725bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:40.042949 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d612b4-d3c5-4fba-9a59-271d0bc725bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:40.051139 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-80d612b4-d3c5-4fba-9a59-271d0bc725bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:40.051139 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:40.051139 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:40.051139 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:40.051139 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:40.051139 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:40.051139 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:40.051139 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:40.051139 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:40.051139 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:40.051139 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:40.051139 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:40.051139 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:40.051139 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:40.051139 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:40.051139 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:40.052427 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:40.052427 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:40.052427 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:40.052427 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:40.052427 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:40.052427 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:40.052427 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:40.052427 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:40.052427 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:40.052427 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:40.052427 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:40.052427 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:40.052427 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:40.052427 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:40.052427 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:40.052427 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:40.053453 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:40.053453 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:40.053453 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:40.053453 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:40.053453 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:40.053453 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:40.053453 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:40.053453 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:40.053453 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:40.053453 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:40.053453 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:40.053453 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:40.057481 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 361/740] 10.222.0.85 () {56 vars in 1102 bytes} [Thu Jun 16 14:43:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:40.058816 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbbb643-5e8d-484e-a549-171e34819ac6 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:40.059106 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbbb643-5e8d-484e-a549-171e34819ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:40.059416 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbbb643-5e8d-484e-a549-171e34819ac6 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:40.064071 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 362/741] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:40.064071 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbbb643-5e8d-484e-a549-171e34819ac6 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:40.086494 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:40.144312 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5de99a-e044-4b80-bd4c-72b5615cfd38 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:40.171339 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:40.176662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbbb643-5e8d-484e-a549-171e34819ac6 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:40.181694 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fd5d0-8c82-4b00-9c7b-93be22cf5486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:40.182401 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fd5d0-8c82-4b00-9c7b-93be22cf5486 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:40.182683 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fd5d0-8c82-4b00-9c7b-93be22cf5486 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:40.182957 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fd5d0-8c82-4b00-9c7b-93be22cf5486 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:40.183688 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fd5d0-8c82-4b00-9c7b-93be22cf5486 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:40.184026 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fd5d0-8c82-4b00-9c7b-93be22cf5486 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:40.185454 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fd5d0-8c82-4b00-9c7b-93be22cf5486 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:40.202183 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 380/742] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:40.202183 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fd5d0-8c82-4b00-9c7b-93be22cf5486 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:40.219912 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba02a10-85c1-4273-b52c-f3b22c19ac8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:40.220595 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba02a10-85c1-4273-b52c-f3b22c19ac8c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:40.220874 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba02a10-85c1-4273-b52c-f3b22c19ac8c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:40.221143 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba02a10-85c1-4273-b52c-f3b22c19ac8c None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:40.221871 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba02a10-85c1-4273-b52c-f3b22c19ac8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:40.222174 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba02a10-85c1-4273-b52c-f3b22c19ac8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:40.223544 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba02a10-85c1-4273-b52c-f3b22c19ac8c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:40.236753 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 363/743] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:40.242565 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810df4f-8858-4b46-91c5-6fbc929ae71a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:40.242848 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810df4f-8858-4b46-91c5-6fbc929ae71a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:40.243151 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810df4f-8858-4b46-91c5-6fbc929ae71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:40.262023 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4810df4f-8858-4b46-91c5-6fbc929ae71a None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:40.264048 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4810df4f-8858-4b46-91c5-6fbc929ae71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:40.317296 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fd5d0-8c82-4b00-9c7b-93be22cf5486 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:40.331614 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:40.349349 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 364/744] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:40 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:40.350538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810df4f-8858-4b46-91c5-6fbc929ae71a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:40.370915 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cedfd-1cc4-4f98-859c-0e14b419d2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:40.371604 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cedfd-1cc4-4f98-859c-0e14b419d2eb None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:40.371904 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cedfd-1cc4-4f98-859c-0e14b419d2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:40.372181 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cedfd-1cc4-4f98-859c-0e14b419d2eb None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:40.372936 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31cedfd-1cc4-4f98-859c-0e14b419d2eb None admin] RBAC: Adding query filter params (name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:40.373243 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31cedfd-1cc4-4f98-859c-0e14b419d2eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:40.374889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31cedfd-1cc4-4f98-859c-0e14b419d2eb None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:40.384466 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 381/745] 10.222.0.85 () {56 vars in 1103 bytes} [Thu Jun 16 14:43:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:40.385322 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cedfd-1cc4-4f98-859c-0e14b419d2eb None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:40.459990 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:40.473050 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810df4f-8858-4b46-91c5-6fbc929ae71a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:40.487166 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cedfd-1cc4-4f98-859c-0e14b419d2eb None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:40.512961 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de4339-bafe-4283-b818-9bd0aabd611b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:40.513952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de4339-bafe-4283-b818-9bd0aabd611b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:40.519625 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de4339-bafe-4283-b818-9bd0aabd611b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:40.519625 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de4339-bafe-4283-b818-9bd0aabd611b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:40.526664 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de4339-bafe-4283-b818-9bd0aabd611b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:40.528227 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de4339-bafe-4283-b818-9bd0aabd611b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:40.528988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bc28e-f87b-464f-8399-9dc78b85d1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:40.530376 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bc28e-f87b-464f-8399-9dc78b85d1aa None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:40.530810 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bc28e-f87b-464f-8399-9dc78b85d1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:40.531082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bc28e-f87b-464f-8399-9dc78b85d1aa None admin] PATH_INFO: `/v3/users/nova` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:40.539374 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bc28e-f87b-464f-8399-9dc78b85d1aa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:40.541018 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bc28e-f87b-464f-8399-9dc78b85d1aa None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:40.544398 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-92de4339-bafe-4283-b818-9bd0aabd611b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:40.544398 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:40.544398 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:40.544398 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:40.544398 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:40.544398 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:40.544398 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:40.544398 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:40.544398 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:40.544398 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:40.544398 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:40.544398 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:40.544398 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:43:40.544398 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:43:40.544398 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:43:40.545288 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:43:40.545288 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:40.545288 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:40.545288 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:40.545288 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:40.545288 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:40.545288 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:40.545288 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:40.545288 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:40.545288 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:40.545288 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:40.545288 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:40.545288 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:40.545288 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:40.545288 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:40.545288 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:40.545288 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:40.546182 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:43:40.546182 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:43:40.546182 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:43:40.546182 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:43:40.546182 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:43:40.546182 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:43:40.546182 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:40.546182 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:40.554347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 365/746] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:40.554551 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de4339-bafe-4283-b818-9bd0aabd611b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:40.556669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-848bc28e-f87b-464f-8399-9dc78b85d1aa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:43:40.556669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:40.556669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:40.556669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:40.556669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:40.556669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:40.556669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:40.556669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:40.556669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:40.556669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:40.556669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:40.556669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:40.556669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:43:40.556669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:43:40.556669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:43:40.556669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:43:40.557946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:40.557946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:40.557946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:43:40.557946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:40.557946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:43:40.557946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:40.557946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:40.557946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:40.557946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:40.557946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:40.557946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:40.557946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:40.557946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:40.557946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:40.557946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:40.557946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:40.557946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:40.557946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:40.559046 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:40.559046 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:40.559046 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:43:40.559046 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:43:40.559046 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:43:40.559046 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:43:40.559046 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:43:40.559046 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:43:40.559046 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:43:40.559046 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:40.559046 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 382/747] 10.222.0.85 () {56 vars in 1093 bytes} [Thu Jun 16 14:43:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:40.559046 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bc28e-f87b-464f-8399-9dc78b85d1aa None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:40.598552 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:40.674819 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bc28e-f87b-464f-8399-9dc78b85d1aa None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:40.677772 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de4339-bafe-4283-b818-9bd0aabd611b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:40.719333 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2aabe-6477-490f-a433-272ca3ad35fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:40.719687 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3cac39-c04a-463a-9fa7-274b54e64120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:40.720123 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2aabe-6477-490f-a433-272ca3ad35fc None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:40.720401 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2aabe-6477-490f-a433-272ca3ad35fc None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:40.720514 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cac39-c04a-463a-9fa7-274b54e64120 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:40.720669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2aabe-6477-490f-a433-272ca3ad35fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:40.720763 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cac39-c04a-463a-9fa7-274b54e64120 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:40.720944 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cac39-c04a-463a-9fa7-274b54e64120 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:40.721680 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3cac39-c04a-463a-9fa7-274b54e64120 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:40.723068 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3cac39-c04a-463a-9fa7-274b54e64120 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:40.732693 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2aabe-6477-490f-a433-272ca3ad35fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:40.734352 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2aabe-6477-490f-a433-272ca3ad35fc None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:40.739302 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 366/748] 10.222.0.85 () {60 vars in 1141 bytes} [Thu Jun 16 14:43:40 2022] POST /identity/v3/services => generated 240 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:43:40.740032 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3cac39-c04a-463a-9fa7-274b54e64120 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:40.759203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-7bc2aabe-6477-490f-a433-272ca3ad35fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:40.759203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:40.759203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:40.759203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:40.759203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:40.759203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:40.759203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:40.759203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:40.759203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:40.759203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:40.759203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:40.759203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:40.759203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:40.759203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:40.759203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:40.760229 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:40.760229 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:40.760229 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:40.760229 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:40.760229 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:40.760229 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:40.760229 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:40.760229 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:40.760229 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:40.760229 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:40.760229 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:40.760229 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:40.760229 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:40.760229 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:40.760229 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:40.760229 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:40.760229 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:40.761190 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:40.761190 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:40.761190 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:40.761190 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:40.763631 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 383/749] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:40.764273 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:40.765112 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2aabe-6477-490f-a433-272ca3ad35fc None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:40.894563 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:40.896850 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3cac39-c04a-463a-9fa7-274b54e64120 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:40.921576 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2aabe-6477-490f-a433-272ca3ad35fc None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:40.942240 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f737b-563a-4f39-b781-82cd77a1dd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:40.943071 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f737b-563a-4f39-b781-82cd77a1dd06 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:40.944046 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f737b-563a-4f39-b781-82cd77a1dd06 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:40.944046 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f737b-563a-4f39-b781-82cd77a1dd06 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:40.944794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f737b-563a-4f39-b781-82cd77a1dd06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:40.945112 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f737b-563a-4f39-b781-82cd77a1dd06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:40.946795 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f737b-563a-4f39-b781-82cd77a1dd06 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:40.960707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 367/750] 10.222.0.85 () {56 vars in 1148 bytes} [Thu Jun 16 14:43:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:40.963997 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f737b-563a-4f39-b781-82cd77a1dd06 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:40.976960 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936a2de-b9b3-47b1-8fea-e883ef5a877e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:40.977611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936a2de-b9b3-47b1-8fea-e883ef5a877e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:40.977896 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936a2de-b9b3-47b1-8fea-e883ef5a877e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:40.978169 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936a2de-b9b3-47b1-8fea-e883ef5a877e None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:40.979453 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936a2de-b9b3-47b1-8fea-e883ef5a877e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:40.979811 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936a2de-b9b3-47b1-8fea-e883ef5a877e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:40.981709 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936a2de-b9b3-47b1-8fea-e883ef5a877e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:41.004497 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 384/751] 10.222.0.85 () {56 vars in 1133 bytes} [Thu Jun 16 14:43:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:41.005383 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936a2de-b9b3-47b1-8fea-e883ef5a877e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:41.045557 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:41.084896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f737b-563a-4f39-b781-82cd77a1dd06 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:41.123072 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af14ef-6317-410b-a3c6-22cb76e773f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:41.123952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af14ef-6317-410b-a3c6-22cb76e773f8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:41.124582 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af14ef-6317-410b-a3c6-22cb76e773f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:41.124582 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af14ef-6317-410b-a3c6-22cb76e773f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:41.125556 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af14ef-6317-410b-a3c6-22cb76e773f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:41.125914 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af14ef-6317-410b-a3c6-22cb76e773f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:41.127601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af14ef-6317-410b-a3c6-22cb76e773f8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:41.145266 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 368/752] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:41.145266 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af14ef-6317-410b-a3c6-22cb76e773f8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:41.157620 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936a2de-b9b3-47b1-8fea-e883ef5a877e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:41.205187 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9961e-8037-46ed-8e71-735a4f93b219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:41.206626 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9961e-8037-46ed-8e71-735a4f93b219 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:41.207081 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9961e-8037-46ed-8e71-735a4f93b219 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:41.207507 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9961e-8037-46ed-8e71-735a4f93b219 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:41.208814 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9961e-8037-46ed-8e71-735a4f93b219 None admin] RBAC: Adding query filter params (role.id=95dcfa6c726a4d01a41d2642554fd338, scope.project.id=80e309a3b3784ba9943734a41949b222, user.id=bf9c39de29324b0ca6329c9a171367c4) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:41.209300 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9961e-8037-46ed-8e71-735a4f93b219 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:41.211631 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9961e-8037-46ed-8e71-735a4f93b219 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:41.228379 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 385/753] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:41 2022] GET /identity/v3/role_assignments?user.id=bf9c39de29324b0ca6329c9a171367c4&scope.project.id=80e309a3b3784ba9943734a41949b222&role.id=95dcfa6c726a4d01a41d2642554fd338 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:41.228379 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9961e-8037-46ed-8e71-735a4f93b219 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:41.246678 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:41.299586 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af14ef-6317-410b-a3c6-22cb76e773f8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:41.363446 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:41.380769 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925c39e-63fd-425e-a817-3cad33eafda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:41.381600 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925c39e-63fd-425e-a817-3cad33eafda8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:41.381882 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925c39e-63fd-425e-a817-3cad33eafda8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:41.382156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925c39e-63fd-425e-a817-3cad33eafda8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:41.402900 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925c39e-63fd-425e-a817-3cad33eafda8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:41.405305 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925c39e-63fd-425e-a817-3cad33eafda8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:41.408029 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9961e-8037-46ed-8e71-735a4f93b219 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:41.440498 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-2925c39e-63fd-425e-a817-3cad33eafda8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:41.440498 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:41.440498 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:41.440498 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:41.440498 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:41.440498 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:41.440498 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:41.440498 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:41.440498 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:41.440498 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:41.440498 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:41.440498 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:41.440498 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:41.440498 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:41.440498 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:41.441487 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:41.441487 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:41.441487 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:41.441487 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:41.441487 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:41.441487 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:41.441487 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:41.441487 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:41.441487 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:41.441487 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:41.441487 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:41.441487 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:41.441487 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:41.441487 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:41.441487 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:41.441487 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:41.441487 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:41.442375 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:41.442375 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:41.442375 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:41.442375 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:41.443187 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 369/754] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:41.451666 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925c39e-63fd-425e-a817-3cad33eafda8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:41.481224 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada8d21-55ea-483f-8d91-56546e7f6e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:41.481951 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada8d21-55ea-483f-8d91-56546e7f6e8c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:41.482211 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada8d21-55ea-483f-8d91-56546e7f6e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:41.482516 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada8d21-55ea-483f-8d91-56546e7f6e8c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:41.498509 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada8d21-55ea-483f-8d91-56546e7f6e8c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:41.500281 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada8d21-55ea-483f-8d91-56546e7f6e8c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:41.522591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-9ada8d21-55ea-483f-8d91-56546e7f6e8c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 14:43:41.522591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:41.522591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:41.522591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:41.522591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:41.522591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:41.522591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:41.522591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:41.522591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:41.522591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:41.522591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:41.522591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:41.522591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:43:41.522591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:43:41.522591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:43:41.522591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:43:41.523603 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:41.523603 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:41.523603 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:43:41.523603 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:41.523603 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:43:41.523603 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:41.523603 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:41.523603 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:41.523603 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:41.523603 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:41.523603 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:41.523603 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:41.523603 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:41.523603 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:41.523603 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:41.523603 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:41.523603 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:41.523603 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:41.525854 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:41.525854 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:41.525854 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:43:41.525854 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:43:41.525854 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:43:41.525854 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:43:41.525854 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:43:41.525854 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:43:41.525854 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 14:43:41.525854 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:41.528049 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 386/755] 10.222.0.85 () {56 vars in 1117 bytes} [Thu Jun 16 14:43:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:41.530135 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada8d21-55ea-483f-8d91-56546e7f6e8c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:41.612211 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:41.653878 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada8d21-55ea-483f-8d91-56546e7f6e8c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:41.655796 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925c39e-63fd-425e-a817-3cad33eafda8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:41.691674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e3e38-53f9-4a8c-aec6-99dd5e5901ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:41.692406 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e3e38-53f9-4a8c-aec6-99dd5e5901ac None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:41.692676 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e3e38-53f9-4a8c-aec6-99dd5e5901ac None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:41.692949 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e3e38-53f9-4a8c-aec6-99dd5e5901ac None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:41.693792 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e3e38-53f9-4a8c-aec6-99dd5e5901ac None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:41.694097 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e3e38-53f9-4a8c-aec6-99dd5e5901ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:41.695531 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e3e38-53f9-4a8c-aec6-99dd5e5901ac None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:41.701827 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24862219-adb6-4db7-82a9-7e722fb49d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:41.703409 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24862219-adb6-4db7-82a9-7e722fb49d85 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:41.703973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24862219-adb6-4db7-82a9-7e722fb49d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:41.704400 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24862219-adb6-4db7-82a9-7e722fb49d85 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:41.705549 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24862219-adb6-4db7-82a9-7e722fb49d85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:41.706007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24862219-adb6-4db7-82a9-7e722fb49d85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:41.708648 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24862219-adb6-4db7-82a9-7e722fb49d85 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:41.718631 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 387/756] 10.222.0.85 () {56 vars in 1149 bytes} [Thu Jun 16 14:43:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:41.720543 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbfbda-513f-4627-9e26-49dd21a674ad None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:41.721111 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbfbda-513f-4627-9e26-49dd21a674ad None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:41.721533 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbfbda-513f-4627-9e26-49dd21a674ad None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:41.723215 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 388/757] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:41.728801 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbfbda-513f-4627-9e26-49dd21a674ad None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:41.729023 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 370/758] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:41.730335 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f8729-6c6f-445d-870c-faa4258cd84f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:41.730716 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f8729-6c6f-445d-870c-faa4258cd84f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:41.731084 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f8729-6c6f-445d-870c-faa4258cd84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:41.752767 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-6a6f8729-6c6f-445d-870c-faa4258cd84f None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:41.754131 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6a6f8729-6c6f-445d-870c-faa4258cd84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:41.792297 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:41.845187 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 371/759] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:43:41.846324 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f8729-6c6f-445d-870c-faa4258cd84f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:41.877821 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbfbda-513f-4627-9e26-49dd21a674ad None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:41.924083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:41.950994 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c95af-d3a1-4760-a297-69c43b999f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:41.952816 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c95af-d3a1-4760-a297-69c43b999f40 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:41.953607 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c95af-d3a1-4760-a297-69c43b999f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:41.954127 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c95af-d3a1-4760-a297-69c43b999f40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:41.991377 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f8729-6c6f-445d-870c-faa4258cd84f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:42.031847 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56dee1-7d2b-4594-a880-d9d40019ff84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:42.032744 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56dee1-7d2b-4594-a880-d9d40019ff84 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:42.032927 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56dee1-7d2b-4594-a880-d9d40019ff84 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:42.033204 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56dee1-7d2b-4594-a880-d9d40019ff84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:42.042250 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd56dee1-7d2b-4594-a880-d9d40019ff84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:42.043748 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd56dee1-7d2b-4594-a880-d9d40019ff84 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:42.045659 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c95af-d3a1-4760-a297-69c43b999f40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:42.047726 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c95af-d3a1-4760-a297-69c43b999f40 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:42.059612 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-dd56dee1-7d2b-4594-a880-d9d40019ff84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:42.059612 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:42.059612 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:42.059612 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:42.059612 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:42.059612 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:42.059612 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:42.059612 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:42.059612 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:42.059612 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:42.059612 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:42.059612 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:42.059612 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:43:42.059612 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:43:42.059612 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:43:42.060760 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:43:42.060760 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:42.060760 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:42.060760 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:42.060760 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:42.060760 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:42.060760 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:42.060760 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:42.060760 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:42.060760 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:42.060760 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:42.060760 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:42.060760 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:42.060760 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:42.060760 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:42.060760 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:42.060760 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:42.061871 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:43:42.061871 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:43:42.061871 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:43:42.061871 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:43:42.061871 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:43:42.061871 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:43:42.061871 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:42.061871 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:42.061871 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 372/760] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:42.062467 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56dee1-7d2b-4594-a880-d9d40019ff84 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:42.094419 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:42.168666 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 389/761] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:41 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:43:42.169870 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c95af-d3a1-4760-a297-69c43b999f40 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:42.192872 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56dee1-7d2b-4594-a880-d9d40019ff84 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:42.198735 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:42.232769 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb99df4-b858-4032-925d-b96dbfeaad63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:42.233596 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb99df4-b858-4032-925d-b96dbfeaad63 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:42.233874 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb99df4-b858-4032-925d-b96dbfeaad63 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:42.234194 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb99df4-b858-4032-925d-b96dbfeaad63 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:42.234840 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb99df4-b858-4032-925d-b96dbfeaad63 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:42.236387 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb99df4-b858-4032-925d-b96dbfeaad63 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:42.252918 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-2fb99df4-b858-4032-925d-b96dbfeaad63 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 14:43:42.252918 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:42.252918 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:43:42.252918 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:43:42.252918 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:43:42.252918 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:43:42.252918 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:43:42.252918 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:43:42.252918 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 14:43:42.252918 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:42.252918 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:43:42.252918 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:42.252918 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:42.252918 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:42.252918 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:42.252918 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:42.253943 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:42.253943 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:42.253943 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:42.253943 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:42.253943 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:42.253943 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:42.253943 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:42.253943 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:43:42.253943 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:43:42.253943 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:43:42.253943 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:43:42.253943 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:42.253943 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:42.253943 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:42.253943 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:42.253943 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:42.254777 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:42.254777 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:42.254777 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:42.254777 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:42.254777 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:42.254777 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:42.254777 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:42.254777 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:42.254777 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:42.254777 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:42.254777 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:42.254777 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:43:42.254777 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:43:42.254777 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 14:43:42.254777 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:42.254777 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 373/762] 10.222.0.85 () {56 vars in 1129 bytes} [Thu Jun 16 14:43:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:42.255615 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb99df4-b858-4032-925d-b96dbfeaad63 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:42.297598 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c95af-d3a1-4760-a297-69c43b999f40 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:42.336017 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c7c4a-4f8e-448b-be21-74890a33d89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:42.337172 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c7c4a-4f8e-448b-be21-74890a33d89b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:42.337647 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c7c4a-4f8e-448b-be21-74890a33d89b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:42.338092 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c7c4a-4f8e-448b-be21-74890a33d89b None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:42.339166 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c7c4a-4f8e-448b-be21-74890a33d89b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:42.339743 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c7c4a-4f8e-448b-be21-74890a33d89b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:42.341568 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c7c4a-4f8e-448b-be21-74890a33d89b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:42.360179 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 390/763] 10.222.0.85 () {56 vars in 1148 bytes} [Thu Jun 16 14:43:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:42.361504 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c7c4a-4f8e-448b-be21-74890a33d89b None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:42.378392 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:42.390319 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb99df4-b858-4032-925d-b96dbfeaad63 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:42.438962 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9712b-64e4-440c-88e1-021c233d7eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:42.439845 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9712b-64e4-440c-88e1-021c233d7eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:42.440718 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9712b-64e4-440c-88e1-021c233d7eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:42.441005 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9712b-64e4-440c-88e1-021c233d7eb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:42.456150 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9712b-64e4-440c-88e1-021c233d7eb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:42.458374 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9712b-64e4-440c-88e1-021c233d7eb3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:42.461070 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:42.481267 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-76d9712b-64e4-440c-88e1-021c233d7eb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:42.481267 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:42.481267 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:42.481267 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:42.481267 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:42.481267 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:42.481267 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:42.481267 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:42.481267 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:42.481267 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:42.481267 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:42.481267 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:42.481267 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:42.481267 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:42.481267 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:42.482237 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:42.482237 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:42.482237 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:42.482237 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:42.482237 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:42.482237 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:42.482237 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:42.482237 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:42.482237 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:42.482237 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:42.482237 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:42.482237 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:42.482237 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:42.482237 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:42.482237 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:42.482237 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:42.482237 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:42.483135 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:42.483135 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:42.483135 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:42.483135 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:42.483135 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 374/764] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:42.483848 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9712b-64e4-440c-88e1-021c233d7eb3 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:42.484101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c7c4a-4f8e-448b-be21-74890a33d89b None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:42.524812 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e1909-840c-4ab3-b672-bee7253a0c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:42.526534 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e1909-840c-4ab3-b672-bee7253a0c6e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:42.527070 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e1909-840c-4ab3-b672-bee7253a0c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:42.527520 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e1909-840c-4ab3-b672-bee7253a0c6e None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:42.528592 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e1909-840c-4ab3-b672-bee7253a0c6e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:42.529374 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e1909-840c-4ab3-b672-bee7253a0c6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:42.531277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e1909-840c-4ab3-b672-bee7253a0c6e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:42.543356 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 391/765] 10.222.0.85 () {56 vars in 1124 bytes} [Thu Jun 16 14:43:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:42.544863 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e1909-840c-4ab3-b672-bee7253a0c6e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:42.640915 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9712b-64e4-440c-88e1-021c233d7eb3 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:42.684636 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f1f4c-0d86-429f-acf5-899e66840f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:42.685431 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f1f4c-0d86-429f-acf5-899e66840f4e None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:42.685685 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f1f4c-0d86-429f-acf5-899e66840f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:42.685983 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f1f4c-0d86-429f-acf5-899e66840f4e None admin] PATH_INFO: `/v3/projects/80e309a3b3784ba9943734a41949b222/users/c74e4d1bdaa64ed280cc5f4c8e79b842/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:42.688405 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f1f4c-0d86-429f-acf5-899e66840f4e None admin] RBAC: Authorizing `identity:create_grant(project_id=80e309a3b3784ba9943734a41949b222, user_id=c74e4d1bdaa64ed280cc5f4c8e79b842, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:42.689498 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f1f4c-0d86-429f-acf5-899e66840f4e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:42.712314 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 375/766] 10.222.0.85 () {58 vars in 1439 bytes} [Thu Jun 16 14:43:42 2022] PUT /identity/v3/projects/80e309a3b3784ba9943734a41949b222/users/c74e4d1bdaa64ed280cc5f4c8e79b842/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:43:42.712314 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f1f4c-0d86-429f-acf5-899e66840f4e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:42.723999 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e1909-840c-4ab3-b672-bee7253a0c6e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:42.732363 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:42.810125 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6a14c-45a3-4148-841e-c56041c34ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:42.810813 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6a14c-45a3-4148-841e-c56041c34ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:42.811138 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6a14c-45a3-4148-841e-c56041c34ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:42.811415 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6a14c-45a3-4148-841e-c56041c34ee0 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:42.812240 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6a14c-45a3-4148-841e-c56041c34ee0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:42.812546 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6a14c-45a3-4148-841e-c56041c34ee0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:42.816948 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6a14c-45a3-4148-841e-c56041c34ee0 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:42.850184 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 392/767] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:42.858085 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6a14c-45a3-4148-841e-c56041c34ee0 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:42.879380 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:42.939185 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f1f4c-0d86-429f-acf5-899e66840f4e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:42.982891 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173f9ec-31e6-4d19-85fb-d8c1b290cd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:42.983114 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173f9ec-31e6-4d19-85fb-d8c1b290cd86 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:42.983366 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173f9ec-31e6-4d19-85fb-d8c1b290cd86 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:42.983625 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173f9ec-31e6-4d19-85fb-d8c1b290cd86 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:42.984380 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8173f9ec-31e6-4d19-85fb-d8c1b290cd86 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:42.984748 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8173f9ec-31e6-4d19-85fb-d8c1b290cd86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:42.986230 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8173f9ec-31e6-4d19-85fb-d8c1b290cd86 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:42.993133 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 376/768] 10.222.0.85 () {56 vars in 1124 bytes} [Thu Jun 16 14:43:42 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:43.001160 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173f9ec-31e6-4d19-85fb-d8c1b290cd86 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:43.016122 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6a14c-45a3-4148-841e-c56041c34ee0 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:43.067498 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672191e2-132d-4189-91b6-544f7518b439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:43.068515 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672191e2-132d-4189-91b6-544f7518b439 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:43.068795 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672191e2-132d-4189-91b6-544f7518b439 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:43.069505 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672191e2-132d-4189-91b6-544f7518b439 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:43.079698 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672191e2-132d-4189-91b6-544f7518b439 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:43.081794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:43.082883 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672191e2-132d-4189-91b6-544f7518b439 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:43.102161 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-672191e2-132d-4189-91b6-544f7518b439 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:43.102161 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:43.102161 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:43.102161 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:43.102161 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:43.102161 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:43.102161 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:43.102161 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:43.102161 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:43.102161 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:43.102161 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:43.102161 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:43.102161 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:43:43.102161 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:43:43.102161 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:43:43.103538 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:43:43.103538 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:43.103538 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:43.103538 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:43.103538 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:43.103538 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:43.103538 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:43.103538 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:43.103538 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:43.103538 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:43.103538 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:43.103538 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:43.103538 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:43.103538 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:43.103538 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:43.103538 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:43.103538 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:43.104473 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:43:43.104473 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:43:43.104473 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:43:43.104473 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:43:43.104473 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:43:43.104473 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:43:43.104473 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:43.104473 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:43.104896 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 393/769] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:43.107893 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a83fd-53e8-41c9-bc8b-8e7f0d54fbd7 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:43.107893 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a83fd-53e8-41c9-bc8b-8e7f0d54fbd7 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:43.108250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a83fd-53e8-41c9-bc8b-8e7f0d54fbd7 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:43.109768 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 394/770] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:43.114649 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a83fd-53e8-41c9-bc8b-8e7f0d54fbd7 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:43.127284 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173f9ec-31e6-4d19-85fb-d8c1b290cd86 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:43.178093 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40132c4-a2db-44a7-93cb-f2f64a0d6bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:43.178779 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40132c4-a2db-44a7-93cb-f2f64a0d6bea None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:43.179053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40132c4-a2db-44a7-93cb-f2f64a0d6bea None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:43.179324 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40132c4-a2db-44a7-93cb-f2f64a0d6bea None admin] PATH_INFO: `/v3/endpoints` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:43.181462 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40132c4-a2db-44a7-93cb-f2f64a0d6bea None admin] RBAC: Adding query filter params (interface=public, service_id=d4f74325a30249c7ad5260ab369efc58, region_id=RegionOne) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:43.181840 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40132c4-a2db-44a7-93cb-f2f64a0d6bea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:43.183562 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40132c4-a2db-44a7-93cb-f2f64a0d6bea None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:43.196070 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 377/771] 10.222.0.85 () {56 vars in 1251 bytes} [Thu Jun 16 14:43:42 2022] GET /identity/v3/endpoints?service_id=d4f74325a30249c7ad5260ab369efc58&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:43.197974 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c31fdb-c3f1-437d-b783-6373146a9719 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:43.198269 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c31fdb-c3f1-437d-b783-6373146a9719 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:43.198547 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c31fdb-c3f1-437d-b783-6373146a9719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:43.201145 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:43.224955 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f9c31fdb-c3f1-437d-b783-6373146a9719 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:43.227360 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f9c31fdb-c3f1-437d-b783-6373146a9719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:43.241079 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a83fd-53e8-41c9-bc8b-8e7f0d54fbd7 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:43.278771 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada200d-5062-414f-83c8-bcad70d21bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:43.280141 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada200d-5062-414f-83c8-bcad70d21bdc None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:43.280141 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada200d-5062-414f-83c8-bcad70d21bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:43.280141 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada200d-5062-414f-83c8-bcad70d21bdc None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:43.280974 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dada200d-5062-414f-83c8-bcad70d21bdc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:43.281284 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dada200d-5062-414f-83c8-bcad70d21bdc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:43.282817 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dada200d-5062-414f-83c8-bcad70d21bdc None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:43.302099 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 395/772] 10.222.0.85 () {56 vars in 1148 bytes} [Thu Jun 16 14:43:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:43.302099 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada200d-5062-414f-83c8-bcad70d21bdc None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:43.340469 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 378/773] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:43:43.341689 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c31fdb-c3f1-437d-b783-6373146a9719 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:43.418811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:43.459422 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada200d-5062-414f-83c8-bcad70d21bdc None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:43.467933 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c31fdb-c3f1-437d-b783-6373146a9719 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:43.505946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:43.512679 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7c5a8-5aa4-49e3-b73a-97d6cb9bab3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:43.513380 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7c5a8-5aa4-49e3-b73a-97d6cb9bab3f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:43.513660 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7c5a8-5aa4-49e3-b73a-97d6cb9bab3f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:43.513935 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7c5a8-5aa4-49e3-b73a-97d6cb9bab3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:43.514813 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a7c5a8-5aa4-49e3-b73a-97d6cb9bab3f None admin] RBAC: Adding query filter params (role.id=17fa92022f834aa5bf5cb9e3a506a478, scope.project.id=80e309a3b3784ba9943734a41949b222, user.id=db4d36e6837d4b2fa4b7ee5c7243b6b3) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:43.515145 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a7c5a8-5aa4-49e3-b73a-97d6cb9bab3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:43.517451 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a7c5a8-5aa4-49e3-b73a-97d6cb9bab3f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:43.531917 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 379/774] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:43 2022] GET /identity/v3/role_assignments?user.id=db4d36e6837d4b2fa4b7ee5c7243b6b3&scope.project.id=80e309a3b3784ba9943734a41949b222&role.id=17fa92022f834aa5bf5cb9e3a506a478 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:43.531917 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7c5a8-5aa4-49e3-b73a-97d6cb9bab3f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:43.541626 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87fe9b-cfe4-4837-ba2d-85b42e0f86a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:43.542331 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87fe9b-cfe4-4837-ba2d-85b42e0f86a6 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:43.542638 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87fe9b-cfe4-4837-ba2d-85b42e0f86a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:43.542886 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87fe9b-cfe4-4837-ba2d-85b42e0f86a6 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:43.543580 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c87fe9b-cfe4-4837-ba2d-85b42e0f86a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:43.547147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c87fe9b-cfe4-4837-ba2d-85b42e0f86a6 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:43.561875 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 396/775] 10.222.0.85 () {56 vars in 1087 bytes} [Thu Jun 16 14:43:43 2022] GET /identity/v3/services => generated 772 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:43.719022 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73964ab3-83d4-4ae8-a991-f9681020b763 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:43.719222 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73964ab3-83d4-4ae8-a991-f9681020b763 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:43.719478 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73964ab3-83d4-4ae8-a991-f9681020b763 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:43.722631 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 397/776] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:43.725629 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7c5a8-5aa4-49e3-b73a-97d6cb9bab3f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:43.727312 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e842b-ecb0-4027-91e2-90d4aaa7fdd5 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:43.727813 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e842b-ecb0-4027-91e2-90d4aaa7fdd5 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:43.727967 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e842b-ecb0-4027-91e2-90d4aaa7fdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:43.760460 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:43.765144 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-5c3e842b-ecb0-4027-91e2-90d4aaa7fdd5 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:43.766488 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5c3e842b-ecb0-4027-91e2-90d4aaa7fdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:43.773408 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c67e7-244f-4e9e-be05-daa1e6e97444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:43.774782 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c67e7-244f-4e9e-be05-daa1e6e97444 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:43.775558 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c67e7-244f-4e9e-be05-daa1e6e97444 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:43.776138 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c67e7-244f-4e9e-be05-daa1e6e97444 None admin] PATH_INFO: `/v3/services/network` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:43.777055 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c67e7-244f-4e9e-be05-daa1e6e97444 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:43.778757 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c67e7-244f-4e9e-be05-daa1e6e97444 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:43.800602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-b03c67e7-244f-4e9e-be05-daa1e6e97444 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 14:43:43.800602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:43.800602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:43:43.800602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:43:43.800602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:43:43.800602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:43:43.800602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:43:43.800602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:43:43.800602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 14:43:43.800602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:43.800602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:43:43.800602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:43.800602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:43.800602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:43.800602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:43.800602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:43.800602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:43.801684 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:43.801684 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:43.801684 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:43.801684 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:43.801684 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:43.801684 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:43.801684 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:43:43.801684 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:43:43.801684 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:43:43.801684 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:43:43.801684 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:43.801684 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:43.801684 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:43.801684 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:43.801684 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:43.801684 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:43.802548 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:43.802548 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:43.802548 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:43.802548 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:43.802548 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:43.802548 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:43.802548 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:43.802548 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:43.802548 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:43.802548 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:43.802548 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:43:43.802548 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:43:43.802548 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 14:43:43.802548 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:43.810547 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 380/777] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:43 2022] GET /identity/v3/services/network => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:43.816940 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c67e7-244f-4e9e-be05-daa1e6e97444 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:43.893122 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 398/778] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:43:43.917401 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e842b-ecb0-4027-91e2-90d4aaa7fdd5 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:43.963730 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c67e7-244f-4e9e-be05-daa1e6e97444 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:44.008931 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d586963f-83db-477c-9d00-b31789547302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:44.010260 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586963f-83db-477c-9d00-b31789547302 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:44.011418 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586963f-83db-477c-9d00-b31789547302 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:44.011709 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586963f-83db-477c-9d00-b31789547302 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:44.013594 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d586963f-83db-477c-9d00-b31789547302 None admin] RBAC: Adding query filter params (name=network) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:44.013910 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d586963f-83db-477c-9d00-b31789547302 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:44.016471 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d586963f-83db-477c-9d00-b31789547302 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:44.024191 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 381/779] 10.222.0.85 () {56 vars in 1112 bytes} [Thu Jun 16 14:43:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:44.030524 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d586963f-83db-477c-9d00-b31789547302 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:44.064867 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e842b-ecb0-4027-91e2-90d4aaa7fdd5 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:44.100947 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:44.112350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:44.125100 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a86c9-8450-4acd-9f9b-8726e5e210cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:44.125936 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a86c9-8450-4acd-9f9b-8726e5e210cd None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:44.127909 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a86c9-8450-4acd-9f9b-8726e5e210cd None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:44.128150 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a86c9-8450-4acd-9f9b-8726e5e210cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:44.141528 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a86c9-8450-4acd-9f9b-8726e5e210cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:44.149715 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-b69a86c9-8450-4acd-9f9b-8726e5e210cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:44.149715 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:44.149715 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:44.149715 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:44.149715 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:44.149715 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:44.149715 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:44.149715 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:44.149715 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:44.149715 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:44.149715 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:44.149715 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:44.149715 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:44.149715 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:44.149715 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:44.149715 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:44.150903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:44.150903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:44.150903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:44.150903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:44.150903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:44.150903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:44.150903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:44.150903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:44.150903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:44.150903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:44.150903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:44.150903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:44.150903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:44.150903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:44.150903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:44.150903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:44.151938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:44.151938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:44.151938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:44.151938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:44.151938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:44.151938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:44.151938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:44.151938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:44.151938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:44.151938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:44.151938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:44.151938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:44.151938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 399/780] 10.222.0.85 () {56 vars in 1096 bytes} [Thu Jun 16 14:43:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:43:44.160592 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a86c9-8450-4acd-9f9b-8726e5e210cd None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:44.250372 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d586963f-83db-477c-9d00-b31789547302 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:44.295831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd0ab8-a301-40e5-8480-c89b7ba53311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:44.297071 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd0ab8-a301-40e5-8480-c89b7ba53311 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:44.297369 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd0ab8-a301-40e5-8480-c89b7ba53311 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:44.297651 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd0ab8-a301-40e5-8480-c89b7ba53311 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:44.298209 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a86c9-8450-4acd-9f9b-8726e5e210cd None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:44.298407 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd0ab8-a301-40e5-8480-c89b7ba53311 None admin] RBAC: Adding query filter params (type=network) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:44.298689 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd0ab8-a301-40e5-8480-c89b7ba53311 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:44.308979 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd0ab8-a301-40e5-8480-c89b7ba53311 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:44.319729 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 382/781] 10.222.0.85 () {56 vars in 1112 bytes} [Thu Jun 16 14:43:44 2022] GET /identity/v3/services?type=network => generated 350 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:44.321324 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd0ab8-a301-40e5-8480-c89b7ba53311 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:44.378172 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a38a3-5d9e-4b87-bf07-b558b9cc6986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:44.379293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a38a3-5d9e-4b87-bf07-b558b9cc6986 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:44.379787 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a38a3-5d9e-4b87-bf07-b558b9cc6986 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:44.380300 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a38a3-5d9e-4b87-bf07-b558b9cc6986 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:44.381365 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a38a3-5d9e-4b87-bf07-b558b9cc6986 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:44.382002 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a38a3-5d9e-4b87-bf07-b558b9cc6986 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:44.383406 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a38a3-5d9e-4b87-bf07-b558b9cc6986 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:44.407119 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 400/782] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:44.416003 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a38a3-5d9e-4b87-bf07-b558b9cc6986 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:44.501992 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:44.570326 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a38a3-5d9e-4b87-bf07-b558b9cc6986 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:44.584658 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd0ab8-a301-40e5-8480-c89b7ba53311 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:44.607648 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5019c-06c2-45da-ad5c-93f972d4aacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:44.608982 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5019c-06c2-45da-ad5c-93f972d4aacf None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:44.609483 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5019c-06c2-45da-ad5c-93f972d4aacf None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:44.609953 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5019c-06c2-45da-ad5c-93f972d4aacf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:44.623025 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5019c-06c2-45da-ad5c-93f972d4aacf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:44.625151 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5019c-06c2-45da-ad5c-93f972d4aacf None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:44.637500 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:44.655897 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-57c5019c-06c2-45da-ad5c-93f972d4aacf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:44.655897 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:44.655897 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:44.655897 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:44.655897 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:44.655897 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:44.655897 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:44.655897 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:44.655897 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:44.655897 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:44.655897 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:44.655897 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:44.655897 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:44.655897 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:44.655897 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:44.656856 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:44.656856 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:44.656856 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:44.656856 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:44.656856 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:44.656856 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:44.656856 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:44.656856 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:44.656856 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:44.656856 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:44.656856 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:44.656856 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:44.656856 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:44.656856 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:44.656856 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:44.656856 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:44.656856 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:44.657788 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:44.657788 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:44.657788 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:44.657788 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:44.657788 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 401/783] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:44.661771 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5019c-06c2-45da-ad5c-93f972d4aacf None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:44.693852 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e9d9a-ef06-48b9-9fb8-956f0128c763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:44.695064 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e9d9a-ef06-48b9-9fb8-956f0128c763 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:44.695648 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e9d9a-ef06-48b9-9fb8-956f0128c763 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:44.696024 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e9d9a-ef06-48b9-9fb8-956f0128c763 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:44.700109 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e9d9a-ef06-48b9-9fb8-956f0128c763 None admin] RBAC: Adding query filter params (interface=public, service_id=5aeba3b394764665b7e9c84f163c8794, region_id=RegionOne) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:44.700577 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e9d9a-ef06-48b9-9fb8-956f0128c763 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:44.704427 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e9d9a-ef06-48b9-9fb8-956f0128c763 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:44.719132 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 383/784] 10.222.0.85 () {56 vars in 1251 bytes} [Thu Jun 16 14:43:44 2022] GET /identity/v3/endpoints?service_id=5aeba3b394764665b7e9c84f163c8794&interface=public®ion_id=RegionOne => generated 194 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:44.728280 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e9d9a-ef06-48b9-9fb8-956f0128c763 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:44.914657 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:44.924970 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5019c-06c2-45da-ad5c-93f972d4aacf None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:44.944694 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e9d9a-ef06-48b9-9fb8-956f0128c763 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:44.997712 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bea00a-211c-4bdb-b9ce-5766d68d9428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:44.998413 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bea00a-211c-4bdb-b9ce-5766d68d9428 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:44.998696 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bea00a-211c-4bdb-b9ce-5766d68d9428 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:44.998973 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bea00a-211c-4bdb-b9ce-5766d68d9428 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:44.999709 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bea00a-211c-4bdb-b9ce-5766d68d9428 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:45.000039 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bea00a-211c-4bdb-b9ce-5766d68d9428 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:45.001467 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bea00a-211c-4bdb-b9ce-5766d68d9428 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:45.018084 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584d34a-4368-4e3a-98c4-6aa187232629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:45.018797 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584d34a-4368-4e3a-98c4-6aa187232629 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:45.019106 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584d34a-4368-4e3a-98c4-6aa187232629 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:45.019386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584d34a-4368-4e3a-98c4-6aa187232629 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:45.020172 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584d34a-4368-4e3a-98c4-6aa187232629 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:45.021634 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584d34a-4368-4e3a-98c4-6aa187232629 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:45.028355 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 402/785] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:45.031321 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 384/786] 10.222.0.85 () {56 vars in 1087 bytes} [Thu Jun 16 14:43:44 2022] GET /identity/v3/services => generated 772 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:45.034188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bea00a-211c-4bdb-b9ce-5766d68d9428 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:45.206345 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bea00a-211c-4bdb-b9ce-5766d68d9428 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:45.251630 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c7e43-b32a-4bdf-960a-d7c2063b5e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:45.252867 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c7e43-b32a-4bdf-960a-d7c2063b5e35 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:45.253348 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c7e43-b32a-4bdf-960a-d7c2063b5e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:45.253819 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c7e43-b32a-4bdf-960a-d7c2063b5e35 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:45.263325 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c7e43-b32a-4bdf-960a-d7c2063b5e35 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:45.265221 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c7e43-b32a-4bdf-960a-d7c2063b5e35 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:45.281082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-382c7e43-b32a-4bdf-960a-d7c2063b5e35 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 14:43:45.281082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:45.281082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:45.281082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:45.281082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:45.281082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:45.281082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:45.281082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:45.281082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:45.281082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:45.281082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:45.281082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:45.281082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:43:45.281082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:43:45.281082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:43:45.281082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:43:45.282083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:45.282083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:45.282083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:43:45.282083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:45.282083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:43:45.282083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:45.282083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:45.282083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:45.282083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:45.282083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:45.282083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:45.282083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:45.282083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:45.282083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:45.282083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:45.282083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:45.282083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:45.282083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:45.283147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:45.283147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:45.283147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:43:45.283147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:43:45.283147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:43:45.283147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:43:45.283147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:43:45.283147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:43:45.283147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 14:43:45.283147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:45.285965 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 403/787] 10.222.0.85 () {56 vars in 1096 bytes} [Thu Jun 16 14:43:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:45.292010 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584d34a-4368-4e3a-98c4-6aa187232629 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:45.356373 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:45.437283 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584d34a-4368-4e3a-98c4-6aa187232629 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:45.483284 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdf5b5-9297-4793-85fc-b99c2b94a65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:45.484365 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdf5b5-9297-4793-85fc-b99c2b94a65f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:45.484867 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdf5b5-9297-4793-85fc-b99c2b94a65f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:45.485336 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdf5b5-9297-4793-85fc-b99c2b94a65f None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:45.486431 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bdf5b5-9297-4793-85fc-b99c2b94a65f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:45.486949 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bdf5b5-9297-4793-85fc-b99c2b94a65f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:45.488650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bdf5b5-9297-4793-85fc-b99c2b94a65f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:45.533298 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 385/788] 10.222.0.85 () {56 vars in 1135 bytes} [Thu Jun 16 14:43:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:45.540040 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f66ac-2376-441d-8d18-02d5df12a390 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:45.540928 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f66ac-2376-441d-8d18-02d5df12a390 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:45.541702 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f66ac-2376-441d-8d18-02d5df12a390 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:45.544042 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 404/789] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:45.545944 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdf5b5-9297-4793-85fc-b99c2b94a65f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:45.557491 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8804c-9cec-420a-9ac4-4236dacaede2 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:45.557768 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8804c-9cec-420a-9ac4-4236dacaede2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:45.558112 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8804c-9cec-420a-9ac4-4236dacaede2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:45.605011 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-06c8804c-9cec-420a-9ac4-4236dacaede2 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:45.606248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-06c8804c-9cec-420a-9ac4-4236dacaede2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:45.629724 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:45.724622 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 405/790] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:43:45.737238 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdf5b5-9297-4793-85fc-b99c2b94a65f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:45.740219 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:45.747813 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8804c-9cec-420a-9ac4-4236dacaede2 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:45.815174 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78a3b4-15f7-498a-896f-0c1373e99a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:45.816270 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78a3b4-15f7-498a-896f-0c1373e99a40 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:45.816690 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78a3b4-15f7-498a-896f-0c1373e99a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:45.817125 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78a3b4-15f7-498a-896f-0c1373e99a40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:45.834017 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78a3b4-15f7-498a-896f-0c1373e99a40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:45.835537 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78a3b4-15f7-498a-896f-0c1373e99a40 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:45.864895 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-0e78a3b4-15f7-498a-896f-0c1373e99a40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:45.864895 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:45.864895 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:45.864895 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:45.864895 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:45.864895 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:45.864895 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:45.864895 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:45.864895 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:45.864895 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:45.864895 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:45.864895 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:45.864895 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:45.864895 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:45.864895 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:45.866007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:45.866007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:45.866007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:45.866007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:45.866007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:45.866007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:45.866007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:45.866007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:45.866007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:45.866007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:45.866007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:45.866007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:45.866007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:45.866007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:45.866007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:45.866007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:45.866007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:45.867089 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:45.867089 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:45.867089 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:45.867089 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:45.876672 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 386/791] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:45.882542 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78a3b4-15f7-498a-896f-0c1373e99a40 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:45.918502 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8804c-9cec-420a-9ac4-4236dacaede2 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:45.985760 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38021550-9984-46ab-b04b-356776abc08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:45.986754 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38021550-9984-46ab-b04b-356776abc08a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:45.987130 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38021550-9984-46ab-b04b-356776abc08a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:45.987559 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38021550-9984-46ab-b04b-356776abc08a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:45.992989 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78a3b4-15f7-498a-896f-0c1373e99a40 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:46.014944 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38021550-9984-46ab-b04b-356776abc08a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:46.023015 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-38021550-9984-46ab-b04b-356776abc08a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:46.023015 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:46.023015 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:46.023015 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:46.023015 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:46.023015 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:46.023015 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:46.023015 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:46.023015 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:46.023015 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:46.023015 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:46.023015 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:46.023015 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:46.023015 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:46.023015 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:46.023015 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:46.024117 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:46.024117 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:46.024117 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:46.024117 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:46.024117 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:46.024117 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:46.024117 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:46.024117 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:46.024117 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:46.024117 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:46.024117 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:46.024117 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:46.024117 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:46.024117 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:46.024117 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:46.024117 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:46.025119 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:46.025119 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:46.025119 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:46.025119 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:46.025119 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:46.025119 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:46.025119 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:46.025119 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:46.025119 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:46.025119 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:46.025119 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:46.025119 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:46.032913 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 406/792] 10.222.0.85 () {56 vars in 1096 bytes} [Thu Jun 16 14:43:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:46.040939 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38021550-9984-46ab-b04b-356776abc08a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:46.044047 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9b425-6ac3-4ac1-83b5-adcfdc73c653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:46.045105 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9b425-6ac3-4ac1-83b5-adcfdc73c653 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:46.045611 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9b425-6ac3-4ac1-83b5-adcfdc73c653 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:46.046074 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9b425-6ac3-4ac1-83b5-adcfdc73c653 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:46.047430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9b425-6ac3-4ac1-83b5-adcfdc73c653 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:46.047996 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9b425-6ac3-4ac1-83b5-adcfdc73c653 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:46.049661 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9b425-6ac3-4ac1-83b5-adcfdc73c653 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:46.058951 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:46.071935 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 387/793] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:46.075158 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9b425-6ac3-4ac1-83b5-adcfdc73c653 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:46.095832 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:46.177482 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38021550-9984-46ab-b04b-356776abc08a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:46.183446 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9b425-6ac3-4ac1-83b5-adcfdc73c653 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:46.213118 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0017227-46bc-4461-adf6-5f1f3334e10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:46.213794 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0017227-46bc-4461-adf6-5f1f3334e10c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:46.214082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0017227-46bc-4461-adf6-5f1f3334e10c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:46.214360 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0017227-46bc-4461-adf6-5f1f3334e10c None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:46.215115 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0017227-46bc-4461-adf6-5f1f3334e10c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:46.215432 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0017227-46bc-4461-adf6-5f1f3334e10c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:46.216855 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0017227-46bc-4461-adf6-5f1f3334e10c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:46.221567 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd10f06-814c-4a37-ae76-4b2de61f7506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:46.222605 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd10f06-814c-4a37-ae76-4b2de61f7506 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:46.223095 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd10f06-814c-4a37-ae76-4b2de61f7506 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:46.223573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd10f06-814c-4a37-ae76-4b2de61f7506 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:46.230460 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 407/794] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:46.231329 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd10f06-814c-4a37-ae76-4b2de61f7506 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:46.231866 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ae416-66e8-4bbf-b112-2dbb3b1dc071 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:46.232174 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ae416-66e8-4bbf-b112-2dbb3b1dc071 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:46.232564 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ae416-66e8-4bbf-b112-2dbb3b1dc071 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:46.233676 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd10f06-814c-4a37-ae76-4b2de61f7506 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:46.238185 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 408/795] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:46.239207 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ae416-66e8-4bbf-b112-2dbb3b1dc071 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:46.249290 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-1dd10f06-814c-4a37-ae76-4b2de61f7506 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:46.249290 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:46.249290 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:46.249290 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:46.249290 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:46.249290 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:46.249290 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:46.249290 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:46.249290 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:46.249290 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:46.249290 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:46.249290 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:46.249290 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:43:46.249290 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:43:46.249290 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:43:46.250196 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:43:46.250196 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:46.250196 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:46.250196 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:46.250196 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:46.250196 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:46.250196 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:46.250196 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:46.250196 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:46.250196 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:46.250196 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:46.250196 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:46.250196 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:46.250196 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:46.250196 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:46.250196 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:46.250196 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:46.251066 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:43:46.251066 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:43:46.251066 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:43:46.251066 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:43:46.251066 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:43:46.251066 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:43:46.251066 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:46.251066 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:46.253515 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 388/796] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:43:46.259762 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64c6fd-5052-430e-b51d-ce3f45e6b679 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:46.260323 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64c6fd-5052-430e-b51d-ce3f45e6b679 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:46.260790 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64c6fd-5052-430e-b51d-ce3f45e6b679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:46.277928 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-9b64c6fd-5052-430e-b51d-ce3f45e6b679 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:46.279408 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9b64c6fd-5052-430e-b51d-ce3f45e6b679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:46.315489 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:46.360703 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ae416-66e8-4bbf-b112-2dbb3b1dc071 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:46.361674 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 389/797] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:43:46.362776 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64c6fd-5052-430e-b51d-ce3f45e6b679 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:46.371977 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:46.406387 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1aad3-8a46-4708-965b-df5523cf759d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:46.407196 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1aad3-8a46-4708-965b-df5523cf759d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:46.407476 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1aad3-8a46-4708-965b-df5523cf759d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:46.407747 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1aad3-8a46-4708-965b-df5523cf759d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:46.419737 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1aad3-8a46-4708-965b-df5523cf759d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:46.421222 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1aad3-8a46-4708-965b-df5523cf759d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:46.439342 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-13f1aad3-8a46-4708-965b-df5523cf759d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:46.439342 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:46.439342 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:46.439342 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:46.439342 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:46.439342 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:46.439342 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:46.439342 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:46.439342 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:46.439342 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:46.439342 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:46.439342 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:46.439342 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:46.439342 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:46.439342 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:46.440527 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:46.440527 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:46.440527 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:46.440527 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:46.440527 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:46.440527 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:46.440527 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:46.440527 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:46.440527 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:46.440527 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:46.440527 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:46.440527 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:46.440527 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:46.440527 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:46.440527 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:46.440527 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:46.440527 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:46.441444 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:46.441444 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:46.441444 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:46.441444 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:46.444018 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 409/798] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:46.446006 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9dfe5-fd43-43ce-8980-89f25adf4543 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:46.446329 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9dfe5-fd43-43ce-8980-89f25adf4543 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:46.446609 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9dfe5-fd43-43ce-8980-89f25adf4543 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:46.449081 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 410/799] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:46.452644 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9dfe5-fd43-43ce-8980-89f25adf4543 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:46.478693 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64c6fd-5052-430e-b51d-ce3f45e6b679 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:46.519863 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236c7a4-77bc-41e2-b13a-800f657bc94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:46.520493 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236c7a4-77bc-41e2-b13a-800f657bc94d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:46.520772 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236c7a4-77bc-41e2-b13a-800f657bc94d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:46.521037 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236c7a4-77bc-41e2-b13a-800f657bc94d None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:46.521890 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c236c7a4-77bc-41e2-b13a-800f657bc94d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:46.522249 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c236c7a4-77bc-41e2-b13a-800f657bc94d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:46.523845 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c236c7a4-77bc-41e2-b13a-800f657bc94d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:46.541791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 390/800] 10.222.0.85 () {56 vars in 1148 bytes} [Thu Jun 16 14:43:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:46.541791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236c7a4-77bc-41e2-b13a-800f657bc94d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:46.573082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9dfe5-fd43-43ce-8980-89f25adf4543 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:46.595282 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:46.610557 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8834433-39b5-4b8d-a28d-84fe2b84e47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:46.611651 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8834433-39b5-4b8d-a28d-84fe2b84e47b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:46.611965 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8834433-39b5-4b8d-a28d-84fe2b84e47b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:46.612243 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8834433-39b5-4b8d-a28d-84fe2b84e47b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:46.612989 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:46.623112 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8834433-39b5-4b8d-a28d-84fe2b84e47b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:46.630913 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-e8834433-39b5-4b8d-a28d-84fe2b84e47b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:46.630913 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:46.630913 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:46.630913 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:46.630913 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:46.630913 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:46.630913 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:46.630913 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:46.630913 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:46.630913 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:46.630913 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:46.630913 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:46.630913 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:46.630913 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:46.630913 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:46.630913 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:46.631863 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:46.631863 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:46.631863 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:46.631863 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:46.631863 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:46.631863 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:46.631863 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:46.631863 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:46.631863 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:46.631863 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:46.631863 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:46.631863 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:46.631863 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:46.631863 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:46.631863 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:46.631863 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:46.632756 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:46.632756 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:46.632756 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:46.632756 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:46.632756 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:46.632756 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:46.632756 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:46.632756 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:46.632756 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:46.632756 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:46.632756 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:46.632756 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:46.632756 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 411/801] 10.222.0.85 () {56 vars in 1102 bytes} [Thu Jun 16 14:43:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:46.634450 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf69c4-25ee-4a48-b691-f163a12dc163 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:46.634450 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf69c4-25ee-4a48-b691-f163a12dc163 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:46.634450 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf69c4-25ee-4a48-b691-f163a12dc163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:46.654779 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-dbbf69c4-25ee-4a48-b691-f163a12dc163 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:46.656014 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-dbbf69c4-25ee-4a48-b691-f163a12dc163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:46.659260 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236c7a4-77bc-41e2-b13a-800f657bc94d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:46.704596 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e2df4-4318-4d47-94e2-f4b32774832c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:46.705549 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e2df4-4318-4d47-94e2-f4b32774832c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:46.706028 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e2df4-4318-4d47-94e2-f4b32774832c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:46.706432 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e2df4-4318-4d47-94e2-f4b32774832c None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:46.707590 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e2df4-4318-4d47-94e2-f4b32774832c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:46.708072 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e2df4-4318-4d47-94e2-f4b32774832c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:46.710198 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e2df4-4318-4d47-94e2-f4b32774832c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:46.732578 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 391/802] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:46.732578 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e2df4-4318-4d47-94e2-f4b32774832c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:46.735652 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 412/803] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:43:46.735652 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf69c4-25ee-4a48-b691-f163a12dc163 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:46.859478 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e2df4-4318-4d47-94e2-f4b32774832c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:46.877165 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf69c4-25ee-4a48-b691-f163a12dc163 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:46.894402 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:46.900492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:46.913341 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab0d76-f6c2-4665-8e4b-47043a58312d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:46.915183 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab0d76-f6c2-4665-8e4b-47043a58312d None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:46.916002 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab0d76-f6c2-4665-8e4b-47043a58312d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:46.916509 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab0d76-f6c2-4665-8e4b-47043a58312d None admin] PATH_INFO: `/v3/projects/80e309a3b3784ba9943734a41949b222/users/bf9c39de29324b0ca6329c9a171367c4/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:46.919491 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab0d76-f6c2-4665-8e4b-47043a58312d None admin] RBAC: Authorizing `identity:create_grant(project_id=80e309a3b3784ba9943734a41949b222, user_id=bf9c39de29324b0ca6329c9a171367c4, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:46.922353 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab0d76-f6c2-4665-8e4b-47043a58312d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:46.936357 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b9525-6496-4989-ac20-78ad540b6ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:46.937536 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b9525-6496-4989-ac20-78ad540b6ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:46.937809 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b9525-6496-4989-ac20-78ad540b6ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:46.938958 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b9525-6496-4989-ac20-78ad540b6ad4 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:46.949476 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 392/804] 10.222.0.85 () {58 vars in 1439 bytes} [Thu Jun 16 14:43:46 2022] PUT /identity/v3/projects/80e309a3b3784ba9943734a41949b222/users/bf9c39de29324b0ca6329c9a171367c4/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:43:46.949476 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab0d76-f6c2-4665-8e4b-47043a58312d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:46.950096 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b9525-6496-4989-ac20-78ad540b6ad4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:46.950096 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b9525-6496-4989-ac20-78ad540b6ad4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:46.950096 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b9525-6496-4989-ac20-78ad540b6ad4 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:46.973785 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 413/805] 10.222.0.85 () {56 vars in 1103 bytes} [Thu Jun 16 14:43:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:46.975313 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b9525-6496-4989-ac20-78ad540b6ad4 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:47.135469 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab0d76-f6c2-4665-8e4b-47043a58312d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:47.153970 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b9525-6496-4989-ac20-78ad540b6ad4 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:47.178195 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506fda9-89ea-4d05-9792-594862feabf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:47.179021 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506fda9-89ea-4d05-9792-594862feabf1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:47.179308 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506fda9-89ea-4d05-9792-594862feabf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:47.179586 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506fda9-89ea-4d05-9792-594862feabf1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:47.189714 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506fda9-89ea-4d05-9792-594862feabf1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:47.191764 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506fda9-89ea-4d05-9792-594862feabf1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:47.200015 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc31920-100c-457e-9a47-6f0e9bd81e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:47.201174 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc31920-100c-457e-9a47-6f0e9bd81e99 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:47.201662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc31920-100c-457e-9a47-6f0e9bd81e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:47.202139 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc31920-100c-457e-9a47-6f0e9bd81e99 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:47.202991 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc31920-100c-457e-9a47-6f0e9bd81e99 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:47.204624 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc31920-100c-457e-9a47-6f0e9bd81e99 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:47.208151 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-e506fda9-89ea-4d05-9792-594862feabf1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:43:47.208151 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:47.208151 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:47.208151 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:47.208151 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:47.208151 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:47.208151 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:47.208151 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:47.208151 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:47.208151 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:47.208151 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:47.208151 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:47.208151 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:43:47.208151 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:43:47.208151 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:43:47.208151 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:43:47.209193 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:47.209193 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:47.209193 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:43:47.209193 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:47.209193 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:43:47.209193 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:47.209193 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:47.209193 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:47.209193 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:47.209193 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:47.209193 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:47.209193 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:47.209193 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:47.209193 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:47.209193 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:47.209193 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:47.209193 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:47.209193 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:47.210224 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:47.210224 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:47.210224 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:43:47.210224 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:43:47.210224 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:43:47.210224 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:43:47.210224 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:43:47.210224 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:43:47.210224 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:43:47.210224 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:47.214647 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 393/806] 10.222.0.85 () {56 vars in 1093 bytes} [Thu Jun 16 14:43:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:47.215722 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506fda9-89ea-4d05-9792-594862feabf1 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:47.229145 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-4dc31920-100c-457e-9a47-6f0e9bd81e99 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 14:43:47.229145 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:47.229145 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:43:47.229145 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:43:47.229145 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:43:47.229145 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:43:47.229145 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:43:47.229145 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:43:47.229145 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 14:43:47.229145 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:47.229145 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:43:47.229145 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:47.229145 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:47.229145 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:47.229145 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:47.229145 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:47.230195 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:47.230195 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:47.230195 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:47.230195 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:47.230195 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:47.230195 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:47.230195 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:47.230195 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:43:47.230195 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:43:47.230195 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:43:47.230195 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:43:47.230195 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:47.230195 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:47.230195 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:47.230195 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:47.230195 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:47.231062 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:47.231062 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:47.231062 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:47.231062 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:47.231062 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:47.231062 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:47.231062 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:47.231062 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:47.231062 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:47.231062 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:47.231062 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:47.231062 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:43:47.231062 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:43:47.231062 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 14:43:47.231062 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:47.233593 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 414/807] 10.222.0.85 () {56 vars in 1129 bytes} [Thu Jun 16 14:43:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:47.238814 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc31920-100c-457e-9a47-6f0e9bd81e99 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:47.279982 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:47.288654 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:47.352111 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506fda9-89ea-4d05-9792-594862feabf1 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:47.377007 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc31920-100c-457e-9a47-6f0e9bd81e99 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:47.388882 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1a76c-3d53-4e32-acf3-82b368e8c4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:47.389710 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1a76c-3d53-4e32-acf3-82b368e8c4ba None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:47.390065 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1a76c-3d53-4e32-acf3-82b368e8c4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:47.390413 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1a76c-3d53-4e32-acf3-82b368e8c4ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:47.403091 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f1a76c-3d53-4e32-acf3-82b368e8c4ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:47.405469 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f1a76c-3d53-4e32-acf3-82b368e8c4ba None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:47.420312 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a938a6-b69f-41cc-b767-e276edd2321f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:47.421086 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a938a6-b69f-41cc-b767-e276edd2321f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:47.421801 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a938a6-b69f-41cc-b767-e276edd2321f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:47.422172 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a938a6-b69f-41cc-b767-e276edd2321f None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:47.423063 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a938a6-b69f-41cc-b767-e276edd2321f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:47.423444 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a938a6-b69f-41cc-b767-e276edd2321f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:47.425068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a938a6-b69f-41cc-b767-e276edd2321f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:47.432163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-c2f1a76c-3d53-4e32-acf3-82b368e8c4ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:47.432163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:47.432163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:47.432163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:47.432163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:47.432163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:47.432163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:47.432163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:47.432163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:47.432163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:47.432163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:47.432163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:47.432163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:47.432163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:47.432163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:47.433121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:47.433121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:47.433121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:47.433121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:47.433121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:47.433121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:47.433121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:47.433121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:47.433121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:47.433121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:47.433121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:47.433121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:47.433121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:47.433121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:47.433121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:47.433121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:47.433121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:47.434102 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:47.434102 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:47.434102 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:47.434102 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:47.436852 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 394/808] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:47.439140 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1a76c-3d53-4e32-acf3-82b368e8c4ba None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:47.451970 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 415/809] 10.222.0.85 () {56 vars in 1133 bytes} [Thu Jun 16 14:43:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:47.453221 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a938a6-b69f-41cc-b767-e276edd2321f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:47.567719 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:47.571850 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1a76c-3d53-4e32-acf3-82b368e8c4ba None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:47.587221 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:47.594900 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a938a6-b69f-41cc-b767-e276edd2321f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:47.615420 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fffe10b-5854-4c2a-a26d-26f32a990800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:47.616233 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fffe10b-5854-4c2a-a26d-26f32a990800 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:47.616582 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fffe10b-5854-4c2a-a26d-26f32a990800 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:47.616923 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fffe10b-5854-4c2a-a26d-26f32a990800 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:47.617715 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fffe10b-5854-4c2a-a26d-26f32a990800 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:47.618114 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fffe10b-5854-4c2a-a26d-26f32a990800 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:47.619649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fffe10b-5854-4c2a-a26d-26f32a990800 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:47.624429 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 395/810] 10.222.0.85 () {56 vars in 1124 bytes} [Thu Jun 16 14:43:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:47.625228 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fffe10b-5854-4c2a-a26d-26f32a990800 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:47.637441 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217baded-ee63-4e6f-9939-d7f67895d966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:47.638209 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217baded-ee63-4e6f-9939-d7f67895d966 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:47.638561 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217baded-ee63-4e6f-9939-d7f67895d966 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:47.638960 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217baded-ee63-4e6f-9939-d7f67895d966 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:47.639813 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217baded-ee63-4e6f-9939-d7f67895d966 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:47.640135 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217baded-ee63-4e6f-9939-d7f67895d966 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:47.641522 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217baded-ee63-4e6f-9939-d7f67895d966 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:47.654921 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 416/811] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:47.656316 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12b291-fd2c-481d-87c0-c068cc850cbc None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:47.656607 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12b291-fd2c-481d-87c0-c068cc850cbc None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:47.656886 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12b291-fd2c-481d-87c0-c068cc850cbc None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:47.662187 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 417/812] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:47.662187 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12b291-fd2c-481d-87c0-c068cc850cbc None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:47.743638 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fffe10b-5854-4c2a-a26d-26f32a990800 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:47.780669 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e5b1d-696c-41fc-bd88-53367dd8b01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:47.781327 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e5b1d-696c-41fc-bd88-53367dd8b01d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:47.781608 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e5b1d-696c-41fc-bd88-53367dd8b01d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:47.781879 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e5b1d-696c-41fc-bd88-53367dd8b01d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:47.792273 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12b291-fd2c-481d-87c0-c068cc850cbc None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:47.818284 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:47.835217 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33034928-d300-4aa2-8ba0-2ad459833b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:47.835980 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33034928-d300-4aa2-8ba0-2ad459833b44 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:47.836267 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33034928-d300-4aa2-8ba0-2ad459833b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:47.836542 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33034928-d300-4aa2-8ba0-2ad459833b44 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:47.837665 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33034928-d300-4aa2-8ba0-2ad459833b44 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:47.837976 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33034928-d300-4aa2-8ba0-2ad459833b44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:47.839376 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33034928-d300-4aa2-8ba0-2ad459833b44 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:47.846179 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 418/813] 10.222.0.85 () {56 vars in 1124 bytes} [Thu Jun 16 14:43:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:47.846976 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33034928-d300-4aa2-8ba0-2ad459833b44 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:47.867387 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:47.867559 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e5b1d-696c-41fc-bd88-53367dd8b01d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:47.869138 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e5b1d-696c-41fc-bd88-53367dd8b01d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:47.954470 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33034928-d300-4aa2-8ba0-2ad459833b44 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:47.970958 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 396/814] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:47 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:43:47.975776 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5c11a-a266-42b0-a097-2ca0e99788d8 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:47.975776 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5c11a-a266-42b0-a097-2ca0e99788d8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:47.975776 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5c11a-a266-42b0-a097-2ca0e99788d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:47.989378 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e5b5c11a-a266-42b0-a097-2ca0e99788d8 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:47.990590 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e5b5c11a-a266-42b0-a097-2ca0e99788d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:47.996452 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7159c-8f72-4587-a88a-5f2ffd1268cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:47.997276 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7159c-8f72-4587-a88a-5f2ffd1268cb None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:47.997557 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7159c-8f72-4587-a88a-5f2ffd1268cb None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:47.997931 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7159c-8f72-4587-a88a-5f2ffd1268cb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:48.006255 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7159c-8f72-4587-a88a-5f2ffd1268cb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:48.007962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7159c-8f72-4587-a88a-5f2ffd1268cb None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:48.024214 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-70d7159c-8f72-4587-a88a-5f2ffd1268cb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 14:43:48.024214 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:48.024214 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:48.024214 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:48.024214 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:48.024214 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:48.024214 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:48.024214 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:48.024214 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:48.024214 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:48.024214 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:48.024214 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:48.024214 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:43:48.024214 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:43:48.024214 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:43:48.024214 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:43:48.025250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:48.025250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:48.025250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:43:48.025250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:48.025250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:43:48.025250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:48.025250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:48.025250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:48.025250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:48.025250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:48.025250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:48.025250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:48.025250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:48.025250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:48.025250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:48.025250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:48.025250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:48.025250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:48.026216 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:48.026216 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:48.026216 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:43:48.026216 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:43:48.026216 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:43:48.026216 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:43:48.026216 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:43:48.026216 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:43:48.026216 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 14:43:48.026216 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:48.030462 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 419/815] 10.222.0.85 () {56 vars in 1117 bytes} [Thu Jun 16 14:43:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:48.031314 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7159c-8f72-4587-a88a-5f2ffd1268cb None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:48.053358 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:48.072033 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 397/816] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:43:48.072033 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5c11a-a266-42b0-a097-2ca0e99788d8 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:48.125368 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:48.158404 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7159c-8f72-4587-a88a-5f2ffd1268cb None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:48.183129 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5c11a-a266-42b0-a097-2ca0e99788d8 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:48.196194 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa70c7-8cce-454e-89d6-b7b7e0d5db6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:48.197115 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa70c7-8cce-454e-89d6-b7b7e0d5db6a None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:48.197329 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa70c7-8cce-454e-89d6-b7b7e0d5db6a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:48.197623 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa70c7-8cce-454e-89d6-b7b7e0d5db6a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:48.198621 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa70c7-8cce-454e-89d6-b7b7e0d5db6a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:48.199759 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa70c7-8cce-454e-89d6-b7b7e0d5db6a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:48.220152 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179dfe99-bea3-4863-aa19-d05428cb1719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:48.220898 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dfe99-bea3-4863-aa19-d05428cb1719 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:48.221181 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dfe99-bea3-4863-aa19-d05428cb1719 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:48.221456 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dfe99-bea3-4863-aa19-d05428cb1719 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:48.232091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 420/817] 10.222.0.85 () {60 vars in 1144 bytes} [Thu Jun 16 14:43:48 2022] POST /identity/v3/endpoints => generated 346 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:43:48.232091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa70c7-8cce-454e-89d6-b7b7e0d5db6a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:48.232616 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179dfe99-bea3-4863-aa19-d05428cb1719 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:48.234437 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179dfe99-bea3-4863-aa19-d05428cb1719 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:48.254484 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-179dfe99-bea3-4863-aa19-d05428cb1719 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:48.254484 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:48.254484 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:48.254484 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:48.254484 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:48.254484 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:48.254484 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:48.254484 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:48.254484 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:48.254484 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:48.254484 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:48.254484 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:48.254484 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:48.254484 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:48.254484 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:48.255648 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:48.255648 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:48.255648 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:48.255648 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:48.255648 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:48.255648 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:48.255648 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:48.255648 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:48.255648 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:48.255648 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:48.255648 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:48.255648 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:48.255648 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:48.255648 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:48.255648 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:48.255648 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:48.255648 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:48.256791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:48.256791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:48.256791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:48.256791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:48.257550 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 398/818] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:48.258237 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179dfe99-bea3-4863-aa19-d05428cb1719 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:48.310395 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:48.368240 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa70c7-8cce-454e-89d6-b7b7e0d5db6a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:48.372495 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179dfe99-bea3-4863-aa19-d05428cb1719 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:48.404099 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:48.412263 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21541a-d6cb-4db0-a831-ad606f3476c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:48.413272 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0c165-1a73-4253-ba1f-88c3002e0d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:48.413928 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21541a-d6cb-4db0-a831-ad606f3476c3 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:48.414359 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0c165-1a73-4253-ba1f-88c3002e0d15 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:48.414529 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21541a-d6cb-4db0-a831-ad606f3476c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:48.414965 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0c165-1a73-4253-ba1f-88c3002e0d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:48.415157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21541a-d6cb-4db0-a831-ad606f3476c3 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:48.415466 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0c165-1a73-4253-ba1f-88c3002e0d15 None admin] PATH_INFO: `/v3/services/network` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:48.416433 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21541a-d6cb-4db0-a831-ad606f3476c3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:48.416614 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e0c165-1a73-4253-ba1f-88c3002e0d15 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:48.417069 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21541a-d6cb-4db0-a831-ad606f3476c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:48.418814 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21541a-d6cb-4db0-a831-ad606f3476c3 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:48.419010 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e0c165-1a73-4253-ba1f-88c3002e0d15 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:48.433152 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-e6e0c165-1a73-4253-ba1f-88c3002e0d15 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 14:43:48.433152 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:48.433152 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:43:48.433152 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:43:48.433152 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:43:48.433152 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:43:48.433152 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:43:48.433152 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:43:48.433152 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 14:43:48.433152 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:48.433152 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:43:48.433152 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:48.433152 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:48.433152 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:48.433152 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:48.433152 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:48.433152 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:48.434209 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:48.434209 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:48.434209 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:48.434209 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:48.434209 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:48.434209 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:48.434209 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:43:48.434209 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:43:48.434209 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:43:48.434209 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:43:48.434209 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:48.434209 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:48.434209 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:48.434209 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:48.434209 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:48.434209 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:48.435145 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:48.435145 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:48.435145 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:48.435145 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:48.435145 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:48.435145 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:48.435145 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:48.435145 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:48.435145 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:48.435145 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:48.435145 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:43:48.435145 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:43:48.435145 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 14:43:48.435145 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:48.439406 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 399/819] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:48 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:48.440404 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0c165-1a73-4253-ba1f-88c3002e0d15 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:48.442534 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 421/820] 10.222.0.85 () {56 vars in 1149 bytes} [Thu Jun 16 14:43:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:48.444382 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21541a-d6cb-4db0-a831-ad606f3476c3 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:48.577835 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21541a-d6cb-4db0-a831-ad606f3476c3 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:48.608949 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0c165-1a73-4253-ba1f-88c3002e0d15 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:48.619531 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:48.636698 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396e82a-b41f-4e0b-b620-8de2fcb8f1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:48.638272 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396e82a-b41f-4e0b-b620-8de2fcb8f1c8 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:48.638990 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396e82a-b41f-4e0b-b620-8de2fcb8f1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:48.639458 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396e82a-b41f-4e0b-b620-8de2fcb8f1c8 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:48.640621 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d396e82a-b41f-4e0b-b620-8de2fcb8f1c8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:48.641500 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d396e82a-b41f-4e0b-b620-8de2fcb8f1c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:48.643576 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d396e82a-b41f-4e0b-b620-8de2fcb8f1c8 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:48.651301 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 422/821] 10.222.0.85 () {56 vars in 1112 bytes} [Thu Jun 16 14:43:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:48.652158 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ec523-f41b-4ad3-abf5-d5f452dee5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:48.652605 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396e82a-b41f-4e0b-b620-8de2fcb8f1c8 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:48.652969 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ec523-f41b-4ad3-abf5-d5f452dee5ae None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:48.655940 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ec523-f41b-4ad3-abf5-d5f452dee5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:48.655940 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ec523-f41b-4ad3-abf5-d5f452dee5ae None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:48.655940 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ec523-f41b-4ad3-abf5-d5f452dee5ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:48.655940 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ec523-f41b-4ad3-abf5-d5f452dee5ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:48.656293 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ec523-f41b-4ad3-abf5-d5f452dee5ae None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:48.675404 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 400/822] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:48.676665 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ec523-f41b-4ad3-abf5-d5f452dee5ae None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:48.717404 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:48.770049 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396e82a-b41f-4e0b-b620-8de2fcb8f1c8 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:48.809085 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ec523-f41b-4ad3-abf5-d5f452dee5ae None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:48.809765 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b19b1b-e473-42b1-acda-412890a00d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:48.811068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b19b1b-e473-42b1-acda-412890a00d62 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:48.811666 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b19b1b-e473-42b1-acda-412890a00d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:48.812181 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b19b1b-e473-42b1-acda-412890a00d62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:48.824852 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b19b1b-e473-42b1-acda-412890a00d62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:48.826783 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b19b1b-e473-42b1-acda-412890a00d62 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:48.846601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-a4b19b1b-e473-42b1-acda-412890a00d62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:48.846601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:48.846601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:48.846601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:48.846601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:48.846601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:48.846601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:48.846601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:48.846601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:48.846601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:48.846601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:48.846601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:48.846601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:48.846601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:48.846601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:48.847611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:48.847611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:48.847611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:48.847611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:48.847611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:48.847611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:48.847611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:48.847611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:48.847611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:48.847611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:48.847611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:48.847611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:48.847611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:48.847611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:48.847611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:48.847611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:48.847611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:48.848542 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:48.848542 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:48.848542 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:48.848542 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:48.849925 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363111db-a8b8-474c-a235-54de981c0922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:48.850610 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363111db-a8b8-474c-a235-54de981c0922 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:48.850896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363111db-a8b8-474c-a235-54de981c0922 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:48.851186 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363111db-a8b8-474c-a235-54de981c0922 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:48.851761 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 423/823] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:48.851990 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363111db-a8b8-474c-a235-54de981c0922 None admin] RBAC: Adding query filter params (type=network) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:48.852455 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363111db-a8b8-474c-a235-54de981c0922 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:48.853400 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b19b1b-e473-42b1-acda-412890a00d62 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:48.854085 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363111db-a8b8-474c-a235-54de981c0922 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:48.865506 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 401/824] 10.222.0.85 () {56 vars in 1112 bytes} [Thu Jun 16 14:43:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:48.865506 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363111db-a8b8-474c-a235-54de981c0922 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:48.902351 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:48.971147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b19b1b-e473-42b1-acda-412890a00d62 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:48.974308 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:48.995247 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363111db-a8b8-474c-a235-54de981c0922 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:49.010369 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db4d09-007a-4c41-90fa-4354e97b1457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:49.011701 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db4d09-007a-4c41-90fa-4354e97b1457 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:49.012210 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db4d09-007a-4c41-90fa-4354e97b1457 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:49.012700 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db4d09-007a-4c41-90fa-4354e97b1457 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:49.020261 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db4d09-007a-4c41-90fa-4354e97b1457 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:49.021996 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db4d09-007a-4c41-90fa-4354e97b1457 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:49.036665 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e839259-7e03-47ec-ad9b-f8863e76b1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:49.037143 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-51db4d09-007a-4c41-90fa-4354e97b1457 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:49.037143 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:49.037143 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:49.037143 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:49.037143 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:49.037143 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:49.037143 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:49.037143 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:49.037143 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:49.037143 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:49.037143 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:49.037143 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:49.037143 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:43:49.037143 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:43:49.037143 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:43:49.038051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:43:49.038051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:49.038051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:49.038051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:49.038051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:49.038051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:49.038051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:49.038051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:49.038051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:49.038051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:49.038051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:49.038051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:49.038051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:49.038051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:49.038051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:49.038051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:49.038051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:49.038928 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:43:49.038928 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:43:49.038928 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:43:49.038928 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:43:49.038928 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:43:49.038928 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:43:49.038928 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:49.038928 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:49.039370 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e839259-7e03-47ec-ad9b-f8863e76b1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:49.039370 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e839259-7e03-47ec-ad9b-f8863e76b1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:49.039370 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e839259-7e03-47ec-ad9b-f8863e76b1c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:49.039370 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e839259-7e03-47ec-ad9b-f8863e76b1c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:49.039370 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e839259-7e03-47ec-ad9b-f8863e76b1c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:49.040546 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e839259-7e03-47ec-ad9b-f8863e76b1c1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:49.043183 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 424/825] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:49.044869 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db4d09-007a-4c41-90fa-4354e97b1457 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:49.055333 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 402/826] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:49.056628 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e839259-7e03-47ec-ad9b-f8863e76b1c1 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:49.163512 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:49.172852 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db4d09-007a-4c41-90fa-4354e97b1457 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:49.174799 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e839259-7e03-47ec-ad9b-f8863e76b1c1 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:49.211586 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123c264-57cd-4b6b-8e4e-d007bb73038e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:49.212767 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123c264-57cd-4b6b-8e4e-d007bb73038e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:49.214188 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123c264-57cd-4b6b-8e4e-d007bb73038e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:49.214672 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123c264-57cd-4b6b-8e4e-d007bb73038e None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:49.214934 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968719d-e758-4dcc-8a72-807b484bf999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:49.215605 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968719d-e758-4dcc-8a72-807b484bf999 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:49.215903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968719d-e758-4dcc-8a72-807b484bf999 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:49.216192 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968719d-e758-4dcc-8a72-807b484bf999 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:49.216572 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123c264-57cd-4b6b-8e4e-d007bb73038e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:49.216948 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968719d-e758-4dcc-8a72-807b484bf999 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:49.217295 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123c264-57cd-4b6b-8e4e-d007bb73038e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:49.218339 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968719d-e758-4dcc-8a72-807b484bf999 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:49.219151 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123c264-57cd-4b6b-8e4e-d007bb73038e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:49.235323 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 403/827] 10.222.0.85 () {56 vars in 1148 bytes} [Thu Jun 16 14:43:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:49.236858 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123c264-57cd-4b6b-8e4e-d007bb73038e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:49.248154 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 425/828] 10.222.0.85 () {60 vars in 1144 bytes} [Thu Jun 16 14:43:49 2022] POST /identity/v3/endpoints => generated 327 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:43:49.248154 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968719d-e758-4dcc-8a72-807b484bf999 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:49.293035 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:49.451534 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968719d-e758-4dcc-8a72-807b484bf999 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:49.455197 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123c264-57cd-4b6b-8e4e-d007bb73038e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:49.505379 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999883d-a1df-4ca2-b1fa-f56cd8856f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:49.505590 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b1439-501a-4eb6-ad4e-eb8eaf484dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:49.506201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999883d-a1df-4ca2-b1fa-f56cd8856f9d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:49.506302 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b1439-501a-4eb6-ad4e-eb8eaf484dba None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:49.506485 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999883d-a1df-4ca2-b1fa-f56cd8856f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:49.506597 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b1439-501a-4eb6-ad4e-eb8eaf484dba None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:49.506769 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999883d-a1df-4ca2-b1fa-f56cd8856f9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:49.506862 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b1439-501a-4eb6-ad4e-eb8eaf484dba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:49.507629 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b1439-501a-4eb6-ad4e-eb8eaf484dba None admin] RBAC: Adding query filter params (role.id=95dcfa6c726a4d01a41d2642554fd338, scope.project.id=80e309a3b3784ba9943734a41949b222, user.id=c74e4d1bdaa64ed280cc5f4c8e79b842) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:49.509574 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b1439-501a-4eb6-ad4e-eb8eaf484dba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:49.509709 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b1439-501a-4eb6-ad4e-eb8eaf484dba None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:49.517615 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999883d-a1df-4ca2-b1fa-f56cd8856f9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:49.517788 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 426/829] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:49 2022] GET /identity/v3/role_assignments?user.id=c74e4d1bdaa64ed280cc5f4c8e79b842&scope.project.id=80e309a3b3784ba9943734a41949b222&role.id=95dcfa6c726a4d01a41d2642554fd338 => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:49.517866 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999883d-a1df-4ca2-b1fa-f56cd8856f9d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:49.517933 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fab806-d2c1-4afe-adc6-a0f52d3c7fc8 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:49.518030 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fab806-d2c1-4afe-adc6-a0f52d3c7fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:49.518265 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fab806-d2c1-4afe-adc6-a0f52d3c7fc8 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:49.519622 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 427/830] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:49.535803 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-8999883d-a1df-4ca2-b1fa-f56cd8856f9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:49.535803 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:49.535803 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:49.535803 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:49.535803 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:49.535803 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:49.535803 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:49.535803 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:49.535803 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:49.535803 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:49.535803 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:49.535803 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:49.535803 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:43:49.535803 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:43:49.535803 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:43:49.536929 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:43:49.536929 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:49.536929 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:49.536929 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:49.536929 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:49.536929 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:49.536929 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:49.536929 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:49.536929 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:49.536929 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:49.536929 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:49.536929 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:49.536929 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:49.536929 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:49.536929 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:49.536929 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:49.536929 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:49.537811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:43:49.537811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:43:49.537811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:43:49.537811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:43:49.537811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:43:49.537811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:43:49.537811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:49.537811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:49.537811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 404/831] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:49.545692 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fab806-d2c1-4afe-adc6-a0f52d3c7fc8 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:49.546297 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564db33-eda1-4048-aad3-44725dbfc058 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:49.546946 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564db33-eda1-4048-aad3-44725dbfc058 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:49.547227 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564db33-eda1-4048-aad3-44725dbfc058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:49.566943 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e564db33-eda1-4048-aad3-44725dbfc058 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:49.568244 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e564db33-eda1-4048-aad3-44725dbfc058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:49.577184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:49.666495 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 405/832] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:43:49.672273 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:49.691747 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564db33-eda1-4048-aad3-44725dbfc058 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:49.693375 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fab806-d2c1-4afe-adc6-a0f52d3c7fc8 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:49.740608 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ae959-02f1-4dd1-b14a-948f6859f4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:49.741030 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ae959-02f1-4dd1-b14a-948f6859f4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:49.741320 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ae959-02f1-4dd1-b14a-948f6859f4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:49.741603 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ae959-02f1-4dd1-b14a-948f6859f4c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:49.742408 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ae959-02f1-4dd1-b14a-948f6859f4c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:49.742802 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ae959-02f1-4dd1-b14a-948f6859f4c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:49.745075 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ae959-02f1-4dd1-b14a-948f6859f4c7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:49.759061 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 428/833] 10.222.0.85 () {56 vars in 1148 bytes} [Thu Jun 16 14:43:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:49.764561 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ae959-02f1-4dd1-b14a-948f6859f4c7 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:49.816171 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564db33-eda1-4048-aad3-44725dbfc058 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:49.861111 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a8707a-4394-4d6d-b45f-032163395a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:49.862119 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8707a-4394-4d6d-b45f-032163395a6d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:49.862852 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8707a-4394-4d6d-b45f-032163395a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:49.863232 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8707a-4394-4d6d-b45f-032163395a6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:49.878307 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a8707a-4394-4d6d-b45f-032163395a6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:49.885870 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ae959-02f1-4dd1-b14a-948f6859f4c7 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:49.889317 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-21a8707a-4394-4d6d-b45f-032163395a6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:49.889317 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:49.889317 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:49.889317 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:49.889317 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:49.889317 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:49.889317 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:49.889317 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:49.889317 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:49.889317 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:49.889317 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:49.889317 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:49.889317 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:49.889317 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:49.889317 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:49.889317 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:49.890257 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:49.890257 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:49.890257 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:49.890257 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:49.890257 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:49.890257 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:49.890257 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:49.890257 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:49.890257 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:49.890257 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:49.890257 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:49.890257 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:49.890257 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:49.890257 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:49.890257 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:49.890257 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:49.891141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:49.891141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:49.891141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:49.891141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:49.891141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:49.891141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:49.891141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:49.891141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:49.891141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:49.891141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:49.891141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:49.891141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:49.891141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 406/834] 10.222.0.85 () {56 vars in 1096 bytes} [Thu Jun 16 14:43:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:49.897138 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a8707a-4394-4d6d-b45f-032163395a6d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:49.901288 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:49.931171 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037be98-4802-46a9-8d82-81cadbb1895c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:49.933012 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037be98-4802-46a9-8d82-81cadbb1895c None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:49.933444 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037be98-4802-46a9-8d82-81cadbb1895c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:49.933887 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037be98-4802-46a9-8d82-81cadbb1895c None admin] PATH_INFO: `/v3/projects/80e309a3b3784ba9943734a41949b222/users/db4d36e6837d4b2fa4b7ee5c7243b6b3/roles/17fa92022f834aa5bf5cb9e3a506a478` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:49.951899 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:49.957925 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037be98-4802-46a9-8d82-81cadbb1895c None admin] RBAC: Authorizing `identity:create_grant(project_id=80e309a3b3784ba9943734a41949b222, user_id=db4d36e6837d4b2fa4b7ee5c7243b6b3, role_id=17fa92022f834aa5bf5cb9e3a506a478)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:49.960040 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037be98-4802-46a9-8d82-81cadbb1895c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:49.982294 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 429/835] 10.222.0.85 () {58 vars in 1439 bytes} [Thu Jun 16 14:43:49 2022] PUT /identity/v3/projects/80e309a3b3784ba9943734a41949b222/users/db4d36e6837d4b2fa4b7ee5c7243b6b3/roles/17fa92022f834aa5bf5cb9e3a506a478 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:43:50.019073 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a8707a-4394-4d6d-b45f-032163395a6d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:50.061192 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9a214-2614-45c0-8281-373eb2b9a3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:50.061895 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9a214-2614-45c0-8281-373eb2b9a3ce None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:50.062179 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9a214-2614-45c0-8281-373eb2b9a3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:50.062455 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9a214-2614-45c0-8281-373eb2b9a3ce None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:50.063225 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9a214-2614-45c0-8281-373eb2b9a3ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:50.063535 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9a214-2614-45c0-8281-373eb2b9a3ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:50.065000 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9a214-2614-45c0-8281-373eb2b9a3ce None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:50.075562 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 407/836] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:50.081197 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037be98-4802-46a9-8d82-81cadbb1895c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:50.203234 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037be98-4802-46a9-8d82-81cadbb1895c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:50.239158 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c9848-a489-4e37-91aa-21f84416ee63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:50.239991 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c9848-a489-4e37-91aa-21f84416ee63 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:50.240277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c9848-a489-4e37-91aa-21f84416ee63 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:50.240551 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c9848-a489-4e37-91aa-21f84416ee63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:50.251439 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c9848-a489-4e37-91aa-21f84416ee63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:50.252936 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c9848-a489-4e37-91aa-21f84416ee63 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:50.274594 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-ca0c9848-a489-4e37-91aa-21f84416ee63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:50.274594 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:50.274594 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:50.274594 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:50.274594 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:50.274594 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:50.274594 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:50.274594 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:50.274594 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:50.274594 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:50.274594 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:50.274594 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:50.274594 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:50.274594 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:50.274594 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:50.275509 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:50.275509 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:50.275509 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:50.275509 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:50.275509 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:50.275509 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:50.275509 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:50.275509 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:50.275509 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:50.275509 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:50.275509 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:50.275509 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:50.275509 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:50.275509 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:50.275509 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:50.275509 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:50.275509 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:50.276445 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:50.276445 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:50.276445 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:50.276445 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:50.276445 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 430/837] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:50.281473 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9a214-2614-45c0-8281-373eb2b9a3ce None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:50.347709 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:50.388800 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9a214-2614-45c0-8281-373eb2b9a3ce None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:50.424554 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e62d25-f5b6-4e9b-9577-c23ba6870849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:50.425231 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e62d25-f5b6-4e9b-9577-c23ba6870849 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:50.425517 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e62d25-f5b6-4e9b-9577-c23ba6870849 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:50.425797 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e62d25-f5b6-4e9b-9577-c23ba6870849 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:50.426536 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e62d25-f5b6-4e9b-9577-c23ba6870849 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:50.426847 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e62d25-f5b6-4e9b-9577-c23ba6870849 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:50.428337 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e62d25-f5b6-4e9b-9577-c23ba6870849 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:50.441727 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 408/838] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:50.447274 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c9848-a489-4e37-91aa-21f84416ee63 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:50.497557 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:50.561665 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbaa87-2bf8-4ed4-a90a-7df8f68e64cc None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:50.561971 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbaa87-2bf8-4ed4-a90a-7df8f68e64cc None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:50.562158 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbaa87-2bf8-4ed4-a90a-7df8f68e64cc None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:50.563664 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 409/839] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:43:50.566697 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c9848-a489-4e37-91aa-21f84416ee63 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:50.570028 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca78079-ab5c-4511-b962-a143f755c27c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:50.570386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca78079-ab5c-4511-b962-a143f755c27c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:50.570735 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca78079-ab5c-4511-b962-a143f755c27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:50.588694 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-cca78079-ab5c-4511-b962-a143f755c27c None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:50.590096 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-cca78079-ab5c-4511-b962-a143f755c27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:50.604707 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7711b-777b-429f-86c9-50f935a824f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:50.606033 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7711b-777b-429f-86c9-50f935a824f6 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:50.606358 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7711b-777b-429f-86c9-50f935a824f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:50.606632 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7711b-777b-429f-86c9-50f935a824f6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:50.614522 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7711b-777b-429f-86c9-50f935a824f6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:50.616043 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7711b-777b-429f-86c9-50f935a824f6 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:50.632829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-0bf7711b-777b-429f-86c9-50f935a824f6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 14:43:50.632829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:50.632829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:50.632829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:50.632829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:50.632829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:50.632829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:50.632829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:50.632829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:50.632829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:50.632829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:50.632829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:50.632829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:43:50.632829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:43:50.632829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:43:50.632829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:43:50.633914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:50.633914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:50.633914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:43:50.633914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:50.633914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:43:50.633914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:50.633914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:50.633914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:50.633914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:50.633914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:50.633914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:50.633914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:50.633914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:50.633914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:50.633914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:50.633914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:50.633914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:50.633914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:50.634965 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:50.634965 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:50.634965 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:43:50.634965 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:43:50.634965 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:43:50.634965 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:43:50.634965 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:43:50.634965 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:43:50.634965 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 14:43:50.634965 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:50.634965 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 431/840] 10.222.0.85 () {56 vars in 1096 bytes} [Thu Jun 16 14:43:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:50.640492 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7711b-777b-429f-86c9-50f935a824f6 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:50.687906 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 410/841] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:43:50.710842 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca78079-ab5c-4511-b962-a143f755c27c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:50.768645 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7711b-777b-429f-86c9-50f935a824f6 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:50.771231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:50.772261 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:50.821589 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84af83a-7e41-4baa-b33f-a3d22eef972e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:50.822875 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84af83a-7e41-4baa-b33f-a3d22eef972e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:50.823356 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84af83a-7e41-4baa-b33f-a3d22eef972e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:50.823817 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84af83a-7e41-4baa-b33f-a3d22eef972e None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:50.824916 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84af83a-7e41-4baa-b33f-a3d22eef972e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:50.825425 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84af83a-7e41-4baa-b33f-a3d22eef972e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:50.827058 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84af83a-7e41-4baa-b33f-a3d22eef972e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:50.833944 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca78079-ab5c-4511-b962-a143f755c27c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:50.851444 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 432/842] 10.222.0.85 () {56 vars in 1135 bytes} [Thu Jun 16 14:43:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:50.852975 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84af83a-7e41-4baa-b33f-a3d22eef972e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:50.879796 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbad648-361b-4968-a248-c67110b7a12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:50.880628 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbad648-361b-4968-a248-c67110b7a12e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:50.880904 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbad648-361b-4968-a248-c67110b7a12e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:50.881174 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbad648-361b-4968-a248-c67110b7a12e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:50.881819 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbad648-361b-4968-a248-c67110b7a12e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:50.883189 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbad648-361b-4968-a248-c67110b7a12e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:50.900223 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-1dbad648-361b-4968-a248-c67110b7a12e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 14:43:50.900223 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:50.900223 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:43:50.900223 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:43:50.900223 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:43:50.900223 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:43:50.900223 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:43:50.900223 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:43:50.900223 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 14:43:50.900223 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:50.900223 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:43:50.900223 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:50.900223 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:50.900223 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:50.900223 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:50.900223 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:50.900223 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:50.901294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:50.901294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:50.901294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:50.901294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:50.901294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:50.901294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:50.901294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:43:50.901294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:43:50.901294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:43:50.901294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:43:50.901294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:50.901294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:50.901294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:50.901294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:50.901294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:50.901294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:50.902121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:50.902121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:50.902121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:50.902121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:50.902121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:50.902121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:50.902121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:50.902121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:50.902121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:50.902121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:50.902121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:43:50.902121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:43:50.902121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 14:43:50.902121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:50.906457 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 411/843] 10.222.0.85 () {56 vars in 1114 bytes} [Thu Jun 16 14:43:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:43:50.907421 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbad648-361b-4968-a248-c67110b7a12e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:50.976098 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84af83a-7e41-4baa-b33f-a3d22eef972e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:51.011770 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb0710-e79c-4f5e-9ac9-dd404aa6b24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:51.012471 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb0710-e79c-4f5e-9ac9-dd404aa6b24f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:51.012989 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb0710-e79c-4f5e-9ac9-dd404aa6b24f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:51.012989 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb0710-e79c-4f5e-9ac9-dd404aa6b24f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:51.043340 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:51.043897 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbad648-361b-4968-a248-c67110b7a12e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:51.069392 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:51.090387 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb0710-e79c-4f5e-9ac9-dd404aa6b24f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:51.092019 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb0710-e79c-4f5e-9ac9-dd404aa6b24f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:51.093618 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0502c92-a78e-4699-b9b2-874e798428ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:51.094712 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0502c92-a78e-4699-b9b2-874e798428ec None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:51.096070 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0502c92-a78e-4699-b9b2-874e798428ec None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:51.096496 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0502c92-a78e-4699-b9b2-874e798428ec None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:51.097349 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0502c92-a78e-4699-b9b2-874e798428ec None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:51.097799 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0502c92-a78e-4699-b9b2-874e798428ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:51.099301 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0502c92-a78e-4699-b9b2-874e798428ec None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:51.106356 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 412/844] 10.222.0.85 () {56 vars in 1114 bytes} [Thu Jun 16 14:43:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:51.111419 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0502c92-a78e-4699-b9b2-874e798428ec None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:51.220714 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 433/845] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:50 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:43:51.226542 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb0710-e79c-4f5e-9ac9-dd404aa6b24f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:51.235900 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0502c92-a78e-4699-b9b2-874e798428ec None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:51.272732 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502d979-6bcb-4a5e-b8a3-f34e49202af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:51.273513 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502d979-6bcb-4a5e-b8a3-f34e49202af1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:51.273862 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502d979-6bcb-4a5e-b8a3-f34e49202af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:51.275068 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502d979-6bcb-4a5e-b8a3-f34e49202af1 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:51.275068 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502d979-6bcb-4a5e-b8a3-f34e49202af1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:51.275494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502d979-6bcb-4a5e-b8a3-f34e49202af1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:51.276988 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502d979-6bcb-4a5e-b8a3-f34e49202af1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:51.288221 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 413/846] 10.222.0.85 () {56 vars in 1114 bytes} [Thu Jun 16 14:43:51 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:51.306057 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:51.354867 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb0710-e79c-4f5e-9ac9-dd404aa6b24f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:51.517870 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a45a0-e527-430c-824d-7085a23d7ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:51.519075 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a45a0-e527-430c-824d-7085a23d7ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:51.519532 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a45a0-e527-430c-824d-7085a23d7ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:51.520078 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a45a0-e527-430c-824d-7085a23d7ff7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:51.531335 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a45a0-e527-430c-824d-7085a23d7ff7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:51.533112 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a45a0-e527-430c-824d-7085a23d7ff7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:51.552144 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-868a45a0-e527-430c-824d-7085a23d7ff7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:51.552144 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:51.552144 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:51.552144 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:51.552144 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:51.552144 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:51.552144 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:51.552144 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:51.552144 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:51.552144 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:51.552144 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:51.552144 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:51.552144 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:51.552144 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:51.552144 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:51.553128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:51.553128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:51.553128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:51.553128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:51.553128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:51.553128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:51.553128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:51.553128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:51.553128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:51.553128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:51.553128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:51.553128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:51.553128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:51.553128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:51.553128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:51.553128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:51.553128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:51.554050 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:51.554050 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:51.554050 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:51.554050 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:51.556514 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 434/847] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:43:51.562469 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502d979-6bcb-4a5e-b8a3-f34e49202af1 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:51.616951 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:51.669488 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502d979-6bcb-4a5e-b8a3-f34e49202af1 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:51.705150 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652bd615-be93-4f9a-905f-a97fcb3273dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:51.705826 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bd615-be93-4f9a-905f-a97fcb3273dd None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:51.706165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bd615-be93-4f9a-905f-a97fcb3273dd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:51.706442 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bd615-be93-4f9a-905f-a97fcb3273dd None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:51.707216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652bd615-be93-4f9a-905f-a97fcb3273dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:51.707529 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652bd615-be93-4f9a-905f-a97fcb3273dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:51.708962 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652bd615-be93-4f9a-905f-a97fcb3273dd None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:51.723936 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 414/848] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:51.732503 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a45a0-e527-430c-824d-7085a23d7ff7 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:51.846840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a45a0-e527-430c-824d-7085a23d7ff7 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:51.853625 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb46fc5-b8de-4e18-9b9d-8e60aecfc05d None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:51.853916 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb46fc5-b8de-4e18-9b9d-8e60aecfc05d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:51.854182 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb46fc5-b8de-4e18-9b9d-8e60aecfc05d None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:51.855812 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 415/849] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:51.861102 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10ab92-2c17-4cfc-bfc1-8a26fc19d4f8 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:51.861388 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10ab92-2c17-4cfc-bfc1-8a26fc19d4f8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:51.861668 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10ab92-2c17-4cfc-bfc1-8a26fc19d4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:51.865374 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:51.881055 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-aa10ab92-2c17-4cfc-bfc1-8a26fc19d4f8 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:51.882602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-aa10ab92-2c17-4cfc-bfc1-8a26fc19d4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:51.883058 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63ec08-fd64-4217-b795-2deb0f0d06a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:51.884430 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63ec08-fd64-4217-b795-2deb0f0d06a1 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:51.884736 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63ec08-fd64-4217-b795-2deb0f0d06a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:51.885009 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63ec08-fd64-4217-b795-2deb0f0d06a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:51.892446 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63ec08-fd64-4217-b795-2deb0f0d06a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:51.894025 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63ec08-fd64-4217-b795-2deb0f0d06a1 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:51.909537 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-4a63ec08-fd64-4217-b795-2deb0f0d06a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:51.909537 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:51.909537 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:51.909537 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:51.909537 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:51.909537 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:51.909537 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:51.909537 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:51.909537 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:51.909537 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:51.909537 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:51.909537 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:51.909537 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:43:51.909537 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:43:51.909537 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:43:51.910550 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:43:51.910550 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:51.910550 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:51.910550 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:51.910550 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:51.910550 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:51.910550 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:51.910550 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:51.910550 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:51.910550 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:51.910550 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:51.910550 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:51.910550 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:51.910550 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:51.910550 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:51.910550 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:51.910550 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:51.911505 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:43:51.911505 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:43:51.911505 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:43:51.911505 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:43:51.911505 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:43:51.911505 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:43:51.911505 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:51.911505 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:51.911505 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 435/850] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:51.916775 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63ec08-fd64-4217-b795-2deb0f0d06a1 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:51.980018 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 416/851] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:51 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:43:52.002253 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10ab92-2c17-4cfc-bfc1-8a26fc19d4f8 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:52.036613 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63ec08-fd64-4217-b795-2deb0f0d06a1 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:52.047890 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:52.078668 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57baced9-92b6-4e47-b17f-6bcc6035ad2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:52.079538 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57baced9-92b6-4e47-b17f-6bcc6035ad2d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:52.079940 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57baced9-92b6-4e47-b17f-6bcc6035ad2d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:52.080308 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57baced9-92b6-4e47-b17f-6bcc6035ad2d None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:52.081220 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57baced9-92b6-4e47-b17f-6bcc6035ad2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:52.081620 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57baced9-92b6-4e47-b17f-6bcc6035ad2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:52.083206 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57baced9-92b6-4e47-b17f-6bcc6035ad2d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:52.098657 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 436/852] 10.222.0.85 () {56 vars in 1148 bytes} [Thu Jun 16 14:43:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:52.105121 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57baced9-92b6-4e47-b17f-6bcc6035ad2d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:52.168394 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:52.221834 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57baced9-92b6-4e47-b17f-6bcc6035ad2d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:52.264870 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb516a-ae1d-4280-bf1b-4ebba7f596e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:52.266031 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb516a-ae1d-4280-bf1b-4ebba7f596e6 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:52.266506 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb516a-ae1d-4280-bf1b-4ebba7f596e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:52.266981 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb516a-ae1d-4280-bf1b-4ebba7f596e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:52.268290 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb516a-ae1d-4280-bf1b-4ebba7f596e6 None admin] RBAC: Adding query filter params (role.id=95dcfa6c726a4d01a41d2642554fd338, scope.project.id=80e309a3b3784ba9943734a41949b222, user.id=bf9c39de29324b0ca6329c9a171367c4) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:52.268907 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb516a-ae1d-4280-bf1b-4ebba7f596e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:52.270831 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb516a-ae1d-4280-bf1b-4ebba7f596e6 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:52.275594 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10ab92-2c17-4cfc-bfc1-8a26fc19d4f8 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:52.279523 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 437/853] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:52 2022] GET /identity/v3/role_assignments?user.id=bf9c39de29324b0ca6329c9a171367c4&scope.project.id=80e309a3b3784ba9943734a41949b222&role.id=95dcfa6c726a4d01a41d2642554fd338 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:52.316905 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb7479-3993-4162-99e7-1ffedf9f8f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:52.317757 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb7479-3993-4162-99e7-1ffedf9f8f8c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:52.318036 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb7479-3993-4162-99e7-1ffedf9f8f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:52.318304 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb7479-3993-4162-99e7-1ffedf9f8f8c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:52.318961 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb7479-3993-4162-99e7-1ffedf9f8f8c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:52.320568 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb7479-3993-4162-99e7-1ffedf9f8f8c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:52.332718 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b483c69-24a9-49b8-b3be-4233c423d394 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:52.333398 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b483c69-24a9-49b8-b3be-4233c423d394 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:52.333896 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b483c69-24a9-49b8-b3be-4233c423d394 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:52.334310 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-41cb7479-3993-4162-99e7-1ffedf9f8f8c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 14:43:52.334310 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:52.334310 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:43:52.334310 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:43:52.334310 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:43:52.334310 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:43:52.334310 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:43:52.334310 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:43:52.334310 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 14:43:52.334310 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:52.334310 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:43:52.334310 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:52.334310 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:52.334310 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:52.334310 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:52.334310 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:52.335292 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:52.335292 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:52.335292 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:52.335292 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:52.335292 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:52.335292 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:52.335292 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:52.335292 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:43:52.335292 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:43:52.335292 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:43:52.335292 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:43:52.335292 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:52.335292 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:52.335292 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:52.335292 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:52.335292 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:52.336170 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:52.336170 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:52.336170 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:52.336170 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:52.336170 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:52.336170 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:52.336170 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:52.336170 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:52.336170 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:52.336170 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:52.336170 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:52.336170 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:43:52.336170 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:43:52.336170 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 14:43:52.336170 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:52.339955 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 438/855] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:43:52.340124 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 417/855] 10.222.0.85 () {56 vars in 1132 bytes} [Thu Jun 16 14:43:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:52.343924 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb7479-3993-4162-99e7-1ffedf9f8f8c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:52.346374 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da273b-fc3e-43c7-b623-df63ce86e86f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:52.346912 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da273b-fc3e-43c7-b623-df63ce86e86f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:52.347606 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da273b-fc3e-43c7-b623-df63ce86e86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:52.372800 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-57da273b-fc3e-43c7-b623-df63ce86e86f None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:52.374753 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-57da273b-fc3e-43c7-b623-df63ce86e86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:52.480529 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 439/856] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:43:52.482734 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:52.485522 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb7479-3993-4162-99e7-1ffedf9f8f8c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:52.504995 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da273b-fc3e-43c7-b623-df63ce86e86f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:52.529707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9ff65-c4cb-4fb8-be8a-f022170a9160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:52.529954 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9ff65-c4cb-4fb8-be8a-f022170a9160 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:52.530189 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9ff65-c4cb-4fb8-be8a-f022170a9160 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:52.530422 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9ff65-c4cb-4fb8-be8a-f022170a9160 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:52.532737 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9ff65-c4cb-4fb8-be8a-f022170a9160 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:52.532737 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9ff65-c4cb-4fb8-be8a-f022170a9160 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:52.532931 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9ff65-c4cb-4fb8-be8a-f022170a9160 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:52.537299 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:52.539215 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 418/857] 10.222.0.85 () {56 vars in 1126 bytes} [Thu Jun 16 14:43:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:52.544263 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9ff65-c4cb-4fb8-be8a-f022170a9160 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:52.626853 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da273b-fc3e-43c7-b623-df63ce86e86f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:52.667138 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0442b7-2f39-46a1-b70d-6da7b2be31ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:52.668480 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0442b7-2f39-46a1-b70d-6da7b2be31ea None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:52.668983 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0442b7-2f39-46a1-b70d-6da7b2be31ea None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:52.669595 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0442b7-2f39-46a1-b70d-6da7b2be31ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:52.679184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9ff65-c4cb-4fb8-be8a-f022170a9160 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:52.682685 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0442b7-2f39-46a1-b70d-6da7b2be31ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:52.691090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-9d0442b7-2f39-46a1-b70d-6da7b2be31ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:52.691090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:52.691090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:52.691090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:52.691090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:52.691090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:52.691090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:52.691090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:52.691090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:52.691090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:52.691090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:52.691090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:52.691090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:52.691090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:52.691090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:52.691090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:52.692097 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:52.692097 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:52.692097 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:52.692097 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:52.692097 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:52.692097 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:52.692097 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:52.692097 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:52.692097 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:52.692097 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:52.692097 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:52.692097 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:52.692097 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:52.692097 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:52.692097 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:52.692097 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:52.692945 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:52.692945 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:52.692945 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:52.692945 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:52.692945 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:52.692945 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:52.692945 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:52.692945 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:52.692945 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:52.692945 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:52.692945 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:52.692945 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:52.696013 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 440/858] 10.222.0.85 () {56 vars in 1102 bytes} [Thu Jun 16 14:43:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:52.701944 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0442b7-2f39-46a1-b70d-6da7b2be31ea None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:52.718420 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b189f14-85a6-40e1-ab96-7d44a62b99ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:52.719688 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b189f14-85a6-40e1-ab96-7d44a62b99ac None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:52.720207 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b189f14-85a6-40e1-ab96-7d44a62b99ac None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:52.721037 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b189f14-85a6-40e1-ab96-7d44a62b99ac None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:52.722679 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b189f14-85a6-40e1-ab96-7d44a62b99ac None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:52.723333 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b189f14-85a6-40e1-ab96-7d44a62b99ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:52.725659 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b189f14-85a6-40e1-ab96-7d44a62b99ac None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:52.733377 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 419/859] 10.222.0.85 () {56 vars in 1126 bytes} [Thu Jun 16 14:43:52 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:52.808308 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:52.826965 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0442b7-2f39-46a1-b70d-6da7b2be31ea None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:52.865213 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bf775-5a47-4725-b553-0becb12eea70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:52.866252 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bf775-5a47-4725-b553-0becb12eea70 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:52.866537 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bf775-5a47-4725-b553-0becb12eea70 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:52.866813 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bf775-5a47-4725-b553-0becb12eea70 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:52.867585 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5bf775-5a47-4725-b553-0becb12eea70 None admin] RBAC: Adding query filter params (name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:52.868577 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5bf775-5a47-4725-b553-0becb12eea70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:52.869609 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5bf775-5a47-4725-b553-0becb12eea70 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:52.879567 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 441/860] 10.222.0.85 () {56 vars in 1103 bytes} [Thu Jun 16 14:43:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:52.889135 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b189f14-85a6-40e1-ab96-7d44a62b99ac None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:52.921643 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:52.998303 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b189f14-85a6-40e1-ab96-7d44a62b99ac None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:53.033817 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac6939-a746-4088-956e-965f00f7c835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:53.034627 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac6939-a746-4088-956e-965f00f7c835 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:53.034911 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac6939-a746-4088-956e-965f00f7c835 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:53.035187 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac6939-a746-4088-956e-965f00f7c835 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:53.046742 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac6939-a746-4088-956e-965f00f7c835 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:53.048247 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac6939-a746-4088-956e-965f00f7c835 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:53.066483 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-eaac6939-a746-4088-956e-965f00f7c835 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:53.066483 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:53.066483 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:53.066483 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:53.066483 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:53.066483 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:53.066483 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:53.066483 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:53.066483 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:53.066483 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:53.066483 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:53.066483 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:53.066483 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:53.066483 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:53.066483 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:53.067650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:53.067650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:53.067650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:53.067650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:53.067650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:53.067650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:53.067650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:53.067650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:53.067650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:53.067650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:53.067650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:53.067650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:53.067650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:53.067650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:53.067650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:53.067650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:53.067650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:53.068788 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:53.068788 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:53.068788 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:53.068788 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:53.068788 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 420/861] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:53.074101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bf775-5a47-4725-b553-0becb12eea70 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:53.181777 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bf775-5a47-4725-b553-0becb12eea70 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:53.217487 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794bf77-c3bf-43cc-9e90-3f106d15e8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:53.218217 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794bf77-c3bf-43cc-9e90-3f106d15e8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:53.218502 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794bf77-c3bf-43cc-9e90-3f106d15e8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:53.218831 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794bf77-c3bf-43cc-9e90-3f106d15e8a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:53.219565 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794bf77-c3bf-43cc-9e90-3f106d15e8a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:53.219888 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794bf77-c3bf-43cc-9e90-3f106d15e8a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:53.221281 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794bf77-c3bf-43cc-9e90-3f106d15e8a3 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:53.234732 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 442/862] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:53.239940 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac6939-a746-4088-956e-965f00f7c835 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:53.324681 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:53.345355 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac6939-a746-4088-956e-965f00f7c835 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:53.380307 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187375e-eb55-4038-9087-f23b4582424b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:53.381561 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187375e-eb55-4038-9087-f23b4582424b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:53.382058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187375e-eb55-4038-9087-f23b4582424b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:53.382540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187375e-eb55-4038-9087-f23b4582424b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:53.391360 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187375e-eb55-4038-9087-f23b4582424b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:53.393139 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187375e-eb55-4038-9087-f23b4582424b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:53.408449 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-1187375e-eb55-4038-9087-f23b4582424b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 14:43:53.408449 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:53.408449 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:53.408449 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:53.408449 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:53.408449 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:53.408449 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:53.408449 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:53.408449 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:53.408449 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:53.408449 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:53.408449 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:53.408449 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:43:53.408449 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:43:53.408449 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:43:53.408449 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:43:53.409460 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:53.409460 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:53.409460 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:43:53.409460 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:53.409460 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:43:53.409460 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:53.409460 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:53.409460 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:53.409460 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:53.409460 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:53.409460 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:53.409460 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:53.409460 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:53.409460 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:53.409460 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:53.409460 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:53.409460 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:53.409460 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:53.410412 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:53.410412 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:53.410412 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:43:53.410412 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:43:53.410412 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:43:53.410412 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:43:53.410412 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:43:53.410412 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:43:53.410412 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 14:43:53.410412 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:53.413129 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 421/863] 10.222.0.85 () {56 vars in 1117 bytes} [Thu Jun 16 14:43:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:53.422527 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794bf77-c3bf-43cc-9e90-3f106d15e8a3 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:53.431050 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:53.540366 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794bf77-c3bf-43cc-9e90-3f106d15e8a3 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:53.580585 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcff110-6005-4c03-ad9c-904ba576b9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:53.581184 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcff110-6005-4c03-ad9c-904ba576b9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:53.581469 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcff110-6005-4c03-ad9c-904ba576b9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:53.581743 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcff110-6005-4c03-ad9c-904ba576b9e5 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:53.582607 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcff110-6005-4c03-ad9c-904ba576b9e5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:53.582921 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcff110-6005-4c03-ad9c-904ba576b9e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:53.584421 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcff110-6005-4c03-ad9c-904ba576b9e5 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:53.602815 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b32da7-9be2-4426-a68b-9018b95c02e6 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:53.603397 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b32da7-9be2-4426-a68b-9018b95c02e6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:53.603913 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b32da7-9be2-4426-a68b-9018b95c02e6 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:53.605908 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 422/864] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:43:53.607185 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 443/865] 10.222.0.85 () {56 vars in 1149 bytes} [Thu Jun 16 14:43:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:53.613038 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94eaefd-c7f5-4664-99ef-25a5a80d6243 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:53.613328 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94eaefd-c7f5-4664-99ef-25a5a80d6243 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:53.613604 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94eaefd-c7f5-4664-99ef-25a5a80d6243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:53.616000 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcff110-6005-4c03-ad9c-904ba576b9e5 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:53.637303 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e94eaefd-c7f5-4664-99ef-25a5a80d6243 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:53.639031 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e94eaefd-c7f5-4664-99ef-25a5a80d6243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:53.711662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:53.736639 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 423/866] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:43:53.753205 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcff110-6005-4c03-ad9c-904ba576b9e5 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:53.760611 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94eaefd-c7f5-4664-99ef-25a5a80d6243 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:53.793427 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f843b5-7fde-4130-a2ec-34d997cc3a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:53.794087 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f843b5-7fde-4130-a2ec-34d997cc3a47 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:53.794368 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f843b5-7fde-4130-a2ec-34d997cc3a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:53.794647 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f843b5-7fde-4130-a2ec-34d997cc3a47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:53.853705 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:53.879155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f843b5-7fde-4130-a2ec-34d997cc3a47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:53.880981 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f843b5-7fde-4130-a2ec-34d997cc3a47 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:53.888662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94eaefd-c7f5-4664-99ef-25a5a80d6243 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:53.940703 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45a0d7-7438-4840-ac62-93290915fb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:53.941388 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45a0d7-7438-4840-ac62-93290915fb27 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:53.941668 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45a0d7-7438-4840-ac62-93290915fb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:53.941942 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45a0d7-7438-4840-ac62-93290915fb27 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:53.943208 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45a0d7-7438-4840-ac62-93290915fb27 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:53.944936 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45a0d7-7438-4840-ac62-93290915fb27 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:53.958373 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:53.967327 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 424/867] 10.222.0.85 () {60 vars in 1141 bytes} [Thu Jun 16 14:43:53 2022] POST /identity/v3/services => generated 251 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:43:54.003820 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 444/868] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:53 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:43:54.010551 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45a0d7-7438-4840-ac62-93290915fb27 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:54.135549 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45a0d7-7438-4840-ac62-93290915fb27 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:54.163378 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:54.176894 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3949037-2997-4811-8675-87097e31efdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:54.177707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3949037-2997-4811-8675-87097e31efdc None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:54.177989 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3949037-2997-4811-8675-87097e31efdc None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:54.178265 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3949037-2997-4811-8675-87097e31efdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:54.191233 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3949037-2997-4811-8675-87097e31efdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:54.193642 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3949037-2997-4811-8675-87097e31efdc None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:54.214010 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-e3949037-2997-4811-8675-87097e31efdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:54.214010 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:54.214010 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:54.214010 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:54.214010 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:54.214010 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:54.214010 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:54.214010 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:54.214010 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:54.214010 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:54.214010 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:54.214010 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:54.214010 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:54.214010 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:54.214010 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:54.214945 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:54.214945 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:54.214945 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:54.214945 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:54.214945 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:54.214945 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:54.214945 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:54.214945 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:54.214945 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:54.214945 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:54.214945 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:54.214945 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:54.214945 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:54.214945 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:54.214945 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:54.214945 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:54.214945 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:54.215835 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:54.215835 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:54.215835 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:54.215835 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:54.218117 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 425/869] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:54.223995 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f843b5-7fde-4130-a2ec-34d997cc3a47 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:54.340212 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f843b5-7fde-4130-a2ec-34d997cc3a47 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:54.376673 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74872e5e-33fd-4244-abd5-e97caf4e94bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:54.377393 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74872e5e-33fd-4244-abd5-e97caf4e94bb None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:54.377676 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74872e5e-33fd-4244-abd5-e97caf4e94bb None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:54.377950 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74872e5e-33fd-4244-abd5-e97caf4e94bb None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:54.378678 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74872e5e-33fd-4244-abd5-e97caf4e94bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:54.378984 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74872e5e-33fd-4244-abd5-e97caf4e94bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:54.380399 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74872e5e-33fd-4244-abd5-e97caf4e94bb None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:54.393095 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 445/870] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:54.398677 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3949037-2997-4811-8675-87097e31efdc None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:54.505758 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3949037-2997-4811-8675-87097e31efdc None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:54.543756 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84607f6-8ad4-4e72-8e4a-311852c87efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:54.544990 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84607f6-8ad4-4e72-8e4a-311852c87efe None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:54.545508 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84607f6-8ad4-4e72-8e4a-311852c87efe None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:54.545982 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84607f6-8ad4-4e72-8e4a-311852c87efe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:54.554022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84607f6-8ad4-4e72-8e4a-311852c87efe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:54.556140 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84607f6-8ad4-4e72-8e4a-311852c87efe None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:54.572099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-d84607f6-8ad4-4e72-8e4a-311852c87efe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:54.572099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:54.572099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:54.572099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:54.572099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:54.572099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:54.572099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:54.572099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:54.572099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:54.572099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:54.572099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:54.572099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:54.572099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:43:54.572099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:43:54.572099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:43:54.573075 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:43:54.573075 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:54.573075 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:54.573075 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:54.573075 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:54.573075 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:54.573075 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:54.573075 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:54.573075 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:54.573075 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:54.573075 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:54.573075 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:54.573075 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:54.573075 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:54.573075 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:54.573075 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:54.573075 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:54.573987 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:43:54.573987 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:43:54.573987 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:43:54.573987 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:43:54.573987 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:43:54.573987 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:43:54.573987 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:54.573987 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:54.573987 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 426/871] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:54.579435 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74872e5e-33fd-4244-abd5-e97caf4e94bb None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:54.610255 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:54.693434 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74872e5e-33fd-4244-abd5-e97caf4e94bb None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:54.730441 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8130b-bee4-44a8-b447-af389af3e14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:54.731480 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8130b-bee4-44a8-b447-af389af3e14f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:54.731764 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8130b-bee4-44a8-b447-af389af3e14f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:54.732076 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8130b-bee4-44a8-b447-af389af3e14f None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:54.732522 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d44b7f-793a-4f8a-a38d-4a8aa612da71 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:54.732807 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d44b7f-793a-4f8a-a38d-4a8aa612da71 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:54.732899 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8130b-bee4-44a8-b447-af389af3e14f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:54.733084 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d44b7f-793a-4f8a-a38d-4a8aa612da71 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:54.733178 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8130b-bee4-44a8-b447-af389af3e14f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:54.734607 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8130b-bee4-44a8-b447-af389af3e14f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:54.734716 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 427/872] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:54.741412 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0607b30-ca01-4bd0-a0a8-aeaac079de4d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:54.742031 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0607b30-ca01-4bd0-a0a8-aeaac079de4d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:54.742516 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0607b30-ca01-4bd0-a0a8-aeaac079de4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:54.751919 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 446/873] 10.222.0.85 () {56 vars in 1148 bytes} [Thu Jun 16 14:43:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:54.754190 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8130b-bee4-44a8-b447-af389af3e14f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:54.765824 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f0607b30-ca01-4bd0-a0a8-aeaac079de4d None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:54.766818 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f0607b30-ca01-4bd0-a0a8-aeaac079de4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:54.798555 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:54.851953 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 428/874] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:54 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:43:54.857752 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:54.871505 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8130b-bee4-44a8-b447-af389af3e14f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:54.874542 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0607b30-ca01-4bd0-a0a8-aeaac079de4d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:54.911081 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a06d95-62ec-4312-a6e3-739cecc9e65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:54.912143 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a06d95-62ec-4312-a6e3-739cecc9e65c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:54.912674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a06d95-62ec-4312-a6e3-739cecc9e65c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:54.913152 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a06d95-62ec-4312-a6e3-739cecc9e65c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:54.914187 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a06d95-62ec-4312-a6e3-739cecc9e65c None admin] RBAC: Adding query filter params (role.id=17fa92022f834aa5bf5cb9e3a506a478, scope.project.id=80e309a3b3784ba9943734a41949b222, user.id=db4d36e6837d4b2fa4b7ee5c7243b6b3) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:54.914845 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a06d95-62ec-4312-a6e3-739cecc9e65c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:54.917091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a06d95-62ec-4312-a6e3-739cecc9e65c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:54.932305 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 447/875] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:54 2022] GET /identity/v3/role_assignments?user.id=db4d36e6837d4b2fa4b7ee5c7243b6b3&scope.project.id=80e309a3b3784ba9943734a41949b222&role.id=17fa92022f834aa5bf5cb9e3a506a478 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:54.990951 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0607b30-ca01-4bd0-a0a8-aeaac079de4d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:55.031088 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b8251-bd87-4c9f-b1a5-2a1d3d936930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:55.032009 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b8251-bd87-4c9f-b1a5-2a1d3d936930 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:55.032294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b8251-bd87-4c9f-b1a5-2a1d3d936930 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:55.032567 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b8251-bd87-4c9f-b1a5-2a1d3d936930 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:55.033232 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b8251-bd87-4c9f-b1a5-2a1d3d936930 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:55.034636 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b8251-bd87-4c9f-b1a5-2a1d3d936930 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:55.049178 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-d93b8251-bd87-4c9f-b1a5-2a1d3d936930 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:43:55.049178 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:55.049178 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:43:55.049178 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:43:55.049178 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:43:55.049178 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:43:55.049178 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:43:55.049178 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:43:55.049178 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:43:55.049178 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:55.049178 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:43:55.049178 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:55.049178 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:55.049178 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:55.049178 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:55.049178 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:55.049178 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:55.050246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:55.050246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:55.050246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:55.050246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:55.050246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:55.050246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:55.050246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:43:55.050246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:43:55.050246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:43:55.050246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:43:55.050246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:55.050246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:55.050246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:55.050246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:55.050246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:55.050246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:55.051126 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:55.051126 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:55.051126 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:55.051126 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:55.051126 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:55.051126 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:55.051126 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:55.051126 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:55.051126 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:55.051126 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:55.051126 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:43:55.051126 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:43:55.051126 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:43:55.051126 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:55.051126 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 429/876] 10.222.0.85 () {56 vars in 1126 bytes} [Thu Jun 16 14:43:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:43:55.057979 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba1ba1-3eaa-4086-8fec-ba2a290d6def None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:55.058519 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba1ba1-3eaa-4086-8fec-ba2a290d6def None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:55.058961 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba1ba1-3eaa-4086-8fec-ba2a290d6def None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:55.060936 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 448/877] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:55.061059 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b8251-bd87-4c9f-b1a5-2a1d3d936930 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:55.066993 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897dadf0-3bf1-4285-b349-769d4229cefd None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:55.067577 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897dadf0-3bf1-4285-b349-769d4229cefd None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:55.068115 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897dadf0-3bf1-4285-b349-769d4229cefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:55.087910 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-897dadf0-3bf1-4285-b349-769d4229cefd None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:55.089607 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-897dadf0-3bf1-4285-b349-769d4229cefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:55.106942 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:55.181345 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 449/878] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:55 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:43:55.197933 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b8251-bd87-4c9f-b1a5-2a1d3d936930 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:55.206510 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897dadf0-3bf1-4285-b349-769d4229cefd None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:55.240255 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee6276-64fe-4a97-8aae-9953556a1f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:55.241345 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee6276-64fe-4a97-8aae-9953556a1f58 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:55.241982 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee6276-64fe-4a97-8aae-9953556a1f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:55.242458 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee6276-64fe-4a97-8aae-9953556a1f58 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:55.244234 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee6276-64fe-4a97-8aae-9953556a1f58 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:55.244756 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee6276-64fe-4a97-8aae-9953556a1f58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:55.246341 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee6276-64fe-4a97-8aae-9953556a1f58 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:55.251688 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 430/879] 10.222.0.85 () {56 vars in 1122 bytes} [Thu Jun 16 14:43:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:55.260671 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee6276-64fe-4a97-8aae-9953556a1f58 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:55.316393 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:55.342177 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897dadf0-3bf1-4285-b349-769d4229cefd None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:55.378437 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9f5a4-a669-4c5d-bf10-198296ea98b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:55.379473 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9f5a4-a669-4c5d-bf10-198296ea98b9 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:55.380099 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9f5a4-a669-4c5d-bf10-198296ea98b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:55.380689 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9f5a4-a669-4c5d-bf10-198296ea98b9 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:55.381614 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9f5a4-a669-4c5d-bf10-198296ea98b9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:55.383747 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:55.384082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9f5a4-a669-4c5d-bf10-198296ea98b9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:55.390232 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee6276-64fe-4a97-8aae-9953556a1f58 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:55.410535 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 450/880] 10.222.0.85 () {60 vars in 1141 bytes} [Thu Jun 16 14:43:55 2022] POST /identity/v3/services => generated 269 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:43:55.435185 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472bfd5-9894-4f66-8f12-f8eb28e55173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:55.435893 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472bfd5-9894-4f66-8f12-f8eb28e55173 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:55.436182 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472bfd5-9894-4f66-8f12-f8eb28e55173 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:55.436454 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472bfd5-9894-4f66-8f12-f8eb28e55173 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:55.437167 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472bfd5-9894-4f66-8f12-f8eb28e55173 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:55.437474 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472bfd5-9894-4f66-8f12-f8eb28e55173 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:55.438942 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472bfd5-9894-4f66-8f12-f8eb28e55173 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:55.452147 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 431/881] 10.222.0.85 () {56 vars in 1122 bytes} [Thu Jun 16 14:43:55 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:56.229695 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611ad62-3fb6-438c-a9e0-e7e40d3bcb79 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:56.230120 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611ad62-3fb6-438c-a9e0-e7e40d3bcb79 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:56.230298 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611ad62-3fb6-438c-a9e0-e7e40d3bcb79 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:56.231910 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 451/882] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:56.237449 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640677e-b9e9-48e1-ba3e-758dba38ff85 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:56.238384 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640677e-b9e9-48e1-ba3e-758dba38ff85 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:56.238927 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640677e-b9e9-48e1-ba3e-758dba38ff85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:56.257560 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4640677e-b9e9-48e1-ba3e-758dba38ff85 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:56.259827 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4640677e-b9e9-48e1-ba3e-758dba38ff85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:56.331700 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 432/883] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:43:56.355598 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611ad62-3fb6-438c-a9e0-e7e40d3bcb79 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:56.464316 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611ad62-3fb6-438c-a9e0-e7e40d3bcb79 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:56.502836 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba4041-69c6-4e91-befd-0aa125be3d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:56.504047 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba4041-69c6-4e91-befd-0aa125be3d91 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:56.504522 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba4041-69c6-4e91-befd-0aa125be3d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:56.504984 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba4041-69c6-4e91-befd-0aa125be3d91 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:56.505886 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba4041-69c6-4e91-befd-0aa125be3d91 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:56.507450 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba4041-69c6-4e91-befd-0aa125be3d91 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:56.522682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-aeba4041-69c6-4e91-befd-0aa125be3d91 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 14:43:56.522682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:56.522682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:43:56.522682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:43:56.522682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:43:56.522682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:43:56.522682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:43:56.522682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:43:56.522682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 14:43:56.522682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:56.522682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:43:56.522682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:56.522682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:56.522682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:56.522682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:56.522682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:56.522682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:56.523890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:56.523890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:56.523890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:56.523890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:56.523890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:56.523890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:56.523890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:43:56.523890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:43:56.523890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:43:56.523890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:43:56.523890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:56.523890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:56.523890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:56.523890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:56.523890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:56.523890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:56.525552 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:56.525552 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:56.525552 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:56.525552 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:56.525552 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:56.525552 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:56.525552 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:56.525552 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:56.525552 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:56.525552 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:56.525552 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:43:56.525552 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:43:56.525552 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 14:43:56.525552 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:56.528479 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 452/884] 10.222.0.85 () {56 vars in 1114 bytes} [Thu Jun 16 14:43:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:56.534550 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640677e-b9e9-48e1-ba3e-758dba38ff85 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:56.641278 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:56.658385 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640677e-b9e9-48e1-ba3e-758dba38ff85 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:56.694827 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d86377-8a87-4106-974d-f8717a34d1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:56.695501 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d86377-8a87-4106-974d-f8717a34d1f6 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:56.695804 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d86377-8a87-4106-974d-f8717a34d1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:56.696328 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d86377-8a87-4106-974d-f8717a34d1f6 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:56.697141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d86377-8a87-4106-974d-f8717a34d1f6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:56.697452 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d86377-8a87-4106-974d-f8717a34d1f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:56.698888 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d86377-8a87-4106-974d-f8717a34d1f6 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:56.704417 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 433/885] 10.222.0.85 () {56 vars in 1114 bytes} [Thu Jun 16 14:43:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:56.709697 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba4041-69c6-4e91-befd-0aa125be3d91 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:56.714525 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:56.824144 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba4041-69c6-4e91-befd-0aa125be3d91 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:56.860448 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46144df8-777d-44cf-aa1e-c932e67e8117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:56.861452 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46144df8-777d-44cf-aa1e-c932e67e8117 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:56.861925 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46144df8-777d-44cf-aa1e-c932e67e8117 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:56.862404 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46144df8-777d-44cf-aa1e-c932e67e8117 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:56.863293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46144df8-777d-44cf-aa1e-c932e67e8117 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:56.863813 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46144df8-777d-44cf-aa1e-c932e67e8117 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:56.865407 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46144df8-777d-44cf-aa1e-c932e67e8117 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:56.871804 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 453/886] 10.222.0.85 () {56 vars in 1114 bytes} [Thu Jun 16 14:43:56 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:56.878020 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d86377-8a87-4106-974d-f8717a34d1f6 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:56.981687 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d86377-8a87-4106-974d-f8717a34d1f6 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:57.016988 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cba016-39e0-48ca-bbf2-a379bbd3e1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:57.017687 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cba016-39e0-48ca-bbf2-a379bbd3e1e2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:57.017970 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cba016-39e0-48ca-bbf2-a379bbd3e1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:57.018249 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cba016-39e0-48ca-bbf2-a379bbd3e1e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:57.019050 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cba016-39e0-48ca-bbf2-a379bbd3e1e2 None admin] RBAC: Adding query filter params (interface=public, service_id=b88ee6add86345b38addc3a1a551a5ca, region_id=RegionOne) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:57.019365 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cba016-39e0-48ca-bbf2-a379bbd3e1e2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:57.027934 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cba016-39e0-48ca-bbf2-a379bbd3e1e2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:57.033226 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 434/887] 10.222.0.85 () {56 vars in 1251 bytes} [Thu Jun 16 14:43:56 2022] GET /identity/v3/endpoints?service_id=b88ee6add86345b38addc3a1a551a5ca&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:57.038986 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46144df8-777d-44cf-aa1e-c932e67e8117 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:57.116407 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:57.155948 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46144df8-777d-44cf-aa1e-c932e67e8117 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:57.202071 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9b1ee-8c6f-4773-b649-362ac0adc0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:57.202743 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9b1ee-8c6f-4773-b649-362ac0adc0bf None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:57.203028 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9b1ee-8c6f-4773-b649-362ac0adc0bf None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:57.203297 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9b1ee-8c6f-4773-b649-362ac0adc0bf None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:57.204008 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d9b1ee-8c6f-4773-b649-362ac0adc0bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:57.205385 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d9b1ee-8c6f-4773-b649-362ac0adc0bf None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:57.212747 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 454/888] 10.222.0.85 () {56 vars in 1087 bytes} [Thu Jun 16 14:43:57 2022] GET /identity/v3/services => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:43:57.235202 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7de3e-0708-4ac9-81ed-d472f59f773a None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:57.235481 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7de3e-0708-4ac9-81ed-d472f59f773a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:57.236070 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7de3e-0708-4ac9-81ed-d472f59f773a None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:57.238066 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 435/889] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:57.245459 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af341ec-c689-443e-b4af-07d28b73cc91 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:57.245751 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af341ec-c689-443e-b4af-07d28b73cc91 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:57.246191 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af341ec-c689-443e-b4af-07d28b73cc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:57.269572 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-2af341ec-c689-443e-b4af-07d28b73cc91 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:57.271079 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2af341ec-c689-443e-b4af-07d28b73cc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:57.353568 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 455/890] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:57 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:43:57.376519 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a7de3e-0708-4ac9-81ed-d472f59f773a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:57.395792 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:57.516240 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a7de3e-0708-4ac9-81ed-d472f59f773a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:57.561273 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb73ee5-31b5-4fca-8fcb-7649fb9a27e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:57.562112 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb73ee5-31b5-4fca-8fcb-7649fb9a27e5 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:57.562386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb73ee5-31b5-4fca-8fcb-7649fb9a27e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:57.562657 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb73ee5-31b5-4fca-8fcb-7649fb9a27e5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:57.575418 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb73ee5-31b5-4fca-8fcb-7649fb9a27e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:57.584190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-5fb73ee5-31b5-4fca-8fcb-7649fb9a27e5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 14:43:57.584190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:57.584190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:57.584190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:57.584190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:57.584190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:57.584190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:57.584190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:57.584190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:57.584190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:57.584190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:57.584190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:57.584190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:57.584190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:57.584190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:57.584190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:57.585143 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:57.585143 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:57.585143 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:57.585143 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:57.585143 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:57.585143 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:57.585143 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:57.585143 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:57.585143 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:57.585143 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:57.585143 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:57.585143 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:57.585143 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:57.585143 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:57.585143 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:57.585143 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:57.586008 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:57.586008 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:57.586008 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:57.586008 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:57.586008 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:57.586008 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:57.586008 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:57.586008 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:57.586008 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:57.586008 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:57.586008 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 14:43:57.586008 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:57.586008 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 436/891] 10.222.0.85 () {56 vars in 1120 bytes} [Thu Jun 16 14:43:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:57.593840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af341ec-c689-443e-b4af-07d28b73cc91 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:57.678637 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae867b-9951-4612-84f4-649a6f43a0b7 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:57.678986 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae867b-9951-4612-84f4-649a6f43a0b7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:57.679791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae867b-9951-4612-84f4-649a6f43a0b7 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:57.683318 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 437/892] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:57.692719 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ec293-0d32-452e-ad2f-7e2c628a0d3e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:57.693717 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ec293-0d32-452e-ad2f-7e2c628a0d3e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:57.694469 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ec293-0d32-452e-ad2f-7e2c628a0d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:57.699090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:57.726463 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5e7ec293-0d32-452e-ad2f-7e2c628a0d3e None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:57.729064 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5e7ec293-0d32-452e-ad2f-7e2c628a0d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:57.745393 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af341ec-c689-443e-b4af-07d28b73cc91 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:57.791421 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91adbdec-addd-4aec-a94f-1c604c902fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:57.792660 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91adbdec-addd-4aec-a94f-1c604c902fee None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:57.793201 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91adbdec-addd-4aec-a94f-1c604c902fee None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:57.793706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91adbdec-addd-4aec-a94f-1c604c902fee None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:57.794721 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91adbdec-addd-4aec-a94f-1c604c902fee None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:57.795232 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91adbdec-addd-4aec-a94f-1c604c902fee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:57.797250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91adbdec-addd-4aec-a94f-1c604c902fee None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:57.811721 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 456/893] 10.222.0.85 () {56 vars in 1115 bytes} [Thu Jun 16 14:43:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:57.813748 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc9e95-8ab6-43e7-b9f4-5cc910cb8681 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:57.814113 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc9e95-8ab6-43e7-b9f4-5cc910cb8681 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:57.814406 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc9e95-8ab6-43e7-b9f4-5cc910cb8681 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:57.820685 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 457/894] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:57.822182 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc9e95-8ab6-43e7-b9f4-5cc910cb8681 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:57.831919 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 438/895] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:57 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:43:57.831919 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27d8cd-5f01-4f8f-8061-f4c5547c0480 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:57.831919 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27d8cd-5f01-4f8f-8061-f4c5547c0480 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:57.831919 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27d8cd-5f01-4f8f-8061-f4c5547c0480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:57.840400 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:57.857336 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-af27d8cd-5f01-4f8f-8061-f4c5547c0480 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:57.859186 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-af27d8cd-5f01-4f8f-8061-f4c5547c0480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:57.941657 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 439/896] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:57 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:43:57.942442 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27d8cd-5f01-4f8f-8061-f4c5547c0480 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:57.985047 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc9e95-8ab6-43e7-b9f4-5cc910cb8681 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:58.024257 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:58.037544 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca8941-e6fd-470d-86cd-1c4d4849057f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:58.038945 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca8941-e6fd-470d-86cd-1c4d4849057f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:58.039431 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca8941-e6fd-470d-86cd-1c4d4849057f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:58.040312 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca8941-e6fd-470d-86cd-1c4d4849057f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:58.058032 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca8941-e6fd-470d-86cd-1c4d4849057f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:58.059615 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca8941-e6fd-470d-86cd-1c4d4849057f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:58.078761 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-10ca8941-e6fd-470d-86cd-1c4d4849057f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:58.078761 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:58.078761 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:58.078761 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:58.078761 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:58.078761 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:58.078761 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:58.078761 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:58.078761 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:58.078761 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:58.078761 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:58.078761 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:58.078761 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:58.078761 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:58.078761 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:58.079731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:58.079731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:58.079731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:58.079731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:58.079731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:58.079731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:58.079731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:58.079731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:58.079731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:58.079731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:58.079731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:58.079731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:58.079731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:58.079731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:58.079731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:58.079731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:58.079731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:58.085787 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:58.085787 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:58.085787 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:58.085787 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:58.085787 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 458/897] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:58.085787 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca8941-e6fd-470d-86cd-1c4d4849057f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:58.094099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27d8cd-5f01-4f8f-8061-f4c5547c0480 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:58.132975 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7450e-e5c0-4987-aaf4-98ed0d5b91cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:58.134325 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7450e-e5c0-4987-aaf4-98ed0d5b91cd None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:58.134770 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7450e-e5c0-4987-aaf4-98ed0d5b91cd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:58.135201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7450e-e5c0-4987-aaf4-98ed0d5b91cd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:58.136038 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d7450e-e5c0-4987-aaf4-98ed0d5b91cd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:58.137728 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d7450e-e5c0-4987-aaf4-98ed0d5b91cd None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:58.140100 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:58.153480 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-07d7450e-e5c0-4987-aaf4-98ed0d5b91cd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 14:43:58.153480 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:58.153480 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:43:58.153480 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:43:58.153480 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:43:58.153480 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:43:58.153480 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:43:58.153480 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:43:58.153480 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 14:43:58.153480 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:58.153480 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:43:58.153480 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:58.153480 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:58.153480 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:58.153480 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:58.153480 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:58.154650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:58.154650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:58.154650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:58.154650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:58.154650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:58.154650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:58.154650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:58.154650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:43:58.154650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:43:58.154650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:43:58.154650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:43:58.154650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:58.154650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:58.154650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:58.154650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:58.154650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:58.155669 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:58.155669 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:58.155669 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:58.155669 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:58.155669 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:58.155669 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:58.155669 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:58.155669 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:58.155669 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:58.155669 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:58.155669 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:58.155669 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:43:58.155669 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:43:58.155669 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 14:43:58.155669 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:58.158305 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 440/898] 10.222.0.85 () {56 vars in 1132 bytes} [Thu Jun 16 14:43:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:58.159286 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7450e-e5c0-4987-aaf4-98ed0d5b91cd None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:58.229426 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca8941-e6fd-470d-86cd-1c4d4849057f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:58.268410 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e689e5-447e-42fd-b105-793515a302d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:58.269076 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e689e5-447e-42fd-b105-793515a302d9 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:58.269355 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e689e5-447e-42fd-b105-793515a302d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:58.269629 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e689e5-447e-42fd-b105-793515a302d9 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:58.270358 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e689e5-447e-42fd-b105-793515a302d9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:58.271747 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e689e5-447e-42fd-b105-793515a302d9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:58.287675 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7450e-e5c0-4987-aaf4-98ed0d5b91cd None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:58.298970 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 459/899] 10.222.0.85 () {60 vars in 1141 bytes} [Thu Jun 16 14:43:58 2022] POST /identity/v3/services => generated 241 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:43:58.300485 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e689e5-447e-42fd-b105-793515a302d9 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:58.356576 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35835d4a-6cc3-4ad2-9c1d-e97d232b41d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:58.357584 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35835d4a-6cc3-4ad2-9c1d-e97d232b41d5 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:58.358041 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35835d4a-6cc3-4ad2-9c1d-e97d232b41d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:58.358509 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35835d4a-6cc3-4ad2-9c1d-e97d232b41d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:58.359420 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35835d4a-6cc3-4ad2-9c1d-e97d232b41d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:58.359893 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35835d4a-6cc3-4ad2-9c1d-e97d232b41d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:58.361479 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35835d4a-6cc3-4ad2-9c1d-e97d232b41d5 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:58.365027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:58.383676 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 441/900] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:58.385755 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35835d4a-6cc3-4ad2-9c1d-e97d232b41d5 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:58.466859 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:58.492998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e689e5-447e-42fd-b105-793515a302d9 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:58.529042 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35835d4a-6cc3-4ad2-9c1d-e97d232b41d5 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:58.539920 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dff999-c1ff-4570-bb17-15df4dd619f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:58.540611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dff999-c1ff-4570-bb17-15df4dd619f8 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:58.540887 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dff999-c1ff-4570-bb17-15df4dd619f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:58.541562 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dff999-c1ff-4570-bb17-15df4dd619f8 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:58.542288 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dff999-c1ff-4570-bb17-15df4dd619f8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:58.542961 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dff999-c1ff-4570-bb17-15df4dd619f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:58.545455 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dff999-c1ff-4570-bb17-15df4dd619f8 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:58.551910 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 460/901] 10.222.0.85 () {56 vars in 1126 bytes} [Thu Jun 16 14:43:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:58.559989 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dff999-c1ff-4570-bb17-15df4dd619f8 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:58.583646 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432b650-191a-442c-8391-81a8e7a8cbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:58.584983 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432b650-191a-442c-8391-81a8e7a8cbf3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:58.585484 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432b650-191a-442c-8391-81a8e7a8cbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:58.586458 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432b650-191a-442c-8391-81a8e7a8cbf3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:58.597381 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432b650-191a-442c-8391-81a8e7a8cbf3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:58.599353 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432b650-191a-442c-8391-81a8e7a8cbf3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:58.623652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-5432b650-191a-442c-8391-81a8e7a8cbf3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 14:43:58.623652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:58.623652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:58.623652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:58.623652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:58.623652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:58.623652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:58.623652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:58.623652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:58.623652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:58.623652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:58.623652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:58.623652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:43:58.623652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:43:58.623652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:43:58.623652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:43:58.624831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:58.624831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:58.624831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:43:58.624831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:58.624831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:43:58.624831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:58.624831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:58.624831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:58.624831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:58.624831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:58.624831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:58.624831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:58.624831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:58.624831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:58.624831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:58.624831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:58.624831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:58.624831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:58.625825 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:58.625825 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:58.625825 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:43:58.625825 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:43:58.625825 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:43:58.625825 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:43:58.625825 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:43:58.625825 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:43:58.625825 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 14:43:58.625825 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:58.628597 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 442/902] 10.222.0.85 () {56 vars in 1117 bytes} [Thu Jun 16 14:43:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:43:58.634438 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432b650-191a-442c-8391-81a8e7a8cbf3 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:58.682036 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:58.685790 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dff999-c1ff-4570-bb17-15df4dd619f8 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:58.724734 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5ea3c-64f0-4044-90df-97272dfd7ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:58.725676 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5ea3c-64f0-4044-90df-97272dfd7ccf None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:58.726020 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5ea3c-64f0-4044-90df-97272dfd7ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:58.726387 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5ea3c-64f0-4044-90df-97272dfd7ccf None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:58.727312 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c5ea3c-64f0-4044-90df-97272dfd7ccf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:58.727778 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c5ea3c-64f0-4044-90df-97272dfd7ccf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:58.729333 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c5ea3c-64f0-4044-90df-97272dfd7ccf None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:58.739971 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 461/903] 10.222.0.85 () {56 vars in 1126 bytes} [Thu Jun 16 14:43:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:58.741776 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5ea3c-64f0-4044-90df-97272dfd7ccf None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:58.767848 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432b650-191a-442c-8391-81a8e7a8cbf3 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:58.784781 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:58.810389 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e7af6-be96-4a3d-ba5d-b07bbbd8f301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:58.811361 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e7af6-be96-4a3d-ba5d-b07bbbd8f301 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:58.811792 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e7af6-be96-4a3d-ba5d-b07bbbd8f301 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:58.812280 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e7af6-be96-4a3d-ba5d-b07bbbd8f301 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:58.813312 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e7af6-be96-4a3d-ba5d-b07bbbd8f301 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:58.813758 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e7af6-be96-4a3d-ba5d-b07bbbd8f301 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:58.815336 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e7af6-be96-4a3d-ba5d-b07bbbd8f301 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:58.840019 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 443/904] 10.222.0.85 () {56 vars in 1149 bytes} [Thu Jun 16 14:43:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:58.845812 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e7af6-be96-4a3d-ba5d-b07bbbd8f301 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:58.894910 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5ea3c-64f0-4044-90df-97272dfd7ccf None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:58.938059 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2776a1-3461-41ae-98dc-9d71ffecd2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:58.938737 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2776a1-3461-41ae-98dc-9d71ffecd2fa None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:58.939062 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2776a1-3461-41ae-98dc-9d71ffecd2fa None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:58.939338 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2776a1-3461-41ae-98dc-9d71ffecd2fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:58.940456 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2776a1-3461-41ae-98dc-9d71ffecd2fa None admin] RBAC: Adding query filter params (interface=public, service_id=c069a501f6154ac2a25c4705f49b2ca9, region_id=RegionOne) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:58.940766 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2776a1-3461-41ae-98dc-9d71ffecd2fa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:58.942326 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2776a1-3461-41ae-98dc-9d71ffecd2fa None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:58.957786 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 462/905] 10.222.0.85 () {56 vars in 1251 bytes} [Thu Jun 16 14:43:58 2022] GET /identity/v3/endpoints?service_id=c069a501f6154ac2a25c4705f49b2ca9&interface=public®ion_id=RegionOne => generated 194 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:58.960112 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2776a1-3461-41ae-98dc-9d71ffecd2fa None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:58.982911 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e7af6-be96-4a3d-ba5d-b07bbbd8f301 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:58.992654 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:59.023608 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4211027-f117-40c9-affd-62a118165d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:59.024453 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4211027-f117-40c9-affd-62a118165d12 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:59.024939 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4211027-f117-40c9-affd-62a118165d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:59.025306 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4211027-f117-40c9-affd-62a118165d12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:59.075299 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2776a1-3461-41ae-98dc-9d71ffecd2fa None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:59.077977 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:59.109702 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4211027-f117-40c9-affd-62a118165d12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:59.111429 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4211027-f117-40c9-affd-62a118165d12 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:59.115647 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2da445-9a02-45d2-b66b-7c16e5495d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:59.116680 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2da445-9a02-45d2-b66b-7c16e5495d0c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:59.117169 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2da445-9a02-45d2-b66b-7c16e5495d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:59.117660 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2da445-9a02-45d2-b66b-7c16e5495d0c None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:59.118683 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2da445-9a02-45d2-b66b-7c16e5495d0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:59.121261 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2da445-9a02-45d2-b66b-7c16e5495d0c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:59.136045 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 463/906] 10.222.0.85 () {56 vars in 1087 bytes} [Thu Jun 16 14:43:58 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:43:59.226532 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 444/907] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:58 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 14:43:59.232677 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2da445-9a02-45d2-b66b-7c16e5495d0c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:59.333715 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:59.342798 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2da445-9a02-45d2-b66b-7c16e5495d0c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:59.377028 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879b6b0-3778-4782-8f40-aed9a6ab5e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:59.377834 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879b6b0-3778-4782-8f40-aed9a6ab5e00 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:59.378116 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879b6b0-3778-4782-8f40-aed9a6ab5e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:59.378381 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879b6b0-3778-4782-8f40-aed9a6ab5e00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:59.389404 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2879b6b0-3778-4782-8f40-aed9a6ab5e00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:59.390860 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2879b6b0-3778-4782-8f40-aed9a6ab5e00 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:59.407714 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-2879b6b0-3778-4782-8f40-aed9a6ab5e00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:59.407714 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:59.407714 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:59.407714 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:59.407714 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:59.407714 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:59.407714 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:59.407714 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:59.407714 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:59.407714 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:59.407714 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:59.407714 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:59.407714 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:59.407714 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:59.407714 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:59.408654 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:59.408654 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:59.408654 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:59.408654 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:59.408654 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:59.408654 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:59.408654 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:59.408654 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:59.408654 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:59.408654 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:59.408654 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:59.408654 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:59.408654 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:59.408654 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:59.408654 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:59.408654 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:59.408654 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:59.409597 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:59.409597 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:59.409597 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:59.409597 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:59.413632 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 464/908] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:59.415229 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4211027-f117-40c9-affd-62a118165d12 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:59.505319 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:59.515536 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fa01d-db95-44c0-a22f-526351cedd3d None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:59.515792 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fa01d-db95-44c0-a22f-526351cedd3d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:59.516128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fa01d-db95-44c0-a22f-526351cedd3d None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:59.518162 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 465/909] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:43:59.526099 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74743a2-9fe0-44dc-8a5a-c8ee91fe2b03 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:59.526417 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74743a2-9fe0-44dc-8a5a-c8ee91fe2b03 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:59.526658 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74743a2-9fe0-44dc-8a5a-c8ee91fe2b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:59.546897 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b74743a2-9fe0-44dc-8a5a-c8ee91fe2b03 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:59.548021 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4211027-f117-40c9-affd-62a118165d12 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:59.548158 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b74743a2-9fe0-44dc-8a5a-c8ee91fe2b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:59.593177 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6b665-1989-48b2-9f0f-14dab2fe8ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:59.594370 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6b665-1989-48b2-9f0f-14dab2fe8ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:59.595011 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6b665-1989-48b2-9f0f-14dab2fe8ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:59.595377 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6b665-1989-48b2-9f0f-14dab2fe8ae8 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:59.596274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6b665-1989-48b2-9f0f-14dab2fe8ae8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:59.596675 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6b665-1989-48b2-9f0f-14dab2fe8ae8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:59.598201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6b665-1989-48b2-9f0f-14dab2fe8ae8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:59.614729 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 445/910] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:59.621638 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6b665-1989-48b2-9f0f-14dab2fe8ae8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:59.652020 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 466/911] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:43:59.667899 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74743a2-9fe0-44dc-8a5a-c8ee91fe2b03 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:59.744183 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6b665-1989-48b2-9f0f-14dab2fe8ae8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:59.772732 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:59.775147 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:59.780913 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1055a65-dea9-42e4-aa05-50f1099a703e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:59.782099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1055a65-dea9-42e4-aa05-50f1099a703e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:59.782582 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1055a65-dea9-42e4-aa05-50f1099a703e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:59.783150 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1055a65-dea9-42e4-aa05-50f1099a703e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:59.790791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1055a65-dea9-42e4-aa05-50f1099a703e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:59.792456 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1055a65-dea9-42e4-aa05-50f1099a703e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:59.806526 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74743a2-9fe0-44dc-8a5a-c8ee91fe2b03 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:59.807864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-f1055a65-dea9-42e4-aa05-50f1099a703e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:59.807864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:59.807864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:59.807864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:59.807864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:59.807864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:59.807864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:59.807864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:59.807864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:59.807864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:59.807864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:59.807864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:59.807864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:43:59.807864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:43:59.807864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:43:59.809059 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:43:59.809059 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:59.809059 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:59.809059 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:59.809059 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:59.809059 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:59.809059 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:59.809059 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:59.809059 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:59.809059 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:59.809059 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:59.809059 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:59.809059 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:59.809059 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:59.809059 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:59.809059 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:59.809059 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:59.809991 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:43:59.809991 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:43:59.809991 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:43:59.809991 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:43:59.809991 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:43:59.809991 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:43:59.809991 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:59.809991 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:43:59.810835 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 446/912] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:59.816017 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1055a65-dea9-42e4-aa05-50f1099a703e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:59.859541 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccd344-1672-44c0-b974-c8c0daa78d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:59.861114 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccd344-1672-44c0-b974-c8c0daa78d52 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:59.861969 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccd344-1672-44c0-b974-c8c0daa78d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:59.862565 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccd344-1672-44c0-b974-c8c0daa78d52 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:59.863495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ccd344-1672-44c0-b974-c8c0daa78d52 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:59.865774 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ccd344-1672-44c0-b974-c8c0daa78d52 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:59.882370 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-22ccd344-1672-44c0-b974-c8c0daa78d52 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 14:43:59.882370 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:59.882370 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:43:59.882370 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:43:59.882370 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:43:59.882370 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:43:59.882370 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:43:59.882370 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:43:59.882370 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 14:43:59.882370 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:59.882370 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:43:59.882370 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:59.882370 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:59.882370 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:59.882370 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:59.882370 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:59.882370 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:59.883419 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:59.883419 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:59.883419 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:59.883419 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:59.883419 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:59.883419 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:59.883419 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:43:59.883419 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:43:59.883419 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:43:59.883419 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:43:59.883419 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:59.883419 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:59.883419 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:59.883419 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:59.883419 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:59.883419 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:59.884304 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:59.884304 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:59.884304 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:59.884304 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:59.884304 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:59.884304 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:59.884304 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:59.884304 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:59.884304 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:59.884304 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:59.884304 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:43:59.884304 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:43:59.884304 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 14:43:59.884304 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:43:59.885680 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 467/913] 10.222.0.85 () {56 vars in 1114 bytes} [Thu Jun 16 14:43:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:59.891018 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccd344-1672-44c0-b974-c8c0daa78d52 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:59.936893 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1055a65-dea9-42e4-aa05-50f1099a703e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:59.974309 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fe086-785f-48bb-aa9f-c84ca913354d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:59.975016 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fe086-785f-48bb-aa9f-c84ca913354d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:59.975297 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fe086-785f-48bb-aa9f-c84ca913354d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:59.975572 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fe086-785f-48bb-aa9f-c84ca913354d None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:59.976512 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fe086-785f-48bb-aa9f-c84ca913354d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:59.976825 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fe086-785f-48bb-aa9f-c84ca913354d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:59.978420 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fe086-785f-48bb-aa9f-c84ca913354d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:59.995998 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 447/914] 10.222.0.85 () {56 vars in 1148 bytes} [Thu Jun 16 14:43:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:59.998771 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fe086-785f-48bb-aa9f-c84ca913354d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:00.009657 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccd344-1672-44c0-b974-c8c0daa78d52 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:00.056272 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4cbf8-f8bf-484a-ae67-651f9976df3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:00.057659 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4cbf8-f8bf-484a-ae67-651f9976df3c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:00.058149 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4cbf8-f8bf-484a-ae67-651f9976df3c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:00.058654 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4cbf8-f8bf-484a-ae67-651f9976df3c None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:00.059603 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4cbf8-f8bf-484a-ae67-651f9976df3c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:00.060143 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4cbf8-f8bf-484a-ae67-651f9976df3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:00.060261 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:00.062490 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4cbf8-f8bf-484a-ae67-651f9976df3c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:00.074139 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 468/915] 10.222.0.85 () {56 vars in 1114 bytes} [Thu Jun 16 14:43:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:00.075093 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4cbf8-f8bf-484a-ae67-651f9976df3c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:00.080006 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:00.129711 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fe086-785f-48bb-aa9f-c84ca913354d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:00.167816 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe781f9e-dc81-41ab-8d64-1dd0ad558dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:00.168879 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe781f9e-dc81-41ab-8d64-1dd0ad558dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:00.169482 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe781f9e-dc81-41ab-8d64-1dd0ad558dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:00.169940 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe781f9e-dc81-41ab-8d64-1dd0ad558dc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:00.170945 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe781f9e-dc81-41ab-8d64-1dd0ad558dc2 None admin] RBAC: Adding query filter params (role.id=12e6cac1ace0476da69b56800ec15fbc, scope.project.id=80e309a3b3784ba9943734a41949b222, user.id=db4d36e6837d4b2fa4b7ee5c7243b6b3) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:00.171784 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe781f9e-dc81-41ab-8d64-1dd0ad558dc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:00.173436 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe781f9e-dc81-41ab-8d64-1dd0ad558dc2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:00.180387 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 448/916] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:59 2022] GET /identity/v3/role_assignments?user.id=db4d36e6837d4b2fa4b7ee5c7243b6b3&scope.project.id=80e309a3b3784ba9943734a41949b222&role.id=12e6cac1ace0476da69b56800ec15fbc => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:00.210089 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4cbf8-f8bf-484a-ae67-651f9976df3c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:00.248545 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53b02a-62cd-4b76-b866-641de3153ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:00.249613 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53b02a-62cd-4b76-b866-641de3153ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:00.250109 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53b02a-62cd-4b76-b866-641de3153ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:00.250566 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53b02a-62cd-4b76-b866-641de3153ca6 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:00.251477 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53b02a-62cd-4b76-b866-641de3153ca6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:00.251997 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53b02a-62cd-4b76-b866-641de3153ca6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:00.253630 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53b02a-62cd-4b76-b866-641de3153ca6 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:00.260457 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 469/917] 10.222.0.85 () {56 vars in 1114 bytes} [Thu Jun 16 14:44:00 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:00.272025 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe781f9e-dc81-41ab-8d64-1dd0ad558dc2 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:00.384581 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe781f9e-dc81-41ab-8d64-1dd0ad558dc2 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:00.404336 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:00.428942 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa88241-0f20-4fdc-af3e-128bd92ccf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:00.429748 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa88241-0f20-4fdc-af3e-128bd92ccf0e None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:00.429883 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa88241-0f20-4fdc-af3e-128bd92ccf0e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:00.430228 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa88241-0f20-4fdc-af3e-128bd92ccf0e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:00.431001 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa88241-0f20-4fdc-af3e-128bd92ccf0e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:00.432502 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa88241-0f20-4fdc-af3e-128bd92ccf0e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:00.457300 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 449/918] 10.222.0.85 () {60 vars in 1144 bytes} [Thu Jun 16 14:44:00 2022] POST /identity/v3/endpoints => generated 346 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:44:00.655431 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87562dd9-e131-436e-ac68-e1127df23b11 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:00.655826 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87562dd9-e131-436e-ac68-e1127df23b11 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:00.656346 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87562dd9-e131-436e-ac68-e1127df23b11 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:00.659408 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 470/919] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:44:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:00.668870 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87917ad-b655-4f52-ae25-ff8bcdf30904 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:00.669904 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87917ad-b655-4f52-ae25-ff8bcdf30904 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:00.670545 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87917ad-b655-4f52-ae25-ff8bcdf30904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:00.696488 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b87917ad-b655-4f52-ae25-ff8bcdf30904 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:00.697716 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b87917ad-b655-4f52-ae25-ff8bcdf30904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:00.798150 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 450/920] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:00.821292 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87562dd9-e131-436e-ac68-e1127df23b11 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:00.908147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:00.956554 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87562dd9-e131-436e-ac68-e1127df23b11 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:00.996097 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e6fb2-d108-4c90-b280-eedc3602f4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:00.997438 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e6fb2-d108-4c90-b280-eedc3602f4ec None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:00.997953 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e6fb2-d108-4c90-b280-eedc3602f4ec None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:00.998439 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e6fb2-d108-4c90-b280-eedc3602f4ec None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:00.999303 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e6fb2-d108-4c90-b280-eedc3602f4ec None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:01.000936 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e6fb2-d108-4c90-b280-eedc3602f4ec None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:01.014771 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-4f9e6fb2-d108-4c90-b280-eedc3602f4ec None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:44:01.014771 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:01.014771 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:44:01.014771 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:44:01.014771 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:44:01.014771 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:44:01.014771 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:44:01.014771 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:01.014771 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:44:01.014771 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:01.014771 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:01.014771 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:01.014771 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:01.014771 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:01.014771 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:01.014771 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:01.014771 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:01.015810 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:01.015810 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:01.015810 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:01.015810 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:01.015810 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:01.015810 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:01.015810 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:44:01.015810 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:44:01.015810 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:44:01.015810 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:44:01.015810 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:01.015810 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:01.015810 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:01.015810 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:01.015810 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:01.015810 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:01.016687 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:01.016687 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:01.016687 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:01.016687 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:01.016687 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:01.016687 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:01.016687 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:01.016687 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:01.016687 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:01.016687 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:01.016687 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:44:01.016687 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:01.016687 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:44:01.016687 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:01.019582 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 471/921] 10.222.0.85 () {56 vars in 1126 bytes} [Thu Jun 16 14:44:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:01.025549 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87917ad-b655-4f52-ae25-ff8bcdf30904 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:01.162491 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:01.169327 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87917ad-b655-4f52-ae25-ff8bcdf30904 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:01.221545 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33263077-30d6-4cf5-ac88-60592f841b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:01.222231 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33263077-30d6-4cf5-ac88-60592f841b58 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:01.222510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33263077-30d6-4cf5-ac88-60592f841b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:01.222791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33263077-30d6-4cf5-ac88-60592f841b58 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:01.223505 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33263077-30d6-4cf5-ac88-60592f841b58 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:01.223809 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33263077-30d6-4cf5-ac88-60592f841b58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:01.225234 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33263077-30d6-4cf5-ac88-60592f841b58 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:01.232159 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 451/922] 10.222.0.85 () {56 vars in 1122 bytes} [Thu Jun 16 14:44:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:01.240167 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e6fb2-d108-4c90-b280-eedc3602f4ec None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:01.359356 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e6fb2-d108-4c90-b280-eedc3602f4ec None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:01.388805 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:01.394878 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc6941-d1d3-4b7b-862b-4a6ed0ded442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:01.395548 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc6941-d1d3-4b7b-862b-4a6ed0ded442 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:01.395824 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc6941-d1d3-4b7b-862b-4a6ed0ded442 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:01.396169 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc6941-d1d3-4b7b-862b-4a6ed0ded442 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:01.396968 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc6941-d1d3-4b7b-862b-4a6ed0ded442 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:01.397269 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc6941-d1d3-4b7b-862b-4a6ed0ded442 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:01.398646 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc6941-d1d3-4b7b-862b-4a6ed0ded442 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:01.405111 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 472/923] 10.222.0.85 () {56 vars in 1122 bytes} [Thu Jun 16 14:44:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:01.410660 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33263077-30d6-4cf5-ac88-60592f841b58 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:01.521880 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33263077-30d6-4cf5-ac88-60592f841b58 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:01.550027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40140c9-cba5-4173-b4a2-05c8254bfffb None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:01.550346 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40140c9-cba5-4173-b4a2-05c8254bfffb None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:01.550581 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40140c9-cba5-4173-b4a2-05c8254bfffb None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:01.551982 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 473/924] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:44:01.557100 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1cfcb-3381-4b41-8bf4-b79a8acd0533 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:01.557387 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1cfcb-3381-4b41-8bf4-b79a8acd0533 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:01.557667 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1cfcb-3381-4b41-8bf4-b79a8acd0533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:01.562294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91704c39-37b8-4173-95ee-370d4b5064ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:01.562967 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91704c39-37b8-4173-95ee-370d4b5064ee None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:01.563244 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91704c39-37b8-4173-95ee-370d4b5064ee None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:01.563515 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91704c39-37b8-4173-95ee-370d4b5064ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:01.564349 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91704c39-37b8-4173-95ee-370d4b5064ee None admin] RBAC: Adding query filter params (interface=public, service_id=5b7a8a8e56454ac1818b3204ab7d29a5, region_id=RegionOne) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:01.564661 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91704c39-37b8-4173-95ee-370d4b5064ee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:01.566043 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91704c39-37b8-4173-95ee-370d4b5064ee None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:01.572075 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 452/925] 10.222.0.85 () {56 vars in 1251 bytes} [Thu Jun 16 14:44:01 2022] GET /identity/v3/endpoints?service_id=5b7a8a8e56454ac1818b3204ab7d29a5&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:01.575122 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-13c1cfcb-3381-4b41-8bf4-b79a8acd0533 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:01.576363 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-13c1cfcb-3381-4b41-8bf4-b79a8acd0533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:01.577483 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91704c39-37b8-4173-95ee-370d4b5064ee None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:01.605400 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:01.663980 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 474/926] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:44:01.681750 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1cfcb-3381-4b41-8bf4-b79a8acd0533 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:01.684258 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91704c39-37b8-4173-95ee-370d4b5064ee None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:01.725385 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb495a2e-ebbc-48d2-a82a-b3fae098fe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:01.726477 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb495a2e-ebbc-48d2-a82a-b3fae098fe9a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:01.726857 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb495a2e-ebbc-48d2-a82a-b3fae098fe9a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:01.727397 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb495a2e-ebbc-48d2-a82a-b3fae098fe9a None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:01.728316 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb495a2e-ebbc-48d2-a82a-b3fae098fe9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:01.730464 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb495a2e-ebbc-48d2-a82a-b3fae098fe9a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:01.739954 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 453/927] 10.222.0.85 () {56 vars in 1087 bytes} [Thu Jun 16 14:44:01 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:44:01.811334 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1cfcb-3381-4b41-8bf4-b79a8acd0533 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:01.848056 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:01.861681 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964dd47f-1bd7-41c2-a0a9-e0947268e750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:01.862544 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dd47f-1bd7-41c2-a0a9-e0947268e750 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:01.862874 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dd47f-1bd7-41c2-a0a9-e0947268e750 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:01.863141 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dd47f-1bd7-41c2-a0a9-e0947268e750 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:01.863773 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964dd47f-1bd7-41c2-a0a9-e0947268e750 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:01.865954 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964dd47f-1bd7-41c2-a0a9-e0947268e750 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:01.891157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-964dd47f-1bd7-41c2-a0a9-e0947268e750 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 14:44:01.891157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:01.891157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:44:01.891157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:44:01.891157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:44:01.891157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:44:01.891157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:44:01.891157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:01.891157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 14:44:01.891157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:01.891157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:01.891157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:01.891157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:01.891157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:01.891157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:01.891157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:01.893029 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:01.893029 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:01.893029 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:01.893029 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:01.893029 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:01.893029 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:01.893029 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:01.893029 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:44:01.893029 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:44:01.893029 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:44:01.893029 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:44:01.893029 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:01.893029 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:01.893029 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:01.893029 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:01.893029 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:01.895533 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:01.895533 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:01.895533 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:01.895533 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:01.895533 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:01.895533 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:01.895533 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:01.895533 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:01.895533 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:01.895533 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:01.895533 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:01.895533 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:44:01.895533 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:01.895533 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 14:44:01.895533 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:01.895533 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 475/928] 10.222.0.85 () {56 vars in 1132 bytes} [Thu Jun 16 14:44:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:44:01.903703 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb495a2e-ebbc-48d2-a82a-b3fae098fe9a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:02.080000 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:02.097676 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb495a2e-ebbc-48d2-a82a-b3fae098fe9a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:02.158375 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb9dc1-88b6-4d5b-9eda-202e8b61a1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:02.159524 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb9dc1-88b6-4d5b-9eda-202e8b61a1c4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:02.159995 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb9dc1-88b6-4d5b-9eda-202e8b61a1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:02.160479 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb9dc1-88b6-4d5b-9eda-202e8b61a1c4 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:02.161658 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb9dc1-88b6-4d5b-9eda-202e8b61a1c4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:02.162152 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb9dc1-88b6-4d5b-9eda-202e8b61a1c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:02.164253 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb9dc1-88b6-4d5b-9eda-202e8b61a1c4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:02.172123 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 454/929] 10.222.0.85 () {56 vars in 1126 bytes} [Thu Jun 16 14:44:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:02.185326 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964dd47f-1bd7-41c2-a0a9-e0947268e750 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:02.303079 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964dd47f-1bd7-41c2-a0a9-e0947268e750 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:02.340706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e4eed-9f47-4b28-9604-cbd063e2e5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:02.341293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e4eed-9f47-4b28-9604-cbd063e2e5f5 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:02.341573 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e4eed-9f47-4b28-9604-cbd063e2e5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:02.341854 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e4eed-9f47-4b28-9604-cbd063e2e5f5 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:02.342562 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e4eed-9f47-4b28-9604-cbd063e2e5f5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:02.342863 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e4eed-9f47-4b28-9604-cbd063e2e5f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:02.344269 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e4eed-9f47-4b28-9604-cbd063e2e5f5 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:02.350439 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 476/930] 10.222.0.85 () {56 vars in 1126 bytes} [Thu Jun 16 14:44:02 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:02.356943 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb9dc1-88b6-4d5b-9eda-202e8b61a1c4 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:02.470926 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb9dc1-88b6-4d5b-9eda-202e8b61a1c4 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:02.511998 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7180cb4-b7e7-44be-be58-3ea156713d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:02.512967 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7180cb4-b7e7-44be-be58-3ea156713d7d None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:02.513391 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7180cb4-b7e7-44be-be58-3ea156713d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:02.513803 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7180cb4-b7e7-44be-be58-3ea156713d7d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:02.514698 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7180cb4-b7e7-44be-be58-3ea156713d7d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:02.516268 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7180cb4-b7e7-44be-be58-3ea156713d7d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:02.538411 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 455/931] 10.222.0.85 () {60 vars in 1144 bytes} [Thu Jun 16 14:44:02 2022] POST /identity/v3/endpoints => generated 347 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:44:02.673719 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711bc29-ea14-4d6f-820d-6f84bc931855 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:02.673912 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711bc29-ea14-4d6f-820d-6f84bc931855 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:02.674189 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711bc29-ea14-4d6f-820d-6f84bc931855 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:02.676160 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 477/932] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:44:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:02.682632 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61a1cb-d9f9-4a3a-bd04-1d4778564831 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:02.683072 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61a1cb-d9f9-4a3a-bd04-1d4778564831 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:02.683384 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61a1cb-d9f9-4a3a-bd04-1d4778564831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:02.704399 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-cc61a1cb-d9f9-4a3a-bd04-1d4778564831 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:02.705759 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-cc61a1cb-d9f9-4a3a-bd04-1d4778564831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:02.709772 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:02.803319 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 456/933] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:44:02.833693 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711bc29-ea14-4d6f-820d-6f84bc931855 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:02.908239 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:02.962487 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711bc29-ea14-4d6f-820d-6f84bc931855 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:02.967458 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a66da-83cf-4014-9969-0d00359421b3 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:02.968018 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a66da-83cf-4014-9969-0d00359421b3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:02.968473 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a66da-83cf-4014-9969-0d00359421b3 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:02.970327 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 457/934] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:44:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:02.976491 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bee589-273b-421d-8490-53b25f29787e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:02.977303 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bee589-273b-421d-8490-53b25f29787e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:02.977840 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bee589-273b-421d-8490-53b25f29787e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:02.998087 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-10bee589-273b-421d-8490-53b25f29787e None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:02.999320 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-10bee589-273b-421d-8490-53b25f29787e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:03.005307 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc3f6d-695c-473c-adf0-1d5d0eff3630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:03.006425 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc3f6d-695c-473c-adf0-1d5d0eff3630 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:03.006978 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc3f6d-695c-473c-adf0-1d5d0eff3630 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:03.007454 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc3f6d-695c-473c-adf0-1d5d0eff3630 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:03.020751 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc3f6d-695c-473c-adf0-1d5d0eff3630 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:03.029816 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-3fbc3f6d-695c-473c-adf0-1d5d0eff3630 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 14:44:03.029816 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:03.029816 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:03.029816 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:03.029816 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:03.029816 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:03.029816 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:03.029816 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:03.029816 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:03.029816 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:03.029816 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:03.029816 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:03.029816 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:03.029816 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:03.029816 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:03.029816 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:03.030832 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:03.030832 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:03.030832 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:03.030832 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:03.030832 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:03.030832 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:03.030832 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:03.030832 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:03.030832 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:03.030832 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:03.030832 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:03.030832 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:03.030832 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:03.030832 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:03.030832 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:03.030832 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:03.031674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:03.031674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:03.031674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:03.031674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:03.031674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:03.031674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:03.031674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:03.031674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:03.031674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:03.031674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:03.031674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 14:44:03.031674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:03.034598 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 478/935] 10.222.0.85 () {56 vars in 1120 bytes} [Thu Jun 16 14:44:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:03.041822 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc3f6d-695c-473c-adf0-1d5d0eff3630 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:03.100182 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 458/936] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:44:03.123320 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bee589-273b-421d-8490-53b25f29787e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:03.176394 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc3f6d-695c-473c-adf0-1d5d0eff3630 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:03.196294 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:03.203686 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:03.220422 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e0fee-e412-4778-abe3-3ebee917b82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:03.221538 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e0fee-e412-4778-abe3-3ebee917b82e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:03.222115 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e0fee-e412-4778-abe3-3ebee917b82e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:03.222588 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e0fee-e412-4778-abe3-3ebee917b82e None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:03.223542 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e0fee-e412-4778-abe3-3ebee917b82e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:03.224075 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e0fee-e412-4778-abe3-3ebee917b82e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:03.225874 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e0fee-e412-4778-abe3-3ebee917b82e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:03.236731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 479/937] 10.222.0.85 () {56 vars in 1115 bytes} [Thu Jun 16 14:44:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:03.245564 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bee589-273b-421d-8490-53b25f29787e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:03.245865 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e0fee-e412-4778-abe3-3ebee917b82e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:03.278941 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e07e5-ed7f-4df4-b5a8-0da7f68f2c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:03.279733 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e07e5-ed7f-4df4-b5a8-0da7f68f2c54 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:03.280072 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e07e5-ed7f-4df4-b5a8-0da7f68f2c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:03.280354 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e07e5-ed7f-4df4-b5a8-0da7f68f2c54 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:03.281073 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e07e5-ed7f-4df4-b5a8-0da7f68f2c54 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:03.282549 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e07e5-ed7f-4df4-b5a8-0da7f68f2c54 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:03.284038 dv-cinder-837165-3-smb devstack@keystone.service[80175]: WARNING keystone.server.flask.common [None req-330e07e5-ed7f-4df4-b5a8-0da7f68f2c54 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 16 14:44:03.303817 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.sql.core [None req-330e07e5-ed7f-4df4-b5a8-0da7f68f2c54 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 14:44:03.303817 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 16 14:44:03.303817 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [parameters: {'id': '3f094b1daa7144aea6d840a872786ae0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 16 14:44:03.303817 dv-cinder-837165-3-smb devstack@keystone.service[80175]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80175) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 14:44:03.314821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-330e07e5-ed7f-4df4-b5a8-0da7f68f2c54 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3f094b1daa7144aea6d840a872786ae0.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3f094b1daa7144aea6d840a872786ae0. Jun 16 14:44:03.314821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:03.314821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 14:44:03.314821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 14:44:03.314821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 14:44:03.314821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 14:44:03.314821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 14:44:03.314821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 14:44:03.314821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 14:44:03.314821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application conn.query(q) Jun 16 14:44:03.314821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 14:44:03.314821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 14:44:03.314821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 14:44:03.315864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application result.read() Jun 16 14:44:03.315864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 14:44:03.315864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 14:44:03.315864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 14:44:03.315864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 14:44:03.315864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 14:44:03.315864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 14:44:03.315864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 14:44:03.315864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 14:44:03.315864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 14:44:03.315864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:03.315864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 14:44:03.315864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:03.315864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:03.315864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 14:44:03.315864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 14:44:03.315864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 16 14:44:03.315864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 16 14:44:03.317403 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 14:44:03.317403 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application next(self.gen) Jun 16 14:44:03.317403 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 14:44:03.317403 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application yield resource Jun 16 14:44:03.317403 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 14:44:03.317403 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application next(self.gen) Jun 16 14:44:03.317403 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 14:44:03.317403 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 14:44:03.317403 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:44:03.317403 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 14:44:03.317403 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:44:03.317403 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise self.value Jun 16 14:44:03.317403 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 14:44:03.317403 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 14:44:03.317403 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 14:44:03.317403 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application session.commit() Jun 16 14:44:03.317403 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 14:44:03.318418 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 14:44:03.318418 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 14:44:03.318418 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 14:44:03.318418 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 14:44:03.318418 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self.session.flush() Jun 16 14:44:03.318418 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 14:44:03.318418 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 14:44:03.318418 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 14:44:03.318418 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 14:44:03.318418 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 14:44:03.318418 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application compat.raise_( Jun 16 14:44:03.318418 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 14:44:03.318418 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception Jun 16 14:44:03.318418 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 14:44:03.318418 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 14:44:03.318418 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 14:44:03.318418 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 14:44:03.319410 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 14:44:03.319410 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 14:44:03.319410 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 14:44:03.319410 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 14:44:03.319410 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 16 14:44:03.319410 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 16 14:44:03.319410 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 14:44:03.319410 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 14:44:03.319410 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 14:44:03.319410 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 14:44:03.319410 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 14:44:03.319410 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 14:44:03.319410 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 14:44:03.319410 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 14:44:03.319410 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 14:44:03.320274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 14:44:03.320274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 14:44:03.320274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception Jun 16 14:44:03.320274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 14:44:03.320274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 14:44:03.320274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 14:44:03.320274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 14:44:03.320274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 14:44:03.320274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 14:44:03.320274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 14:44:03.320274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application conn.query(q) Jun 16 14:44:03.320274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 14:44:03.320274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 14:44:03.320274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 14:44:03.320274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application result.read() Jun 16 14:44:03.320274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 14:44:03.320274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 14:44:03.321589 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 14:44:03.321589 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 14:44:03.321589 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 14:44:03.321589 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 14:44:03.321589 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 14:44:03.321589 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 14:44:03.321589 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 14:44:03.321589 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 16 14:44:03.321589 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [parameters: {'id': '3f094b1daa7144aea6d840a872786ae0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 16 14:44:03.321589 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 14:44:03.321589 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:03.321589 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:03.321589 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:03.321589 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:03.321589 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 16 14:44:03.323107 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 16 14:44:03.323107 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 14:44:03.323107 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 14:44:03.323107 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 16 14:44:03.323107 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:03.323107 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:03.323107 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:03.323107 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:03.323107 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:03.323107 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:03.323107 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:03.323107 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:03.323107 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:03.323107 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:03.323107 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:03.323107 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:03.323107 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:03.332454 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:03.332454 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 16 14:44:03.332454 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 16 14:44:03.332454 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:03.332454 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:03.332454 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 16 14:44:03.332454 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 16 14:44:03.332454 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3f094b1daa7144aea6d840a872786ae0. Jun 16 14:44:03.332454 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:03.332454 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 459/938] 10.222.0.85 () {60 vars in 1140 bytes} [Thu Jun 16 14:44:03 2022] POST /identity/v3/projects => generated 262 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:44:03.332454 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e07e5-ed7f-4df4-b5a8-0da7f68f2c54 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:03.366848 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e0fee-e412-4778-abe3-3ebee917b82e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:03.403664 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d7aba-e859-4fc2-a452-f28390490459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:03.404600 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d7aba-e859-4fc2-a452-f28390490459 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:03.404954 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d7aba-e859-4fc2-a452-f28390490459 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:03.405295 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d7aba-e859-4fc2-a452-f28390490459 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:03.417061 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d7aba-e859-4fc2-a452-f28390490459 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:03.418618 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d7aba-e859-4fc2-a452-f28390490459 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:03.436745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-0f0d7aba-e859-4fc2-a452-f28390490459 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:03.436745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:03.436745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:03.436745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:03.436745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:03.436745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:03.436745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:03.436745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:03.436745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:03.436745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:03.436745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:03.436745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:03.436745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:03.436745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:03.436745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:03.437879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:03.437879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:03.437879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:03.437879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:03.437879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:03.437879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:03.437879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:03.437879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:03.437879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:03.437879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:03.437879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:03.437879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:03.437879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:03.437879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:03.437879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:03.437879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:03.437879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:03.439007 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:03.439007 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:03.439007 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:03.439007 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:03.443895 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 480/939] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:03.447013 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d7aba-e859-4fc2-a452-f28390490459 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:03.463595 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e07e5-ed7f-4df4-b5a8-0da7f68f2c54 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:03.483224 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:03.488119 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:03.505440 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa4266-db0c-454f-84f1-94bae882c62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:03.506657 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa4266-db0c-454f-84f1-94bae882c62f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:03.507148 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa4266-db0c-454f-84f1-94bae882c62f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:03.507641 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa4266-db0c-454f-84f1-94bae882c62f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:03.515633 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa4266-db0c-454f-84f1-94bae882c62f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:03.518216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa4266-db0c-454f-84f1-94bae882c62f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:03.534952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-9bfa4266-db0c-454f-84f1-94bae882c62f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:03.534952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:03.534952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:03.534952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:03.534952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:03.534952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:03.534952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:03.534952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:03.534952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:03.534952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:03.534952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:03.534952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:03.534952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:44:03.534952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:44:03.534952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:44:03.536053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:44:03.536053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:03.536053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:03.536053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:03.536053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:03.536053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:03.536053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:03.536053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:03.536053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:03.536053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:03.536053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:03.536053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:03.536053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:03.536053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:03.536053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:03.536053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:03.536053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:03.537159 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:44:03.537159 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:44:03.537159 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:03.537159 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:03.537159 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:03.537159 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:03.537159 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:03.537159 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:03.544286 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 460/940] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:03.548366 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa4266-db0c-454f-84f1-94bae882c62f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:03.576646 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d7aba-e859-4fc2-a452-f28390490459 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:03.622735 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afcbe3-0ad7-4d54-a58d-ff22b303f656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:03.623442 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afcbe3-0ad7-4d54-a58d-ff22b303f656 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:03.624317 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afcbe3-0ad7-4d54-a58d-ff22b303f656 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:03.624606 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afcbe3-0ad7-4d54-a58d-ff22b303f656 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:03.625339 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79afcbe3-0ad7-4d54-a58d-ff22b303f656 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:03.625791 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79afcbe3-0ad7-4d54-a58d-ff22b303f656 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:03.627589 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79afcbe3-0ad7-4d54-a58d-ff22b303f656 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:03.648623 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 481/941] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:03.652803 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afcbe3-0ad7-4d54-a58d-ff22b303f656 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:03.664999 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa4266-db0c-454f-84f1-94bae882c62f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:03.703331 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2e0d9-7300-4b2a-9931-2cf22e7fa0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:03.704396 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2e0d9-7300-4b2a-9931-2cf22e7fa0cd None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:03.704928 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2e0d9-7300-4b2a-9931-2cf22e7fa0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:03.705409 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2e0d9-7300-4b2a-9931-2cf22e7fa0cd None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:03.706607 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2e0d9-7300-4b2a-9931-2cf22e7fa0cd None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:03.707171 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2e0d9-7300-4b2a-9931-2cf22e7fa0cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:03.708890 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2e0d9-7300-4b2a-9931-2cf22e7fa0cd None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:03.740591 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 461/942] 10.222.0.85 () {56 vars in 1112 bytes} [Thu Jun 16 14:44:03 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:03.746821 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:03.764241 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afcbe3-0ad7-4d54-a58d-ff22b303f656 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:03.804308 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb432ac6-6732-4e51-a566-619eaa87c92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:03.805238 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb432ac6-6732-4e51-a566-619eaa87c92b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:03.805522 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb432ac6-6732-4e51-a566-619eaa87c92b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:03.805802 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb432ac6-6732-4e51-a566-619eaa87c92b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:03.815100 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb432ac6-6732-4e51-a566-619eaa87c92b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:03.816652 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb432ac6-6732-4e51-a566-619eaa87c92b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:03.834157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-fb432ac6-6732-4e51-a566-619eaa87c92b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 14:44:03.834157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:03.834157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:03.834157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:03.834157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:03.834157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:03.834157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:03.834157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:03.834157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:03.834157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:03.834157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:03.834157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:03.834157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:44:03.834157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:44:03.834157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:44:03.834157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:44:03.835218 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:03.835218 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:03.835218 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:03.835218 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:03.835218 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:03.835218 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:03.835218 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:03.835218 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:03.835218 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:03.835218 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:03.835218 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:03.835218 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:03.835218 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:03.835218 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:03.835218 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:03.835218 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:03.835218 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:03.835218 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:03.836271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:03.836271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:03.836271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:44:03.836271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:44:03.836271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:44:03.836271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:44:03.836271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:44:03.836271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:44:03.836271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 14:44:03.836271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:03.836271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 482/943] 10.222.0.85 () {56 vars in 1117 bytes} [Thu Jun 16 14:44:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:03.844641 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2e0d9-7300-4b2a-9931-2cf22e7fa0cd None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:03.899399 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:03.972715 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2e0d9-7300-4b2a-9931-2cf22e7fa0cd None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:04.015250 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc89526-dce2-4f44-b773-0e8a938f9a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:04.016339 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc89526-dce2-4f44-b773-0e8a938f9a25 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:04.016824 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc89526-dce2-4f44-b773-0e8a938f9a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:04.017311 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc89526-dce2-4f44-b773-0e8a938f9a25 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:04.018806 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc89526-dce2-4f44-b773-0e8a938f9a25 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:04.019321 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc89526-dce2-4f44-b773-0e8a938f9a25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:04.021024 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc89526-dce2-4f44-b773-0e8a938f9a25 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:04.041575 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 462/944] 10.222.0.85 () {56 vars in 1149 bytes} [Thu Jun 16 14:44:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:04.048469 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb432ac6-6732-4e51-a566-619eaa87c92b None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:04.165847 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb432ac6-6732-4e51-a566-619eaa87c92b None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:04.208327 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1aafe-b265-4c6d-a3df-94f03d461422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:04.209587 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1aafe-b265-4c6d-a3df-94f03d461422 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:04.210088 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1aafe-b265-4c6d-a3df-94f03d461422 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:04.210589 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1aafe-b265-4c6d-a3df-94f03d461422 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:04.224462 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1aafe-b265-4c6d-a3df-94f03d461422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:04.226517 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1aafe-b265-4c6d-a3df-94f03d461422 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:04.236025 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:04.250240 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-87c1aafe-b265-4c6d-a3df-94f03d461422 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:04.250240 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:04.250240 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:04.250240 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:04.250240 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:04.250240 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:04.250240 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:04.250240 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:04.250240 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:04.250240 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:04.250240 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:04.250240 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:04.250240 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:04.250240 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:04.250240 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:04.251210 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:04.251210 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:04.251210 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:04.251210 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:04.251210 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:04.251210 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:04.251210 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:04.251210 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:04.251210 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:04.251210 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:04.251210 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:04.251210 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:04.251210 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:04.251210 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:04.251210 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:04.251210 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:04.251210 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:04.252181 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:04.252181 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:04.252181 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:04.252181 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:04.254574 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 483/945] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:04.260617 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc89526-dce2-4f44-b773-0e8a938f9a25 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:04.299987 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36756c-b2ea-444b-88d7-305b89218a95 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:04.300589 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36756c-b2ea-444b-88d7-305b89218a95 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:04.300864 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36756c-b2ea-444b-88d7-305b89218a95 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:04.302728 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 484/946] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:44:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:44:04.309473 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4433f6d-10fa-4795-a9a8-dab77129404e None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:04.309754 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4433f6d-10fa-4795-a9a8-dab77129404e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:04.310027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4433f6d-10fa-4795-a9a8-dab77129404e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:04.328462 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-f4433f6d-10fa-4795-a9a8-dab77129404e None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:04.329775 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f4433f6d-10fa-4795-a9a8-dab77129404e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:04.383397 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:04.387204 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc89526-dce2-4f44-b773-0e8a938f9a25 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:04.411894 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 485/947] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:04.428576 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4433f6d-10fa-4795-a9a8-dab77129404e None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:04.432528 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba673801-2aae-419e-8f24-6e338642bc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:04.433476 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba673801-2aae-419e-8f24-6e338642bc32 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:04.433984 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba673801-2aae-419e-8f24-6e338642bc32 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:04.434491 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba673801-2aae-419e-8f24-6e338642bc32 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:04.435421 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba673801-2aae-419e-8f24-6e338642bc32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:04.435958 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba673801-2aae-419e-8f24-6e338642bc32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:04.437651 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba673801-2aae-419e-8f24-6e338642bc32 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:04.451167 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 463/948] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:04.457545 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba673801-2aae-419e-8f24-6e338642bc32 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:04.542273 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4433f6d-10fa-4795-a9a8-dab77129404e None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:04.574915 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:04.585088 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9e607-c9f1-450a-aaae-c4649529fc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:04.586396 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9e607-c9f1-450a-aaae-c4649529fc66 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:04.586898 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9e607-c9f1-450a-aaae-c4649529fc66 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:04.587392 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9e607-c9f1-450a-aaae-c4649529fc66 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:04.588316 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9e607-c9f1-450a-aaae-c4649529fc66 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:04.589942 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9e607-c9f1-450a-aaae-c4649529fc66 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:04.591846 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba673801-2aae-419e-8f24-6e338642bc32 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:04.604660 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-b4b9e607-c9f1-450a-aaae-c4649529fc66 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:44:04.604660 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:04.604660 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:44:04.604660 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:44:04.604660 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:44:04.604660 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:44:04.604660 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:44:04.604660 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:04.604660 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:44:04.604660 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:04.604660 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:04.604660 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:04.604660 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:04.604660 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:04.604660 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:04.604660 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:04.604660 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:04.605738 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:04.605738 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:04.605738 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:04.605738 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:04.605738 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:04.605738 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:04.605738 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:44:04.605738 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:44:04.605738 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:44:04.605738 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:44:04.605738 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:04.605738 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:04.605738 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:04.605738 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:04.605738 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:04.605738 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:04.606798 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:04.606798 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:04.606798 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:04.606798 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:04.606798 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:04.606798 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:04.606798 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:04.606798 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:04.606798 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:04.606798 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:04.606798 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:44:04.606798 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:04.606798 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:44:04.606798 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:04.614903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 486/949] 10.222.0.85 () {56 vars in 1126 bytes} [Thu Jun 16 14:44:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:04.616503 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9e607-c9f1-450a-aaae-c4649529fc66 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:04.633924 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8f67f-e758-462d-b59a-52fa9a0ac06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:04.634747 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8f67f-e758-462d-b59a-52fa9a0ac06a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:04.635031 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8f67f-e758-462d-b59a-52fa9a0ac06a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:04.635311 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8f67f-e758-462d-b59a-52fa9a0ac06a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:04.644662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8f67f-e758-462d-b59a-52fa9a0ac06a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:04.646429 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8f67f-e758-462d-b59a-52fa9a0ac06a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:04.663105 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-6df8f67f-e758-462d-b59a-52fa9a0ac06a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:04.663105 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:04.663105 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:04.663105 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:04.663105 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:04.663105 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:04.663105 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:04.663105 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:04.663105 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:04.663105 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:04.663105 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:04.663105 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:04.663105 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:44:04.663105 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:44:04.663105 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:44:04.664373 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:44:04.664373 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:04.664373 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:04.664373 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:04.664373 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:04.664373 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:04.664373 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:04.664373 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:04.664373 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:04.664373 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:04.664373 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:04.664373 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:04.664373 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:04.664373 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:04.664373 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:04.664373 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:04.664373 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:04.665356 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:44:04.665356 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:44:04.665356 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:04.665356 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:04.665356 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:04.665356 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:04.665356 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:04.665356 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:04.667904 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 464/950] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:04.673928 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8f67f-e758-462d-b59a-52fa9a0ac06a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:04.704762 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:04.733958 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9e607-c9f1-450a-aaae-c4649529fc66 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:04.770017 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8323d-110f-4fab-b6ff-f4301ec8bee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:04.770847 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8323d-110f-4fab-b6ff-f4301ec8bee8 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:04.771245 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8323d-110f-4fab-b6ff-f4301ec8bee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:04.771618 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8323d-110f-4fab-b6ff-f4301ec8bee8 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:04.772512 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8323d-110f-4fab-b6ff-f4301ec8bee8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:04.772946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8323d-110f-4fab-b6ff-f4301ec8bee8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:04.775137 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8323d-110f-4fab-b6ff-f4301ec8bee8 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:04.784897 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 487/951] 10.222.0.85 () {56 vars in 1122 bytes} [Thu Jun 16 14:44:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:04.786564 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8323d-110f-4fab-b6ff-f4301ec8bee8 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:04.814564 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8f67f-e758-462d-b59a-52fa9a0ac06a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:04.848801 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:04.864509 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b17b9a-07f6-47cb-9548-7617e43e49b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:04.866314 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b17b9a-07f6-47cb-9548-7617e43e49b0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:04.866814 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b17b9a-07f6-47cb-9548-7617e43e49b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:04.867240 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b17b9a-07f6-47cb-9548-7617e43e49b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:04.868278 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b17b9a-07f6-47cb-9548-7617e43e49b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:04.868735 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b17b9a-07f6-47cb-9548-7617e43e49b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:04.870422 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b17b9a-07f6-47cb-9548-7617e43e49b0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:04.893951 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 465/952] 10.222.0.85 () {56 vars in 1148 bytes} [Thu Jun 16 14:44:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:04.896170 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b17b9a-07f6-47cb-9548-7617e43e49b0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:04.909410 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8323d-110f-4fab-b6ff-f4301ec8bee8 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:04.962104 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a00db-12e0-48ec-acd6-2f96cf08b9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:04.962802 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a00db-12e0-48ec-acd6-2f96cf08b9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:04.963075 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a00db-12e0-48ec-acd6-2f96cf08b9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:04.963352 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a00db-12e0-48ec-acd6-2f96cf08b9a3 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:04.964091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a00db-12e0-48ec-acd6-2f96cf08b9a3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:04.964398 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a00db-12e0-48ec-acd6-2f96cf08b9a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:04.965786 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a00db-12e0-48ec-acd6-2f96cf08b9a3 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:04.971193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 488/953] 10.222.0.85 () {56 vars in 1122 bytes} [Thu Jun 16 14:44:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:04.972439 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6d4c4-9b78-46bf-9836-9ab3616a17a6 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:04.972735 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6d4c4-9b78-46bf-9836-9ab3616a17a6 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:04.972997 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6d4c4-9b78-46bf-9836-9ab3616a17a6 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:04.974363 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 489/954] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:44:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:04.979125 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe6d4c4-9b78-46bf-9836-9ab3616a17a6 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:04.989056 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:05.010912 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b17b9a-07f6-47cb-9548-7617e43e49b0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:05.049395 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3ce26-f188-49da-82e1-b80c2894635d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:05.050301 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3ce26-f188-49da-82e1-b80c2894635d None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:05.050584 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3ce26-f188-49da-82e1-b80c2894635d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:05.050859 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3ce26-f188-49da-82e1-b80c2894635d None admin] PATH_INFO: `/v3/projects/80e309a3b3784ba9943734a41949b222/users/db4d36e6837d4b2fa4b7ee5c7243b6b3/roles/12e6cac1ace0476da69b56800ec15fbc` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:05.053378 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3ce26-f188-49da-82e1-b80c2894635d None admin] RBAC: Authorizing `identity:create_grant(project_id=80e309a3b3784ba9943734a41949b222, user_id=db4d36e6837d4b2fa4b7ee5c7243b6b3, role_id=12e6cac1ace0476da69b56800ec15fbc)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:05.054822 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3ce26-f188-49da-82e1-b80c2894635d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:05.079994 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 466/955] 10.222.0.85 () {58 vars in 1439 bytes} [Thu Jun 16 14:44:04 2022] PUT /identity/v3/projects/80e309a3b3784ba9943734a41949b222/users/db4d36e6837d4b2fa4b7ee5c7243b6b3/roles/12e6cac1ace0476da69b56800ec15fbc => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:44:05.079994 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab4c77-38c7-42eb-943c-67a3724dceb4 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:05.079994 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab4c77-38c7-42eb-943c-67a3724dceb4 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:05.079994 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab4c77-38c7-42eb-943c-67a3724dceb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:05.104440 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-77ab4c77-38c7-42eb-943c-67a3724dceb4 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:05.106503 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-77ab4c77-38c7-42eb-943c-67a3724dceb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:05.112405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe6d4c4-9b78-46bf-9836-9ab3616a17a6 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:05.136299 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:05.152855 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e2a40-9c6f-4ff7-a73b-4e3360eed61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:05.154133 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e2a40-9c6f-4ff7-a73b-4e3360eed61c None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:05.154133 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e2a40-9c6f-4ff7-a73b-4e3360eed61c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:05.154133 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e2a40-9c6f-4ff7-a73b-4e3360eed61c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:05.154823 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e2a40-9c6f-4ff7-a73b-4e3360eed61c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:05.156297 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e2a40-9c6f-4ff7-a73b-4e3360eed61c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:05.181165 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 490/956] 10.222.0.85 () {60 vars in 1144 bytes} [Thu Jun 16 14:44:04 2022] POST /identity/v3/endpoints => generated 349 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:44:05.204058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 467/957] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:05.226820 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e2a40-9c6f-4ff7-a73b-4e3360eed61c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:05.350152 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e2a40-9c6f-4ff7-a73b-4e3360eed61c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:05.388422 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d21ab9-5948-402c-90ed-e6b1faacede1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:05.389247 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d21ab9-5948-402c-90ed-e6b1faacede1 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:05.389533 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d21ab9-5948-402c-90ed-e6b1faacede1 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:05.389807 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d21ab9-5948-402c-90ed-e6b1faacede1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:05.390467 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d21ab9-5948-402c-90ed-e6b1faacede1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:05.391880 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d21ab9-5948-402c-90ed-e6b1faacede1 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:05.404413 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-61d21ab9-5948-402c-90ed-e6b1faacede1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 14:44:05.404413 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:05.404413 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:44:05.404413 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:44:05.404413 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:44:05.404413 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:44:05.404413 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:44:05.404413 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:05.404413 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 14:44:05.404413 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:05.404413 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:05.404413 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:05.404413 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:05.404413 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:05.404413 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:05.404413 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:05.404413 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:05.405779 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:05.405779 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:05.405779 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:05.405779 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:05.405779 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:05.405779 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:05.405779 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:44:05.405779 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:44:05.405779 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:44:05.405779 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:44:05.405779 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:05.405779 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:05.405779 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:05.405779 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:05.405779 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:05.405779 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:05.407755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:05.407755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:05.407755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:05.407755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:05.407755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:05.407755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:05.407755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:05.407755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:05.407755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:05.407755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:05.407755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:44:05.407755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:05.407755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 14:44:05.407755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:05.407755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 491/958] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:05.411945 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab4c77-38c7-42eb-943c-67a3724dceb4 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:05.485461 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:05.526404 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab4c77-38c7-42eb-943c-67a3724dceb4 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:05.571186 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93faaa61-7abc-477b-8215-b559dfacbd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:05.571896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93faaa61-7abc-477b-8215-b559dfacbd73 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:05.572197 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93faaa61-7abc-477b-8215-b559dfacbd73 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:05.572476 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93faaa61-7abc-477b-8215-b559dfacbd73 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:05.573193 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93faaa61-7abc-477b-8215-b559dfacbd73 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:05.573498 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93faaa61-7abc-477b-8215-b559dfacbd73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:05.574965 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93faaa61-7abc-477b-8215-b559dfacbd73 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:05.580704 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 468/959] 10.222.0.85 () {56 vars in 1112 bytes} [Thu Jun 16 14:44:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:05.586445 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d21ab9-5948-402c-90ed-e6b1faacede1 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:05.631920 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:05.701580 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d21ab9-5948-402c-90ed-e6b1faacede1 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:05.742150 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83add7d4-a148-4892-9b55-63dab99143d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:05.743076 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83add7d4-a148-4892-9b55-63dab99143d7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:05.743491 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83add7d4-a148-4892-9b55-63dab99143d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:05.743782 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83add7d4-a148-4892-9b55-63dab99143d7 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:05.744903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83add7d4-a148-4892-9b55-63dab99143d7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:05.745465 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83add7d4-a148-4892-9b55-63dab99143d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:05.747217 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83add7d4-a148-4892-9b55-63dab99143d7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:05.755709 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 492/960] 10.222.0.85 () {56 vars in 1112 bytes} [Thu Jun 16 14:44:05 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:06.191210 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42bd5a-c803-4bb7-80d3-411f048f5e6c None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:06.191790 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42bd5a-c803-4bb7-80d3-411f048f5e6c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:06.191790 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42bd5a-c803-4bb7-80d3-411f048f5e6c None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:06.193521 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 469/961] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:06.199668 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5721c-ee6f-4961-a3bd-025647349a8b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:06.200257 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5721c-ee6f-4961-a3bd-025647349a8b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:06.200257 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5721c-ee6f-4961-a3bd-025647349a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:06.218743 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-29a5721c-ee6f-4961-a3bd-025647349a8b None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:06.220063 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-29a5721c-ee6f-4961-a3bd-025647349a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:06.296549 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 493/962] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:06.320448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42bd5a-c803-4bb7-80d3-411f048f5e6c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:06.438659 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42bd5a-c803-4bb7-80d3-411f048f5e6c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:06.471232 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:06.478686 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdbde8-c8bd-42c6-98f0-3964f92ed3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:06.479694 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdbde8-c8bd-42c6-98f0-3964f92ed3fd None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:06.480202 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdbde8-c8bd-42c6-98f0-3964f92ed3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:06.480676 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdbde8-c8bd-42c6-98f0-3964f92ed3fd None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:06.481624 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bdbde8-c8bd-42c6-98f0-3964f92ed3fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:06.483268 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bdbde8-c8bd-42c6-98f0-3964f92ed3fd None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:06.498165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.sql.core [None req-d4bdbde8-c8bd-42c6-98f0-3964f92ed3fd None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 14:44:06.498165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 16 14:44:06.498165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [parameters: {'user_id': '958b678855c04f56b487798130c2cf8a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 16 14:44:06.498165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80175) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 14:44:06.506671 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-d4bdbde8-c8bd-42c6-98f0-3964f92ed3fd None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 16 14:44:06.506671 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:06.506671 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 14:44:06.506671 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 14:44:06.506671 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 14:44:06.506671 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 14:44:06.506671 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 14:44:06.506671 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 14:44:06.506671 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 14:44:06.506671 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application conn.query(q) Jun 16 14:44:06.506671 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 14:44:06.506671 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 14:44:06.506671 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 14:44:06.506671 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application result.read() Jun 16 14:44:06.506671 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 14:44:06.507565 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 14:44:06.507565 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 14:44:06.507565 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 14:44:06.507565 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 14:44:06.507565 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 14:44:06.507565 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 14:44:06.507565 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 14:44:06.507565 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 14:44:06.507565 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:06.507565 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 14:44:06.507565 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:06.507565 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:06.507565 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 14:44:06.507565 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 14:44:06.507565 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 16 14:44:06.507565 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 16 14:44:06.507565 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 14:44:06.507565 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application next(self.gen) Jun 16 14:44:06.508707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 14:44:06.508707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application yield resource Jun 16 14:44:06.508707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 14:44:06.508707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application next(self.gen) Jun 16 14:44:06.508707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 14:44:06.508707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 14:44:06.508707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:44:06.508707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 14:44:06.508707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:44:06.508707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise self.value Jun 16 14:44:06.508707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 14:44:06.508707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 14:44:06.508707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 14:44:06.508707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application session.commit() Jun 16 14:44:06.508707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 14:44:06.508707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 14:44:06.508707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 14:44:06.509657 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 14:44:06.509657 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 14:44:06.509657 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self.session.flush() Jun 16 14:44:06.509657 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 14:44:06.509657 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 14:44:06.509657 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 14:44:06.509657 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 14:44:06.509657 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 14:44:06.509657 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application compat.raise_( Jun 16 14:44:06.509657 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 14:44:06.509657 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception Jun 16 14:44:06.509657 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 14:44:06.509657 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 14:44:06.509657 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 14:44:06.509657 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 14:44:06.509657 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 14:44:06.509657 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 14:44:06.511242 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 14:44:06.511242 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 14:44:06.511242 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 16 14:44:06.511242 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 16 14:44:06.511242 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 14:44:06.511242 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 14:44:06.511242 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 14:44:06.511242 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 14:44:06.511242 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 14:44:06.511242 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 14:44:06.511242 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 14:44:06.511242 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 14:44:06.511242 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 14:44:06.511242 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 14:44:06.511242 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 14:44:06.511242 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception Jun 16 14:44:06.512154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 14:44:06.512154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 14:44:06.512154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 14:44:06.512154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 14:44:06.512154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 14:44:06.512154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 14:44:06.512154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 14:44:06.512154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application conn.query(q) Jun 16 14:44:06.512154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 14:44:06.512154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 14:44:06.512154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 14:44:06.512154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application result.read() Jun 16 14:44:06.512154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 14:44:06.512154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 14:44:06.512154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 14:44:06.512154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 14:44:06.513012 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 14:44:06.513012 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 14:44:06.513012 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 14:44:06.513012 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 14:44:06.513012 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 14:44:06.513012 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 16 14:44:06.513012 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [parameters: {'user_id': '958b678855c04f56b487798130c2cf8a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 16 14:44:06.513012 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 14:44:06.513012 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:06.513012 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:06.513012 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:06.513012 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:06.513012 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:06.513012 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:06.513012 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:06.513814 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:06.513814 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:06.513814 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:06.513814 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:06.513814 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:06.513814 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:06.513814 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:06.513814 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 16 14:44:06.513814 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 16 14:44:06.513814 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:06.513814 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:06.513814 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:06.513814 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:06.513814 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:06.513814 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:06.513814 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 16 14:44:06.513814 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 16 14:44:06.516388 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 16 14:44:06.516388 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 16 14:44:06.516388 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 14:44:06.516388 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 14:44:06.516388 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 16 14:44:06.516388 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:06.519187 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 470/963] 10.222.0.85 () {60 vars in 1131 bytes} [Thu Jun 16 14:44:06 2022] POST /identity/v3/users => generated 160 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:06.525415 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5721c-ee6f-4961-a3bd-025647349a8b None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:06.569118 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:06.641953 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5721c-ee6f-4961-a3bd-025647349a8b None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:06.677618 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbfc99-339c-4e10-b7e4-de56d82b2ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:06.678419 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbfc99-339c-4e10-b7e4-de56d82b2ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:06.678699 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbfc99-339c-4e10-b7e4-de56d82b2ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:06.678969 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbfc99-339c-4e10-b7e4-de56d82b2ac8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:06.686670 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbfc99-339c-4e10-b7e4-de56d82b2ac8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:06.688222 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbfc99-339c-4e10-b7e4-de56d82b2ac8 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:06.703093 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-e6dbfc99-339c-4e10-b7e4-de56d82b2ac8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 14:44:06.703093 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:06.703093 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:06.703093 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:06.703093 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:06.703093 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:06.703093 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:06.703093 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:06.703093 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:06.703093 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:06.703093 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:06.703093 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:06.703093 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:44:06.703093 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:44:06.703093 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:44:06.703093 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:44:06.705223 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:06.705223 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:06.705223 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:06.705223 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:06.705223 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:06.705223 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:06.705223 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:06.705223 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:06.705223 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:06.705223 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:06.705223 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:06.705223 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:06.705223 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:06.705223 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:06.705223 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:06.705223 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:06.705223 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:06.705223 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:06.707452 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:06.707452 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:06.707452 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:44:06.707452 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:44:06.707452 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:44:06.707452 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:44:06.707452 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:44:06.707452 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:44:06.707452 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 14:44:06.707452 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:06.707452 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 494/964] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:44:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:06.713556 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdbde8-c8bd-42c6-98f0-3964f92ed3fd None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:06.822744 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdbde8-c8bd-42c6-98f0-3964f92ed3fd None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:06.859325 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d66fe9-9a0a-4761-8320-c3d16e54275e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:06.860077 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d66fe9-9a0a-4761-8320-c3d16e54275e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:06.860357 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d66fe9-9a0a-4761-8320-c3d16e54275e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:06.860629 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d66fe9-9a0a-4761-8320-c3d16e54275e None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:06.861618 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d66fe9-9a0a-4761-8320-c3d16e54275e None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:06.862060 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d66fe9-9a0a-4761-8320-c3d16e54275e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:06.863840 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d66fe9-9a0a-4761-8320-c3d16e54275e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:06.906567 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 471/965] 10.222.0.85 () {56 vars in 1101 bytes} [Thu Jun 16 14:44:06 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:07.364758 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ecabd-818a-45e7-ad77-0adea53fbb87 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:07.365340 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ecabd-818a-45e7-ad77-0adea53fbb87 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:07.365340 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ecabd-818a-45e7-ad77-0adea53fbb87 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:07.366862 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 495/966] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:44:07.372466 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17373b9b-dd03-4c1a-a828-7e8b34962d4a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:07.372894 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17373b9b-dd03-4c1a-a828-7e8b34962d4a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:07.373066 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17373b9b-dd03-4c1a-a828-7e8b34962d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:07.390447 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-17373b9b-dd03-4c1a-a828-7e8b34962d4a None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:07.391999 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-17373b9b-dd03-4c1a-a828-7e8b34962d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:07.441684 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:07.465954 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 472/967] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:07.489370 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ecabd-818a-45e7-ad77-0adea53fbb87 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:07.531843 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95f854-0102-47bc-9354-a9f0dd9076f3 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:07.532124 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95f854-0102-47bc-9354-a9f0dd9076f3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:07.532553 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95f854-0102-47bc-9354-a9f0dd9076f3 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:07.534131 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 473/968] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:07.540114 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3951e-eb9f-4f66-8381-edffd966a37e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:07.540409 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3951e-eb9f-4f66-8381-edffd966a37e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:07.540685 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3951e-eb9f-4f66-8381-edffd966a37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:07.562580 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-baa3951e-eb9f-4f66-8381-edffd966a37e None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:07.563864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-baa3951e-eb9f-4f66-8381-edffd966a37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:07.598951 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:07.607370 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ecabd-818a-45e7-ad77-0adea53fbb87 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:07.642849 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec514a-e469-4f56-9a94-9f95e2b1635b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:07.643602 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec514a-e469-4f56-9a94-9f95e2b1635b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:07.643885 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec514a-e469-4f56-9a94-9f95e2b1635b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:07.644214 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec514a-e469-4f56-9a94-9f95e2b1635b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:07.648013 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 474/969] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:07.654961 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec514a-e469-4f56-9a94-9f95e2b1635b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:07.663271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-5cec514a-e469-4f56-9a94-9f95e2b1635b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 14:44:07.663271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:07.663271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:07.663271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:07.663271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:07.663271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:07.663271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:07.663271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:07.663271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:07.663271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:07.663271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:07.663271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:07.663271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:07.663271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:07.663271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:07.663271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:07.664601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:07.664601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:07.664601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:07.664601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:07.664601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:07.664601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:07.664601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:07.664601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:07.664601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:07.664601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:07.664601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:07.664601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:07.664601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:07.664601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:07.664601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:07.664601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:07.665699 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:07.665699 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:07.665699 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:07.665699 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:07.665699 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:07.665699 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:07.665699 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:07.665699 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:07.665699 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:07.665699 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:07.665699 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 14:44:07.665699 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:07.666364 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3951e-eb9f-4f66-8381-edffd966a37e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:07.666440 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 496/970] 10.222.0.85 () {56 vars in 1120 bytes} [Thu Jun 16 14:44:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:07.672357 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec514a-e469-4f56-9a94-9f95e2b1635b None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:07.774696 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3951e-eb9f-4f66-8381-edffd966a37e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:07.786271 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:07.786768 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec514a-e469-4f56-9a94-9f95e2b1635b None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:07.814484 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3037afd-ac89-4c8e-a9b1-c850c57a2c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:07.815393 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3037afd-ac89-4c8e-a9b1-c850c57a2c06 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:07.815777 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3037afd-ac89-4c8e-a9b1-c850c57a2c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:07.816074 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3037afd-ac89-4c8e-a9b1-c850c57a2c06 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:07.816725 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3037afd-ac89-4c8e-a9b1-c850c57a2c06 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:07.818200 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3037afd-ac89-4c8e-a9b1-c850c57a2c06 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:07.823910 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f6063-f85e-4884-bd19-617a580b1e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:07.824621 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f6063-f85e-4884-bd19-617a580b1e2c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:07.824924 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f6063-f85e-4884-bd19-617a580b1e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:07.825232 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f6063-f85e-4884-bd19-617a580b1e2c None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:07.826009 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f6063-f85e-4884-bd19-617a580b1e2c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:07.826324 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f6063-f85e-4884-bd19-617a580b1e2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:07.827710 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f6063-f85e-4884-bd19-617a580b1e2c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:07.831057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-b3037afd-ac89-4c8e-a9b1-c850c57a2c06 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:44:07.831057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:07.831057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:44:07.831057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:44:07.831057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:44:07.831057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:44:07.831057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:44:07.831057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:07.831057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:44:07.831057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:07.831057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:07.831057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:07.831057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:07.831057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:07.831057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:07.831057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:07.831057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:07.832171 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:07.832171 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:07.832171 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:07.832171 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:07.832171 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:07.832171 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:07.832171 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:44:07.832171 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:44:07.832171 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:44:07.832171 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:44:07.832171 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:07.832171 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:07.832171 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:07.832171 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:07.832171 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:07.832171 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:07.833042 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:07.833042 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:07.833042 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:07.833042 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:07.833042 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:07.833042 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:07.833042 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:07.833042 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:07.833042 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:07.833042 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:07.833042 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:44:07.833042 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:07.833042 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:44:07.833042 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:07.836261 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 475/971] 10.222.0.85 () {56 vars in 1126 bytes} [Thu Jun 16 14:44:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:44:07.837847 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 497/972] 10.222.0.85 () {56 vars in 1115 bytes} [Thu Jun 16 14:44:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:07.839549 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3037afd-ac89-4c8e-a9b1-c850c57a2c06 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:07.844551 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f6063-f85e-4884-bd19-617a580b1e2c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:07.865473 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:07.956493 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3037afd-ac89-4c8e-a9b1-c850c57a2c06 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:07.958945 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f6063-f85e-4884-bd19-617a580b1e2c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:07.990311 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8accd056-8bc4-42f5-bacb-33a54e9c0daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:07.990985 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8accd056-8bc4-42f5-bacb-33a54e9c0daf None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:07.991273 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8accd056-8bc4-42f5-bacb-33a54e9c0daf None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:07.991581 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8accd056-8bc4-42f5-bacb-33a54e9c0daf None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:07.992293 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8accd056-8bc4-42f5-bacb-33a54e9c0daf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:07.992662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8accd056-8bc4-42f5-bacb-33a54e9c0daf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:07.994150 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8accd056-8bc4-42f5-bacb-33a54e9c0daf None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:07.996874 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26412fc9-daff-46cf-ad71-b0e28292aecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:07.997684 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26412fc9-daff-46cf-ad71-b0e28292aecb None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:07.997968 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26412fc9-daff-46cf-ad71-b0e28292aecb None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:07.998244 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26412fc9-daff-46cf-ad71-b0e28292aecb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:07.998907 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 476/973] 10.222.0.85 () {56 vars in 1122 bytes} [Thu Jun 16 14:44:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:08.000142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbbafe-1a60-4d9b-bc05-83768ea74b82 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:08.000424 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbbafe-1a60-4d9b-bc05-83768ea74b82 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:08.000701 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbbafe-1a60-4d9b-bc05-83768ea74b82 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:08.001912 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 477/974] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:44:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:08.004505 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbbafe-1a60-4d9b-bc05-83768ea74b82 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:08.015357 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26412fc9-daff-46cf-ad71-b0e28292aecb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:08.016864 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26412fc9-daff-46cf-ad71-b0e28292aecb None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:08.035645 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-26412fc9-daff-46cf-ad71-b0e28292aecb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:08.035645 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:08.035645 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:08.035645 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:08.035645 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:08.035645 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:08.035645 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:08.035645 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:08.035645 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:08.035645 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:08.035645 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:08.035645 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:08.035645 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:08.035645 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:08.035645 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:08.036600 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:08.036600 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:08.036600 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:08.036600 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:08.036600 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:08.036600 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:08.036600 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:08.036600 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:08.036600 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:08.036600 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:08.036600 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:08.036600 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:08.036600 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:08.036600 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:08.036600 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:08.036600 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:08.036600 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:08.037508 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:08.037508 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:08.037508 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:08.037508 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:08.037508 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 498/975] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:44:08.038186 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff6dd5-ca42-4249-8b1a-fa4db369d9ca None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:08.038465 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff6dd5-ca42-4249-8b1a-fa4db369d9ca None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:08.038742 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff6dd5-ca42-4249-8b1a-fa4db369d9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:08.050056 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:08.057306 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-a2ff6dd5-ca42-4249-8b1a-fa4db369d9ca None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:08.058519 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a2ff6dd5-ca42-4249-8b1a-fa4db369d9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:08.117101 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbbafe-1a60-4d9b-bc05-83768ea74b82 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:08.123030 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:08.128460 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 499/976] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:08.129395 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff6dd5-ca42-4249-8b1a-fa4db369d9ca None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:08.153574 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6283d-cfd0-4e1d-b48d-817eac3d7043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:08.154248 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6283d-cfd0-4e1d-b48d-817eac3d7043 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:08.154545 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6283d-cfd0-4e1d-b48d-817eac3d7043 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:08.154803 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6283d-cfd0-4e1d-b48d-817eac3d7043 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:08.155638 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a6283d-cfd0-4e1d-b48d-817eac3d7043 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:08.156008 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a6283d-cfd0-4e1d-b48d-817eac3d7043 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:08.157396 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a6283d-cfd0-4e1d-b48d-817eac3d7043 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:08.166866 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 478/977] 10.222.0.85 () {56 vars in 1122 bytes} [Thu Jun 16 14:44:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:08.166866 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6283d-cfd0-4e1d-b48d-817eac3d7043 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:08.233876 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff6dd5-ca42-4249-8b1a-fa4db369d9ca None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:08.267229 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a47bcc-8a99-44b8-9f89-85e50c9e91c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:08.267929 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a47bcc-8a99-44b8-9f89-85e50c9e91c3 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:08.268185 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6283d-cfd0-4e1d-b48d-817eac3d7043 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:08.268293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a47bcc-8a99-44b8-9f89-85e50c9e91c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:08.268461 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a47bcc-8a99-44b8-9f89-85e50c9e91c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:08.269176 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a47bcc-8a99-44b8-9f89-85e50c9e91c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:08.269461 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a47bcc-8a99-44b8-9f89-85e50c9e91c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:08.269815 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:08.270882 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a47bcc-8a99-44b8-9f89-85e50c9e91c3 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:08.282726 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 500/978] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:08.283553 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a47bcc-8a99-44b8-9f89-85e50c9e91c3 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:08.309252 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56128e-3b55-4b4d-a692-a3ac20588ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:08.309923 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56128e-3b55-4b4d-a692-a3ac20588ed6 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:08.310209 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56128e-3b55-4b4d-a692-a3ac20588ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:08.310493 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56128e-3b55-4b4d-a692-a3ac20588ed6 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:08.311284 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56128e-3b55-4b4d-a692-a3ac20588ed6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:08.312676 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56128e-3b55-4b4d-a692-a3ac20588ed6 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:08.327002 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 479/979] 10.222.0.85 () {60 vars in 1141 bytes} [Thu Jun 16 14:44:08 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:44:08.327819 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56128e-3b55-4b4d-a692-a3ac20588ed6 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:08.345162 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:08.417895 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a47bcc-8a99-44b8-9f89-85e50c9e91c3 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:08.480785 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a614a0-29ab-4fb6-b297-bb6450f09172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:08.481461 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a614a0-29ab-4fb6-b297-bb6450f09172 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:08.481754 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a614a0-29ab-4fb6-b297-bb6450f09172 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:08.482022 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a614a0-29ab-4fb6-b297-bb6450f09172 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:08.482821 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a614a0-29ab-4fb6-b297-bb6450f09172 None admin] RBAC: Adding query filter params (interface=admin, service_id=5b7a8a8e56454ac1818b3204ab7d29a5, region_id=RegionOne) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:08.483152 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a614a0-29ab-4fb6-b297-bb6450f09172 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:08.484634 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a614a0-29ab-4fb6-b297-bb6450f09172 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:08.484743 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56128e-3b55-4b4d-a692-a3ac20588ed6 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:08.490712 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 501/980] 10.222.0.85 () {56 vars in 1249 bytes} [Thu Jun 16 14:44:08 2022] GET /identity/v3/endpoints?service_id=5b7a8a8e56454ac1818b3204ab7d29a5&interface=admin®ion_id=RegionOne => generated 193 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:08.496278 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a614a0-29ab-4fb6-b297-bb6450f09172 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:08.530572 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00196ca0-bfbb-477e-9390-22cc5de21c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:08.531420 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00196ca0-bfbb-477e-9390-22cc5de21c1c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:08.531706 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00196ca0-bfbb-477e-9390-22cc5de21c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:08.532033 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00196ca0-bfbb-477e-9390-22cc5de21c1c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:08.541078 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00196ca0-bfbb-477e-9390-22cc5de21c1c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:08.542546 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00196ca0-bfbb-477e-9390-22cc5de21c1c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:08.560041 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-00196ca0-bfbb-477e-9390-22cc5de21c1c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 14:44:08.560041 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:08.560041 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:08.560041 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:08.560041 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:08.560041 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:08.560041 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:08.560041 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:08.560041 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:08.560041 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:08.560041 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:08.560041 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:08.560041 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:44:08.560041 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:44:08.560041 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:44:08.560041 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:44:08.561098 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:08.561098 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:08.561098 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:08.561098 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:08.561098 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:08.561098 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:08.561098 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:08.561098 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:08.561098 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:08.561098 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:08.561098 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:08.561098 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:08.561098 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:08.561098 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:08.561098 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:08.561098 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:08.561098 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:08.561098 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:08.562270 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:08.562270 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:08.562270 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:44:08.562270 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:44:08.562270 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:44:08.562270 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:44:08.562270 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:44:08.562270 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:44:08.562270 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 14:44:08.562270 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:08.562270 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 480/981] 10.222.0.85 () {56 vars in 1117 bytes} [Thu Jun 16 14:44:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:08.566900 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00196ca0-bfbb-477e-9390-22cc5de21c1c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:08.599335 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:08.614092 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a614a0-29ab-4fb6-b297-bb6450f09172 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:08.635180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:08.655082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8b435-c607-4e25-a1d2-d899c7c39e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:08.655756 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8b435-c607-4e25-a1d2-d899c7c39e1f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:08.656068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8b435-c607-4e25-a1d2-d899c7c39e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:08.656341 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8b435-c607-4e25-a1d2-d899c7c39e1f None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:08.657023 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8b435-c607-4e25-a1d2-d899c7c39e1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:08.658400 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8b435-c607-4e25-a1d2-d899c7c39e1f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:08.666188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 502/982] 10.222.0.85 () {56 vars in 1087 bytes} [Thu Jun 16 14:44:08 2022] GET /identity/v3/services => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:44:08.699701 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00196ca0-bfbb-477e-9390-22cc5de21c1c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:08.740443 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b24bd-25c1-419f-b017-243c558bba1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:08.741452 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b24bd-25c1-419f-b017-243c558bba1e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:08.741910 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b24bd-25c1-419f-b017-243c558bba1e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:08.742400 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b24bd-25c1-419f-b017-243c558bba1e None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:08.743518 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b24bd-25c1-419f-b017-243c558bba1e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:08.744049 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b24bd-25c1-419f-b017-243c558bba1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:08.745695 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b24bd-25c1-419f-b017-243c558bba1e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:08.767094 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 481/983] 10.222.0.85 () {56 vars in 1149 bytes} [Thu Jun 16 14:44:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:08.773449 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8b435-c607-4e25-a1d2-d899c7c39e1f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:08.884607 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8b435-c607-4e25-a1d2-d899c7c39e1f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:08.922183 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b6b7b-5c7e-431e-ad4e-304ee172c33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:08.922873 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b6b7b-5c7e-431e-ad4e-304ee172c33f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:08.923157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b6b7b-5c7e-431e-ad4e-304ee172c33f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:08.923434 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b6b7b-5c7e-431e-ad4e-304ee172c33f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:08.975313 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:08.995470 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b6b7b-5c7e-431e-ad4e-304ee172c33f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:08.996897 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b6b7b-5c7e-431e-ad4e-304ee172c33f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:09.097680 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 503/984] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:44:08 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:44:09.103389 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b24bd-25c1-419f-b017-243c558bba1e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:09.187404 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:09.208279 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b24bd-25c1-419f-b017-243c558bba1e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:09.243776 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07053fcf-7b32-4426-8e16-a80ce96104a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:09.244824 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07053fcf-7b32-4426-8e16-a80ce96104a4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:09.245113 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07053fcf-7b32-4426-8e16-a80ce96104a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:09.245399 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07053fcf-7b32-4426-8e16-a80ce96104a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:09.255824 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07053fcf-7b32-4426-8e16-a80ce96104a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:09.257239 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07053fcf-7b32-4426-8e16-a80ce96104a4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:09.274951 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-07053fcf-7b32-4426-8e16-a80ce96104a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:09.274951 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:09.274951 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:09.274951 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:09.274951 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:09.274951 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:09.274951 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:09.274951 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:09.274951 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:09.274951 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:09.274951 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:09.274951 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:09.274951 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:09.274951 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:09.274951 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:09.276134 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:09.276134 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:09.276134 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:09.276134 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:09.276134 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:09.276134 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:09.276134 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:09.276134 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:09.276134 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:09.276134 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:09.276134 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:09.276134 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:09.276134 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:09.276134 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:09.276134 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:09.276134 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:09.276134 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:09.277490 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:09.277490 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:09.277490 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:09.277490 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:09.277490 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 482/985] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:09.281758 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b6b7b-5c7e-431e-ad4e-304ee172c33f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:09.365557 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:09.386656 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b6b7b-5c7e-431e-ad4e-304ee172c33f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:09.422442 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9da0cb-a658-4715-a2dd-f2ac782dc8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:09.423110 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9da0cb-a658-4715-a2dd-f2ac782dc8fb None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:09.423385 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9da0cb-a658-4715-a2dd-f2ac782dc8fb None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:09.423636 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9da0cb-a658-4715-a2dd-f2ac782dc8fb None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:09.424405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9da0cb-a658-4715-a2dd-f2ac782dc8fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:09.424714 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9da0cb-a658-4715-a2dd-f2ac782dc8fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:09.426089 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9da0cb-a658-4715-a2dd-f2ac782dc8fb None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:09.438860 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 504/986] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:09.444534 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07053fcf-7b32-4426-8e16-a80ce96104a4 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:09.550918 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07053fcf-7b32-4426-8e16-a80ce96104a4 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:09.587411 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:09.593837 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25212baa-d4d1-48f0-90d6-03963acf4ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:09.595152 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25212baa-d4d1-48f0-90d6-03963acf4ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:09.595425 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25212baa-d4d1-48f0-90d6-03963acf4ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:09.595701 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25212baa-d4d1-48f0-90d6-03963acf4ba2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:09.603295 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25212baa-d4d1-48f0-90d6-03963acf4ba2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:09.604773 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25212baa-d4d1-48f0-90d6-03963acf4ba2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:09.618625 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-25212baa-d4d1-48f0-90d6-03963acf4ba2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:09.618625 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:09.618625 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:09.618625 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:09.618625 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:09.618625 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:09.618625 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:09.618625 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:09.618625 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:09.618625 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:09.618625 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:09.618625 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:09.618625 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:44:09.618625 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:44:09.618625 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:44:09.619535 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:44:09.619535 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:09.619535 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:09.619535 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:09.619535 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:09.619535 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:09.619535 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:09.619535 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:09.619535 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:09.619535 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:09.619535 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:09.619535 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:09.619535 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:09.619535 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:09.619535 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:09.619535 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:09.619535 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:09.621022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:44:09.621022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:44:09.621022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:09.621022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:09.621022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:09.621022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:09.621022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:09.621022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:09.621022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 483/987] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:09.625531 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9da0cb-a658-4715-a2dd-f2ac782dc8fb None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:09.727231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9da0cb-a658-4715-a2dd-f2ac782dc8fb None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:09.761728 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1b115-db73-4460-8880-2066c1458c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:09.762391 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1b115-db73-4460-8880-2066c1458c15 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:09.762671 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1b115-db73-4460-8880-2066c1458c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:09.762946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1b115-db73-4460-8880-2066c1458c15 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:09.763734 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c1b115-db73-4460-8880-2066c1458c15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:09.764070 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c1b115-db73-4460-8880-2066c1458c15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:09.767268 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c1b115-db73-4460-8880-2066c1458c15 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:09.784741 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 505/988] 10.222.0.85 () {56 vars in 1148 bytes} [Thu Jun 16 14:44:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:09.790668 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25212baa-d4d1-48f0-90d6-03963acf4ba2 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:09.897695 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25212baa-d4d1-48f0-90d6-03963acf4ba2 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:09.937729 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb163969-49db-426f-8e12-76730c8d7ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:09.938420 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb163969-49db-426f-8e12-76730c8d7ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:09.938702 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb163969-49db-426f-8e12-76730c8d7ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:09.938980 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb163969-49db-426f-8e12-76730c8d7ce9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:09.939825 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb163969-49db-426f-8e12-76730c8d7ce9 None admin] RBAC: Adding query filter params (role.id=12e6cac1ace0476da69b56800ec15fbc, scope.project.id=80e309a3b3784ba9943734a41949b222, user.id=db4d36e6837d4b2fa4b7ee5c7243b6b3) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:09.940174 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb163969-49db-426f-8e12-76730c8d7ce9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:09.941658 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb163969-49db-426f-8e12-76730c8d7ce9 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:09.948649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 484/989] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:44:09 2022] GET /identity/v3/role_assignments?user.id=db4d36e6837d4b2fa4b7ee5c7243b6b3&scope.project.id=80e309a3b3784ba9943734a41949b222&role.id=12e6cac1ace0476da69b56800ec15fbc => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:10.483961 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22e661-f704-4cc0-83fb-bd29c0b25ed2 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:10.484553 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22e661-f704-4cc0-83fb-bd29c0b25ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:10.484553 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22e661-f704-4cc0-83fb-bd29c0b25ed2 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:10.486158 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 506/990] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:44:10.492559 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2f26c-27c8-4936-a979-afded40b11f5 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:10.493142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2f26c-27c8-4936-a979-afded40b11f5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:10.493709 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2f26c-27c8-4936-a979-afded40b11f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:10.515425 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-03b2f26c-27c8-4936-a979-afded40b11f5 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:10.517256 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-03b2f26c-27c8-4936-a979-afded40b11f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:10.583593 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:10.607921 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 485/991] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:10 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:44:10.629160 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22e661-f704-4cc0-83fb-bd29c0b25ed2 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:10.633090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:10.745292 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22e661-f704-4cc0-83fb-bd29c0b25ed2 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:10.783435 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d429bb-6495-488d-b0c5-63ce8ff8ce19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:10.784449 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d429bb-6495-488d-b0c5-63ce8ff8ce19 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:10.784866 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d429bb-6495-488d-b0c5-63ce8ff8ce19 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:10.785265 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d429bb-6495-488d-b0c5-63ce8ff8ce19 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:10.786053 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d429bb-6495-488d-b0c5-63ce8ff8ce19 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:10.787580 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d429bb-6495-488d-b0c5-63ce8ff8ce19 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:10.800302 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-a1d429bb-6495-488d-b0c5-63ce8ff8ce19 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 14:44:10.800302 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:10.800302 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:44:10.800302 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:44:10.800302 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:44:10.800302 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:44:10.800302 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:44:10.800302 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:10.800302 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 14:44:10.800302 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:10.800302 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:10.800302 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:10.800302 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:10.800302 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:10.800302 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:10.800302 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:10.800302 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:10.801333 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:10.801333 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:10.801333 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:10.801333 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:10.801333 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:10.801333 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:10.801333 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:44:10.801333 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:44:10.801333 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:44:10.801333 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:44:10.801333 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:10.801333 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:10.801333 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:10.801333 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:10.801333 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:10.801333 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:10.802177 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:10.802177 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:10.802177 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:10.802177 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:10.802177 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:10.802177 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:10.802177 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:10.802177 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:10.802177 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:10.802177 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:10.802177 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:44:10.802177 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:10.802177 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 14:44:10.802177 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:10.803963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 507/992] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:44:10.809979 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2f26c-27c8-4936-a979-afded40b11f5 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:10.940868 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2f26c-27c8-4936-a979-afded40b11f5 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:10.986151 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058a2b7-c123-495d-aa8c-257847aeef60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:10.987238 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058a2b7-c123-495d-aa8c-257847aeef60 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:10.987747 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058a2b7-c123-495d-aa8c-257847aeef60 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:10.988270 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058a2b7-c123-495d-aa8c-257847aeef60 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:10.989196 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058a2b7-c123-495d-aa8c-257847aeef60 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:10.989703 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058a2b7-c123-495d-aa8c-257847aeef60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:10.991299 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058a2b7-c123-495d-aa8c-257847aeef60 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:10.997232 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 486/993] 10.222.0.85 () {56 vars in 1112 bytes} [Thu Jun 16 14:44:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:11.003121 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d429bb-6495-488d-b0c5-63ce8ff8ce19 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:11.036249 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e998276-4fd6-41b6-aa7d-175d6b40eeb8 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:11.036523 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e998276-4fd6-41b6-aa7d-175d6b40eeb8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:11.036813 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e998276-4fd6-41b6-aa7d-175d6b40eeb8 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:11.040544 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 487/994] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:44:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:44:11.048596 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e6120-480c-4f19-a106-463bfdf6bcf7 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:11.048892 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e6120-480c-4f19-a106-463bfdf6bcf7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:11.049153 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e6120-480c-4f19-a106-463bfdf6bcf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:11.066263 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-8a3e6120-480c-4f19-a106-463bfdf6bcf7 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:11.067468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8a3e6120-480c-4f19-a106-463bfdf6bcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:11.081427 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:11.125073 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:11.126420 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d429bb-6495-488d-b0c5-63ce8ff8ce19 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:11.153508 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 488/995] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:44:11.171755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a213a56-906a-485a-9e1c-86f8df73b66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:11.172462 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a213a56-906a-485a-9e1c-86f8df73b66f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:11.172737 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a213a56-906a-485a-9e1c-86f8df73b66f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:11.173008 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a213a56-906a-485a-9e1c-86f8df73b66f None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:11.173722 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a213a56-906a-485a-9e1c-86f8df73b66f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:11.174040 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a213a56-906a-485a-9e1c-86f8df73b66f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:11.175781 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a213a56-906a-485a-9e1c-86f8df73b66f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:11.176810 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e6120-480c-4f19-a106-463bfdf6bcf7 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:11.188134 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 508/996] 10.222.0.85 () {56 vars in 1112 bytes} [Thu Jun 16 14:44:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:11.189711 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a213a56-906a-485a-9e1c-86f8df73b66f None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:11.293448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e6120-480c-4f19-a106-463bfdf6bcf7 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:11.299132 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a213a56-906a-485a-9e1c-86f8df73b66f None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:11.329122 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:11.329816 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe357f9-dc30-4596-a336-59a787c442d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:11.330996 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe357f9-dc30-4596-a336-59a787c442d4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:11.331302 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe357f9-dc30-4596-a336-59a787c442d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:11.331653 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe357f9-dc30-4596-a336-59a787c442d4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:11.332451 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe357f9-dc30-4596-a336-59a787c442d4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:11.333836 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe357f9-dc30-4596-a336-59a787c442d4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:11.337011 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a5edb-8484-4ca0-84aa-f0b60bf2b760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:11.337681 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a5edb-8484-4ca0-84aa-f0b60bf2b760 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:11.337961 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a5edb-8484-4ca0-84aa-f0b60bf2b760 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:11.338232 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a5edb-8484-4ca0-84aa-f0b60bf2b760 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:11.339022 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a5edb-8484-4ca0-84aa-f0b60bf2b760 None admin] RBAC: Adding query filter params (interface=public, service_id=8cc461e4aa0f459b900f104a6ec7c192, region_id=RegionOne) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:11.339328 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a5edb-8484-4ca0-84aa-f0b60bf2b760 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:11.340724 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a5edb-8484-4ca0-84aa-f0b60bf2b760 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:11.350602 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 509/997] 10.222.0.85 () {56 vars in 1251 bytes} [Thu Jun 16 14:44:11 2022] GET /identity/v3/endpoints?service_id=8cc461e4aa0f459b900f104a6ec7c192&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:11.350775 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-ffe357f9-dc30-4596-a336-59a787c442d4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:44:11.350775 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:11.350775 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:44:11.350775 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:44:11.350775 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:44:11.350775 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:44:11.350775 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:44:11.350775 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:11.350775 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:44:11.350775 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:11.350775 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:11.350775 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:11.350775 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:11.350775 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:11.350775 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:11.350775 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:11.350775 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:11.351762 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:11.351762 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:11.351762 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:11.351762 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:11.351762 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:11.351762 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:11.351762 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:44:11.351762 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:44:11.351762 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:44:11.351762 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:44:11.351762 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:11.351762 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:11.351762 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:11.351762 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:11.351762 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:11.351762 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:11.352673 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:11.352673 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:11.352673 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:11.352673 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:11.352673 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:11.352673 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:11.352673 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:11.352673 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:11.352673 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:11.352673 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:11.352673 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:44:11.352673 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:11.352673 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:44:11.352673 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:11.352673 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 489/998] 10.222.0.85 () {56 vars in 1126 bytes} [Thu Jun 16 14:44:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:44:11.353500 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a5edb-8484-4ca0-84aa-f0b60bf2b760 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:11.357850 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe357f9-dc30-4596-a336-59a787c442d4 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:11.411499 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:11.465819 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a5edb-8484-4ca0-84aa-f0b60bf2b760 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:11.481277 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe357f9-dc30-4596-a336-59a787c442d4 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:11.518053 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0485ffe-6247-46a0-aa8a-99b297d25457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:11.518053 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0485ffe-6247-46a0-aa8a-99b297d25457 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:11.518053 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0485ffe-6247-46a0-aa8a-99b297d25457 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:11.518053 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0485ffe-6247-46a0-aa8a-99b297d25457 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:11.518849 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0485ffe-6247-46a0-aa8a-99b297d25457 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:11.518849 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0485ffe-6247-46a0-aa8a-99b297d25457 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:11.522912 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b24dd-698b-4e91-a588-88f5636404b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:11.523841 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b24dd-698b-4e91-a588-88f5636404b4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:11.524293 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b24dd-698b-4e91-a588-88f5636404b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:11.524667 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b24dd-698b-4e91-a588-88f5636404b4 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:11.535902 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 510/999] 10.222.0.85 () {56 vars in 1087 bytes} [Thu Jun 16 14:44:11 2022] GET /identity/v3/services => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:44:11.536148 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b24dd-698b-4e91-a588-88f5636404b4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:11.536148 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b24dd-698b-4e91-a588-88f5636404b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:11.536148 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b24dd-698b-4e91-a588-88f5636404b4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:11.536148 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 490/1000] 10.222.0.85 () {56 vars in 1122 bytes} [Thu Jun 16 14:44:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:11.539038 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0485ffe-6247-46a0-aa8a-99b297d25457 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:11.612116 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:11.659697 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0485ffe-6247-46a0-aa8a-99b297d25457 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:11.697142 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c0a11-18f5-4e6a-888f-795fdbda5611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:11.698391 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c0a11-18f5-4e6a-888f-795fdbda5611 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:11.698391 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c0a11-18f5-4e6a-888f-795fdbda5611 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:11.698391 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c0a11-18f5-4e6a-888f-795fdbda5611 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:11.699107 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c0a11-18f5-4e6a-888f-795fdbda5611 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:11.699414 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c0a11-18f5-4e6a-888f-795fdbda5611 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:11.700811 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c0a11-18f5-4e6a-888f-795fdbda5611 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:11.712516 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 511/1001] 10.222.0.85 () {56 vars in 1122 bytes} [Thu Jun 16 14:44:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:11.719809 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b24dd-698b-4e91-a588-88f5636404b4 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:11.829790 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b24dd-698b-4e91-a588-88f5636404b4 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:11.839356 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:11.865546 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975950e4-4b5f-4f7d-938c-929780a528eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:11.866214 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975950e4-4b5f-4f7d-938c-929780a528eb None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:11.866483 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975950e4-4b5f-4f7d-938c-929780a528eb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:11.866759 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975950e4-4b5f-4f7d-938c-929780a528eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:11.867581 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975950e4-4b5f-4f7d-938c-929780a528eb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:11.869004 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975950e4-4b5f-4f7d-938c-929780a528eb None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:11.891915 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 491/1002] 10.222.0.85 () {60 vars in 1144 bytes} [Thu Jun 16 14:44:11 2022] POST /identity/v3/endpoints => generated 325 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:44:12.201090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b2db1-45dd-463f-a035-d4f38c57d011 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:12.201276 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b2db1-45dd-463f-a035-d4f38c57d011 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:12.201554 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b2db1-45dd-463f-a035-d4f38c57d011 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:12.202946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 512/1003] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:12.208779 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797499a-e198-4854-9da9-fd330bbe5a4c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:12.209139 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797499a-e198-4854-9da9-fd330bbe5a4c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:12.209424 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797499a-e198-4854-9da9-fd330bbe5a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:12.227742 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-0797499a-e198-4854-9da9-fd330bbe5a4c None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:12.228997 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0797499a-e198-4854-9da9-fd330bbe5a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:12.311900 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 492/1004] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:12 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:12.334262 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b2db1-45dd-463f-a035-d4f38c57d011 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:12.447679 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b2db1-45dd-463f-a035-d4f38c57d011 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:12.474822 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:12.488527 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61687da2-a325-4009-b70c-bff9ddbe88fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:12.489327 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61687da2-a325-4009-b70c-bff9ddbe88fe None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:12.489623 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61687da2-a325-4009-b70c-bff9ddbe88fe None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:12.489925 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61687da2-a325-4009-b70c-bff9ddbe88fe None admin] PATH_INFO: `/v3/services/image` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:12.490604 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61687da2-a325-4009-b70c-bff9ddbe88fe None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:12.492164 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61687da2-a325-4009-b70c-bff9ddbe88fe None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:12.510678 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-61687da2-a325-4009-b70c-bff9ddbe88fe None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 14:44:12.510678 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:12.510678 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:44:12.510678 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:44:12.510678 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:44:12.510678 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:44:12.510678 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:44:12.510678 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:12.510678 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 14:44:12.510678 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:12.510678 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:12.510678 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:12.510678 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:12.510678 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:12.510678 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:12.510678 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:12.510678 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:12.511762 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:12.511762 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:12.511762 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:12.511762 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:12.511762 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:12.511762 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:12.511762 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:44:12.511762 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:44:12.511762 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:44:12.511762 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:44:12.511762 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:12.511762 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:12.511762 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:12.511762 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:12.511762 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:12.511762 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:12.519363 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:12.519363 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:12.519363 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:12.519363 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:12.519363 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:12.519363 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:12.519363 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:12.519363 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:12.519363 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:12.519363 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:12.519363 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:44:12.519363 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:12.519363 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 14:44:12.519363 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:12.519363 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 513/1005] 10.222.0.85 () {56 vars in 1105 bytes} [Thu Jun 16 14:44:12 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:12.521619 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797499a-e198-4854-9da9-fd330bbe5a4c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:12.653968 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:12.662613 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797499a-e198-4854-9da9-fd330bbe5a4c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:12.703250 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ada93-77d9-422a-930d-6d37d9171cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:12.704327 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ada93-77d9-422a-930d-6d37d9171cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:12.704813 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ada93-77d9-422a-930d-6d37d9171cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:12.705186 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ada93-77d9-422a-930d-6d37d9171cd6 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:12.706123 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ada93-77d9-422a-930d-6d37d9171cd6 None admin] RBAC: Adding query filter params (name=image) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:12.706642 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ada93-77d9-422a-930d-6d37d9171cd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:12.711797 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ada93-77d9-422a-930d-6d37d9171cd6 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:12.717308 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 493/1006] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:12.723062 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61687da2-a325-4009-b70c-bff9ddbe88fe None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:12.873162 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61687da2-a325-4009-b70c-bff9ddbe88fe None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:12.912138 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1660c2e-333c-443c-9c82-e2d24c0b0a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:12.912823 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1660c2e-333c-443c-9c82-e2d24c0b0a10 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:12.913100 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1660c2e-333c-443c-9c82-e2d24c0b0a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:12.913368 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1660c2e-333c-443c-9c82-e2d24c0b0a10 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:12.914097 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1660c2e-333c-443c-9c82-e2d24c0b0a10 None admin] RBAC: Adding query filter params (type=image) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:12.914630 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1660c2e-333c-443c-9c82-e2d24c0b0a10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:12.917141 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1660c2e-333c-443c-9c82-e2d24c0b0a10 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:12.923415 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 514/1007] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:12 2022] GET /identity/v3/services?type=image => generated 122 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:13.726375 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2af988-892a-4000-b055-19f42b2f2d0d None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:13.727243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2af988-892a-4000-b055-19f42b2f2d0d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:13.727617 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2af988-892a-4000-b055-19f42b2f2d0d None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:13.729605 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 494/1008] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:44:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:13.735208 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8a1ab-c8ab-408c-bb34-f5cdd3de245a None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:13.735704 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8a1ab-c8ab-408c-bb34-f5cdd3de245a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:13.735921 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8a1ab-c8ab-408c-bb34-f5cdd3de245a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:13.753167 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-85a8a1ab-c8ab-408c-bb34-f5cdd3de245a None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:13.754355 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-85a8a1ab-c8ab-408c-bb34-f5cdd3de245a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:13.806049 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:13.835277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 515/1009] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:13 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:13.859814 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2af988-892a-4000-b055-19f42b2f2d0d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:13.963345 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2af988-892a-4000-b055-19f42b2f2d0d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:13.997939 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e8f81-4484-40ec-8868-d12b47bddb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:13.998747 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e8f81-4484-40ec-8868-d12b47bddb1f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:13.999028 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e8f81-4484-40ec-8868-d12b47bddb1f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:13.999305 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e8f81-4484-40ec-8868-d12b47bddb1f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:13.999973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e8f81-4484-40ec-8868-d12b47bddb1f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:14.001344 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e8f81-4484-40ec-8868-d12b47bddb1f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:14.013289 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-0f1e8f81-4484-40ec-8868-d12b47bddb1f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 14:44:14.013289 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:14.013289 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:44:14.013289 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:44:14.013289 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:44:14.013289 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:44:14.013289 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:44:14.013289 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:14.013289 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 14:44:14.013289 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:14.013289 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:14.013289 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:14.013289 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:14.013289 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:14.013289 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:14.013289 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:14.013289 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:14.014321 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:14.014321 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:14.014321 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:14.014321 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:14.014321 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:14.014321 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:14.014321 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:44:14.014321 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:44:14.014321 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:44:14.014321 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:44:14.014321 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:14.014321 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:14.014321 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:14.014321 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:14.014321 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:14.014321 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:14.015175 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:14.015175 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:14.015175 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:14.015175 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:14.015175 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:14.015175 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:14.015175 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:14.015175 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:14.015175 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:14.015175 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:14.015175 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:44:14.015175 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:14.015175 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 14:44:14.015175 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:14.016681 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 495/1010] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:14.020499 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8a1ab-c8ab-408c-bb34-f5cdd3de245a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:14.112991 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114e465-0726-419b-983c-94a51f4d40e0 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:14.113172 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114e465-0726-419b-983c-94a51f4d40e0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:14.113564 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114e465-0726-419b-983c-94a51f4d40e0 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:14.115094 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 496/1011] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:14.121034 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbd413-2feb-4efa-9057-a1cbb94dec1a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:14.121317 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbd413-2feb-4efa-9057-a1cbb94dec1a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:14.121589 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbd413-2feb-4efa-9057-a1cbb94dec1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:14.132178 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8a1ab-c8ab-408c-bb34-f5cdd3de245a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:14.140282 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-65cbd413-2feb-4efa-9057-a1cbb94dec1a None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:14.142026 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-65cbd413-2feb-4efa-9057-a1cbb94dec1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:14.167207 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:14.171621 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47347ce2-c9b8-4f54-afee-205df899880d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:14.172342 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47347ce2-c9b8-4f54-afee-205df899880d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:14.172674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47347ce2-c9b8-4f54-afee-205df899880d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:14.172953 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47347ce2-c9b8-4f54-afee-205df899880d None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:14.173688 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47347ce2-c9b8-4f54-afee-205df899880d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:14.174008 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47347ce2-c9b8-4f54-afee-205df899880d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:14.175405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47347ce2-c9b8-4f54-afee-205df899880d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:14.186002 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 516/1012] 10.222.0.85 () {56 vars in 1112 bytes} [Thu Jun 16 14:44:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:14.186920 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47347ce2-c9b8-4f54-afee-205df899880d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:14.247896 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:14.248096 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 497/1013] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:14 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:14.262242 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbd413-2feb-4efa-9057-a1cbb94dec1a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:14.300308 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47347ce2-c9b8-4f54-afee-205df899880d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:14.336407 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361dbcc5-fdfb-4a8c-95eb-24b5bc0fca09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:14.337150 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361dbcc5-fdfb-4a8c-95eb-24b5bc0fca09 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:14.337438 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361dbcc5-fdfb-4a8c-95eb-24b5bc0fca09 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:14.337718 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361dbcc5-fdfb-4a8c-95eb-24b5bc0fca09 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:14.338723 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361dbcc5-fdfb-4a8c-95eb-24b5bc0fca09 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:14.338723 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361dbcc5-fdfb-4a8c-95eb-24b5bc0fca09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:14.340122 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361dbcc5-fdfb-4a8c-95eb-24b5bc0fca09 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:14.345241 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 517/1014] 10.222.0.85 () {56 vars in 1112 bytes} [Thu Jun 16 14:44:14 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:14.350639 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361dbcc5-fdfb-4a8c-95eb-24b5bc0fca09 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:14.371970 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbd413-2feb-4efa-9057-a1cbb94dec1a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:14.410341 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b48877-771c-4cbc-a895-879121dfe8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:14.411301 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b48877-771c-4cbc-a895-879121dfe8c1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:14.411579 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b48877-771c-4cbc-a895-879121dfe8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:14.411844 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b48877-771c-4cbc-a895-879121dfe8c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:14.413171 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b48877-771c-4cbc-a895-879121dfe8c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:14.414995 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b48877-771c-4cbc-a895-879121dfe8c1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:14.416840 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 498/1015] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:14.422656 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b48877-771c-4cbc-a895-879121dfe8c1 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:14.445662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:14.457339 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361dbcc5-fdfb-4a8c-95eb-24b5bc0fca09 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:14.467770 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:14.503704 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c30bb9-a27b-4dc2-821a-6c85759aac1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:14.504403 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c30bb9-a27b-4dc2-821a-6c85759aac1b None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:14.504689 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c30bb9-a27b-4dc2-821a-6c85759aac1b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:14.504965 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c30bb9-a27b-4dc2-821a-6c85759aac1b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:14.505973 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c30bb9-a27b-4dc2-821a-6c85759aac1b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:14.507183 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c30bb9-a27b-4dc2-821a-6c85759aac1b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:14.530456 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 518/1016] 10.222.0.85 () {60 vars in 1144 bytes} [Thu Jun 16 14:44:14 2022] POST /identity/v3/endpoints => generated 334 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:44:14.540647 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b48877-771c-4cbc-a895-879121dfe8c1 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:14.593134 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07a074-95ef-45c1-b17b-1db6d79cebb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:14.593829 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07a074-95ef-45c1-b17b-1db6d79cebb8 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:14.594115 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07a074-95ef-45c1-b17b-1db6d79cebb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:14.594394 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07a074-95ef-45c1-b17b-1db6d79cebb8 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:14.595122 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07a074-95ef-45c1-b17b-1db6d79cebb8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:14.596689 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07a074-95ef-45c1-b17b-1db6d79cebb8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:14.626323 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 499/1017] 10.222.0.85 () {60 vars in 1141 bytes} [Thu Jun 16 14:44:14 2022] POST /identity/v3/projects => generated 311 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:44:15.091341 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd06386-48f9-496f-897d-2b4a2e9ded1a None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:15.091911 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd06386-48f9-496f-897d-2b4a2e9ded1a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:15.091911 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd06386-48f9-496f-897d-2b4a2e9ded1a None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:15.096018 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 519/1018] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:15.098813 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1a8f4-b13c-4157-a9db-d63d3ac85fc2 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:15.099233 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1a8f4-b13c-4157-a9db-d63d3ac85fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:15.099414 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1a8f4-b13c-4157-a9db-d63d3ac85fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:15.118939 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d5e1a8f4-b13c-4157-a9db-d63d3ac85fc2 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:15.120183 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d5e1a8f4-b13c-4157-a9db-d63d3ac85fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:15.188011 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:15.194835 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 500/1019] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:15 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:15.217038 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd06386-48f9-496f-897d-2b4a2e9ded1a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:15.325208 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd06386-48f9-496f-897d-2b4a2e9ded1a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:15.360140 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388f9ce-24e2-4398-953e-2d10de6c831c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:15.360722 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388f9ce-24e2-4398-953e-2d10de6c831c None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:15.360996 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388f9ce-24e2-4398-953e-2d10de6c831c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:15.361268 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388f9ce-24e2-4398-953e-2d10de6c831c None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:15.361996 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2388f9ce-24e2-4398-953e-2d10de6c831c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:15.363364 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2388f9ce-24e2-4398-953e-2d10de6c831c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:15.383897 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 520/1020] 10.222.0.85 () {60 vars in 1141 bytes} [Thu Jun 16 14:44:15 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:44:16.802478 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24c5ac-5999-42ed-b510-b8217803f5b9 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:16.803042 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24c5ac-5999-42ed-b510-b8217803f5b9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:16.803042 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24c5ac-5999-42ed-b510-b8217803f5b9 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:16.804669 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 501/1021] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:16.810401 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724fe5a-871d-41bb-bdfc-af13f4e8e457 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:16.810929 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724fe5a-871d-41bb-bdfc-af13f4e8e457 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:16.811167 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724fe5a-871d-41bb-bdfc-af13f4e8e457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:16.830037 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-4724fe5a-871d-41bb-bdfc-af13f4e8e457 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:16.831274 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4724fe5a-871d-41bb-bdfc-af13f4e8e457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:16.853439 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:16.886287 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6624e7-16cc-4925-a6e0-f06192128ed1 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:16.886594 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6624e7-16cc-4925-a6e0-f06192128ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:16.886997 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6624e7-16cc-4925-a6e0-f06192128ed1 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:16.888482 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 502/1022] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:16.894502 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6047c01-a125-4193-9efb-5a1c3459cdd2 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:16.894789 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6047c01-a125-4193-9efb-5a1c3459cdd2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:16.895101 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6047c01-a125-4193-9efb-5a1c3459cdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:16.912888 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b6047c01-a125-4193-9efb-5a1c3459cdd2 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:16.914434 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b6047c01-a125-4193-9efb-5a1c3459cdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:16.917365 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 521/1023] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:16.941701 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724fe5a-871d-41bb-bdfc-af13f4e8e457 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:16.994196 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 503/1024] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:44:17.024942 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6047c01-a125-4193-9efb-5a1c3459cdd2 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:17.069160 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724fe5a-871d-41bb-bdfc-af13f4e8e457 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:17.109458 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219b934-fcbc-40cf-8caf-c3a08b3caf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:17.110777 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219b934-fcbc-40cf-8caf-c3a08b3caf4b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:17.111258 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219b934-fcbc-40cf-8caf-c3a08b3caf4b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:17.111785 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219b934-fcbc-40cf-8caf-c3a08b3caf4b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:17.123538 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219b934-fcbc-40cf-8caf-c3a08b3caf4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:17.129295 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6047c01-a125-4193-9efb-5a1c3459cdd2 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:17.132357 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-c219b934-fcbc-40cf-8caf-c3a08b3caf4b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 14:44:17.132357 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:17.132357 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:17.132357 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:17.132357 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:17.132357 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:17.132357 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:17.132357 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:17.132357 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:17.132357 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:17.132357 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:17.132357 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:17.132357 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:17.132357 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:17.132357 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:17.132357 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:17.133938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:17.133938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:17.133938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:17.133938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:17.133938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:17.133938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:17.133938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:17.133938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:17.133938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:17.133938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:17.133938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:17.133938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:17.133938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:17.133938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:17.133938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:17.133938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:17.134788 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:17.134788 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:17.134788 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:17.134788 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:17.134788 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:17.134788 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:17.134788 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:17.134788 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:17.134788 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:17.134788 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:17.134788 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 14:44:17.134788 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:17.138941 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 522/1025] 10.222.0.85 () {56 vars in 1120 bytes} [Thu Jun 16 14:44:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:17.140033 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219b934-fcbc-40cf-8caf-c3a08b3caf4b None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:17.154568 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:17.158662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:17.167932 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326045c9-7bd8-446f-981e-1130b806c1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:17.168748 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326045c9-7bd8-446f-981e-1130b806c1ac None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:17.169030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326045c9-7bd8-446f-981e-1130b806c1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:17.169303 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326045c9-7bd8-446f-981e-1130b806c1ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:17.170470 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326045c9-7bd8-446f-981e-1130b806c1ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:17.172310 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326045c9-7bd8-446f-981e-1130b806c1ac None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:17.173961 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 504/1026] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:17.180107 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326045c9-7bd8-446f-981e-1130b806c1ac None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:17.253659 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219b934-fcbc-40cf-8caf-c3a08b3caf4b None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:17.290972 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326045c9-7bd8-446f-981e-1130b806c1ac None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:17.291211 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ec568-29ac-40fc-9722-a2d15ebecf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:17.291858 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ec568-29ac-40fc-9722-a2d15ebecf2c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:17.292166 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ec568-29ac-40fc-9722-a2d15ebecf2c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:17.292540 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ec568-29ac-40fc-9722-a2d15ebecf2c None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:17.293247 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ec568-29ac-40fc-9722-a2d15ebecf2c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:17.294275 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ec568-29ac-40fc-9722-a2d15ebecf2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:17.294938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ec568-29ac-40fc-9722-a2d15ebecf2c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:17.308801 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 523/1027] 10.222.0.85 () {56 vars in 1115 bytes} [Thu Jun 16 14:44:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:17.310184 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ec568-29ac-40fc-9722-a2d15ebecf2c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:17.330655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a83d3e-e993-4914-bf62-0e93c94e8080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:17.331358 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a83d3e-e993-4914-bf62-0e93c94e8080 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:17.331652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a83d3e-e993-4914-bf62-0e93c94e8080 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:17.331951 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a83d3e-e993-4914-bf62-0e93c94e8080 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:17.332675 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a83d3e-e993-4914-bf62-0e93c94e8080 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:17.334134 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a83d3e-e993-4914-bf62-0e93c94e8080 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:17.356918 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 505/1028] 10.222.0.85 () {60 vars in 1132 bytes} [Thu Jun 16 14:44:17 2022] POST /identity/v3/users => generated 285 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:44:17.388611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:17.424622 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ec568-29ac-40fc-9722-a2d15ebecf2c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:17.465076 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145c98f-f1f3-44fb-b455-148ae2bf02cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:17.465901 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145c98f-f1f3-44fb-b455-148ae2bf02cb None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:17.466179 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145c98f-f1f3-44fb-b455-148ae2bf02cb None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:17.466450 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145c98f-f1f3-44fb-b455-148ae2bf02cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:17.479504 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8145c98f-f1f3-44fb-b455-148ae2bf02cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:17.481114 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8145c98f-f1f3-44fb-b455-148ae2bf02cb None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:17.501481 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-8145c98f-f1f3-44fb-b455-148ae2bf02cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:17.501481 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:17.501481 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:17.501481 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:17.501481 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:17.501481 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:17.501481 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:17.501481 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:17.501481 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:17.501481 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:17.501481 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:17.501481 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:17.501481 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:17.501481 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:17.501481 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:17.502519 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:17.502519 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:17.502519 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:17.502519 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:17.502519 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:17.502519 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:17.502519 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:17.502519 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:17.502519 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:17.502519 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:17.502519 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:17.502519 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:17.502519 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:17.502519 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:17.502519 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:17.502519 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:17.502519 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:17.509354 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:17.509354 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:17.509354 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:17.509354 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:17.509354 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 524/1029] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:17.509695 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a83d3e-e993-4914-bf62-0e93c94e8080 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:17.549072 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58414c-44cb-45f5-be6d-fa7ed2a1719d None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:17.549357 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58414c-44cb-45f5-be6d-fa7ed2a1719d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:17.549626 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58414c-44cb-45f5-be6d-fa7ed2a1719d None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:17.551045 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 525/1030] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:44:17.556656 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11712d1-f1c1-4d7c-bde9-2ae4c3e409c0 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:17.556938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11712d1-f1c1-4d7c-bde9-2ae4c3e409c0 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:17.557231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11712d1-f1c1-4d7c-bde9-2ae4c3e409c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:17.571389 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:17.578431 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d11712d1-f1c1-4d7c-bde9-2ae4c3e409c0 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:17.579780 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d11712d1-f1c1-4d7c-bde9-2ae4c3e409c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:17.631596 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a83d3e-e993-4914-bf62-0e93c94e8080 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:17.672079 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 526/1031] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:17.675009 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d6ef9-5ec5-41d6-a27a-cd1db02160e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:17.675913 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d6ef9-5ec5-41d6-a27a-cd1db02160e2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:17.676284 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d6ef9-5ec5-41d6-a27a-cd1db02160e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:17.676643 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d6ef9-5ec5-41d6-a27a-cd1db02160e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:17.677605 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d6ef9-5ec5-41d6-a27a-cd1db02160e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:17.678004 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d6ef9-5ec5-41d6-a27a-cd1db02160e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:17.680382 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d6ef9-5ec5-41d6-a27a-cd1db02160e2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:17.689186 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11712d1-f1c1-4d7c-bde9-2ae4c3e409c0 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:17.698298 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 506/1032] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:17.705544 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d6ef9-5ec5-41d6-a27a-cd1db02160e2 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:17.754969 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:17.810747 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11712d1-f1c1-4d7c-bde9-2ae4c3e409c0 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:17.829055 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d6ef9-5ec5-41d6-a27a-cd1db02160e2 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:17.843607 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:17.850969 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864f781-9248-4b1c-b7b8-6adf321384d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:17.852042 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864f781-9248-4b1c-b7b8-6adf321384d5 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:17.852360 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864f781-9248-4b1c-b7b8-6adf321384d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:17.852599 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864f781-9248-4b1c-b7b8-6adf321384d5 None admin] PATH_INFO: `/v3/services/image` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:17.853256 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864f781-9248-4b1c-b7b8-6adf321384d5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:17.854682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864f781-9248-4b1c-b7b8-6adf321384d5 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:17.867855 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-a864f781-9248-4b1c-b7b8-6adf321384d5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 14:44:17.867855 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:17.867855 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:44:17.867855 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:44:17.867855 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:44:17.867855 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:44:17.867855 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:44:17.867855 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:17.867855 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 14:44:17.867855 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:17.867855 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:17.867855 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:17.867855 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:17.867855 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:17.867855 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:17.867855 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:17.867855 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:17.869001 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:17.869001 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:17.869001 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:17.869001 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:17.869001 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:17.869001 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:17.869001 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:44:17.869001 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:44:17.869001 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:44:17.869001 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:44:17.869001 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:17.869001 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:17.869001 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:17.869001 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:17.869001 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:17.869001 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:17.869889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:17.869889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:17.869889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:17.869889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:17.869889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:17.869889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:17.869889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:17.869889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:17.869889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:17.869889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:17.869889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:44:17.869889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:17.869889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 14:44:17.869889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:17.869889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 527/1033] 10.222.0.85 () {56 vars in 1105 bytes} [Thu Jun 16 14:44:17 2022] GET /identity/v3/services/image => generated 86 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:17.874776 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194283ff-c79a-4b37-a733-5cacff530da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:17.875101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864f781-9248-4b1c-b7b8-6adf321384d5 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:17.875619 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194283ff-c79a-4b37-a733-5cacff530da8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:17.875934 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194283ff-c79a-4b37-a733-5cacff530da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:17.876341 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194283ff-c79a-4b37-a733-5cacff530da8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:17.888996 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194283ff-c79a-4b37-a733-5cacff530da8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:17.890441 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194283ff-c79a-4b37-a733-5cacff530da8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:17.906085 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-194283ff-c79a-4b37-a733-5cacff530da8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:44:17.906085 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:17.906085 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:17.906085 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:17.906085 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:17.906085 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:17.906085 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:17.906085 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:17.906085 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:17.906085 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:17.906085 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:17.906085 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:17.906085 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:44:17.906085 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:44:17.906085 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:44:17.906085 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:44:17.907099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:17.907099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:17.907099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:17.907099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:17.907099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:17.907099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:17.907099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:17.907099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:17.907099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:17.907099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:17.907099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:17.907099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:17.907099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:17.907099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:17.907099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:17.907099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:17.907099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:17.907099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:17.908489 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:17.908489 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:17.908489 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:44:17.908489 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:44:17.908489 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:44:17.908489 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:44:17.908489 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:44:17.908489 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:44:17.908489 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:44:17.908489 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:17.908489 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 507/1034] 10.222.0.85 () {56 vars in 1093 bytes} [Thu Jun 16 14:44:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:44:17.913225 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194283ff-c79a-4b37-a733-5cacff530da8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:17.989526 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864f781-9248-4b1c-b7b8-6adf321384d5 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:18.009578 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:18.027480 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194283ff-c79a-4b37-a733-5cacff530da8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:18.029886 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41c56c-19e6-46d8-a7e7-dc988a22d434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:18.030593 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41c56c-19e6-46d8-a7e7-dc988a22d434 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:18.030861 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41c56c-19e6-46d8-a7e7-dc988a22d434 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:18.031119 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41c56c-19e6-46d8-a7e7-dc988a22d434 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:18.031818 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41c56c-19e6-46d8-a7e7-dc988a22d434 None admin] RBAC: Adding query filter params (name=image) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:18.032150 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41c56c-19e6-46d8-a7e7-dc988a22d434 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:18.033532 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41c56c-19e6-46d8-a7e7-dc988a22d434 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:18.039081 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 528/1035] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:18.045172 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41c56c-19e6-46d8-a7e7-dc988a22d434 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:18.073840 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045b054-e3a2-4c76-b2c7-855e55043a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:18.074598 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045b054-e3a2-4c76-b2c7-855e55043a16 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:18.074882 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045b054-e3a2-4c76-b2c7-855e55043a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:18.075158 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045b054-e3a2-4c76-b2c7-855e55043a16 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:18.076104 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045b054-e3a2-4c76-b2c7-855e55043a16 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:18.076448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045b054-e3a2-4c76-b2c7-855e55043a16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:18.077918 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045b054-e3a2-4c76-b2c7-855e55043a16 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:18.105365 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 508/1036] 10.222.0.85 () {56 vars in 1133 bytes} [Thu Jun 16 14:44:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:18.106505 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045b054-e3a2-4c76-b2c7-855e55043a16 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:18.139566 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:18.157009 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41c56c-19e6-46d8-a7e7-dc988a22d434 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:18.197920 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be131c83-bd86-4e97-9c53-868703589910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:18.198857 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be131c83-bd86-4e97-9c53-868703589910 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:18.198857 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be131c83-bd86-4e97-9c53-868703589910 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:18.199134 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be131c83-bd86-4e97-9c53-868703589910 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:18.199836 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be131c83-bd86-4e97-9c53-868703589910 None admin] RBAC: Adding query filter params (type=image) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:18.200193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be131c83-bd86-4e97-9c53-868703589910 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:18.201609 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be131c83-bd86-4e97-9c53-868703589910 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:18.207478 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 529/1037] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:18.214360 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be131c83-bd86-4e97-9c53-868703589910 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:18.219604 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045b054-e3a2-4c76-b2c7-855e55043a16 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:18.256687 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4498a4f-6270-4ee8-a3b6-0f07ed043c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:18.257262 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4498a4f-6270-4ee8-a3b6-0f07ed043c7c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:18.257518 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4498a4f-6270-4ee8-a3b6-0f07ed043c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:18.257984 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4498a4f-6270-4ee8-a3b6-0f07ed043c7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:18.267140 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:18.329759 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be131c83-bd86-4e97-9c53-868703589910 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:18.331449 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4498a4f-6270-4ee8-a3b6-0f07ed043c7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:18.333774 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4498a4f-6270-4ee8-a3b6-0f07ed043c7c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:18.376119 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974eab91-a423-4a9b-826e-d5ec4105126c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:18.376823 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974eab91-a423-4a9b-826e-d5ec4105126c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:18.377100 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974eab91-a423-4a9b-826e-d5ec4105126c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:18.377377 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974eab91-a423-4a9b-826e-d5ec4105126c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:18.378189 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974eab91-a423-4a9b-826e-d5ec4105126c None admin] RBAC: Adding query filter params (interface=public, service_id=a2641a862f75484098d999af06302704, region_id=RegionOne) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:18.378514 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974eab91-a423-4a9b-826e-d5ec4105126c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:18.379139 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:18.380286 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974eab91-a423-4a9b-826e-d5ec4105126c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:18.386528 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 530/1038] 10.222.0.85 () {56 vars in 1251 bytes} [Thu Jun 16 14:44:18 2022] GET /identity/v3/endpoints?service_id=a2641a862f75484098d999af06302704&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:18.392819 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974eab91-a423-4a9b-826e-d5ec4105126c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:18.468299 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 509/1039] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:44:18 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 14:44:18.474409 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4498a4f-6270-4ee8-a3b6-0f07ed043c7c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:18.513390 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974eab91-a423-4a9b-826e-d5ec4105126c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:18.530807 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:18.564528 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec968da3-6387-4765-bccb-5b3d70e4d4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:18.564653 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec968da3-6387-4765-bccb-5b3d70e4d4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:18.565018 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec968da3-6387-4765-bccb-5b3d70e4d4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:18.565351 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec968da3-6387-4765-bccb-5b3d70e4d4d7 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:18.566107 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec968da3-6387-4765-bccb-5b3d70e4d4d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:18.567565 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec968da3-6387-4765-bccb-5b3d70e4d4d7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:18.580777 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 531/1040] 10.222.0.85 () {56 vars in 1087 bytes} [Thu Jun 16 14:44:18 2022] GET /identity/v3/services => generated 1957 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:44:18.611999 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4498a4f-6270-4ee8-a3b6-0f07ed043c7c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:18.649001 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:18.656729 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d1651-1a28-4e1d-99a6-9a98cc2e5831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:18.657561 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d1651-1a28-4e1d-99a6-9a98cc2e5831 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:18.657879 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d1651-1a28-4e1d-99a6-9a98cc2e5831 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:18.658140 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d1651-1a28-4e1d-99a6-9a98cc2e5831 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:18.675815 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d1651-1a28-4e1d-99a6-9a98cc2e5831 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:18.677422 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d1651-1a28-4e1d-99a6-9a98cc2e5831 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:18.703268 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-5c7d1651-1a28-4e1d-99a6-9a98cc2e5831 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:18.703268 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:18.703268 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:18.703268 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:18.703268 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:18.703268 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:18.703268 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:18.703268 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:18.703268 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:18.703268 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:18.703268 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:18.703268 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:18.703268 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:18.703268 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:18.703268 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:18.704313 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:18.704313 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:18.704313 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:18.704313 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:18.704313 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:18.704313 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:18.704313 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:18.704313 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:18.704313 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:18.704313 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:18.704313 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:18.704313 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:18.704313 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:18.704313 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:18.704313 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:18.704313 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:18.704313 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:18.705718 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:18.705718 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:18.705718 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:18.705718 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:18.705718 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 510/1041] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:18.710487 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec968da3-6387-4765-bccb-5b3d70e4d4d7 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:18.828591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec968da3-6387-4765-bccb-5b3d70e4d4d7 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:18.865188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04612834-46bc-4029-a50c-e699a8e122eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:18.865867 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04612834-46bc-4029-a50c-e699a8e122eb None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:18.866149 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04612834-46bc-4029-a50c-e699a8e122eb None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:18.866401 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04612834-46bc-4029-a50c-e699a8e122eb None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:18.867241 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04612834-46bc-4029-a50c-e699a8e122eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:18.868058 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04612834-46bc-4029-a50c-e699a8e122eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:18.869026 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04612834-46bc-4029-a50c-e699a8e122eb None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:18.882259 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 532/1042] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:18.888627 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d1651-1a28-4e1d-99a6-9a98cc2e5831 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:18.998709 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d1651-1a28-4e1d-99a6-9a98cc2e5831 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:19.037724 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceeab74-9cf0-4b0e-a0a9-5bff07eed846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:19.038540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceeab74-9cf0-4b0e-a0a9-5bff07eed846 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:19.038824 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceeab74-9cf0-4b0e-a0a9-5bff07eed846 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:19.039334 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceeab74-9cf0-4b0e-a0a9-5bff07eed846 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:19.047299 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceeab74-9cf0-4b0e-a0a9-5bff07eed846 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:19.048868 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceeab74-9cf0-4b0e-a0a9-5bff07eed846 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:19.062896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-8ceeab74-9cf0-4b0e-a0a9-5bff07eed846 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:19.062896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:19.062896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:19.062896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:19.062896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:19.062896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:19.062896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:19.062896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:19.062896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:19.062896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:19.062896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:19.062896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:19.062896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:44:19.062896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:44:19.062896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:44:19.063847 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:44:19.063847 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:19.063847 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:19.063847 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:19.063847 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:19.063847 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:19.063847 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:19.063847 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:19.063847 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:19.063847 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:19.063847 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:19.063847 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:19.063847 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:19.063847 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:19.063847 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:19.063847 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:19.063847 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:19.064786 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:44:19.064786 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:44:19.064786 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:19.064786 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:19.064786 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:19.064786 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:19.064786 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:19.064786 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:19.067980 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 511/1043] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:19.070166 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04612834-46bc-4029-a50c-e699a8e122eb None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:19.111001 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:19.190424 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04612834-46bc-4029-a50c-e699a8e122eb None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:19.242789 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f69431-1e53-49bc-837d-6146876531f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:19.243425 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f69431-1e53-49bc-837d-6146876531f8 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:19.243702 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f69431-1e53-49bc-837d-6146876531f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:19.244025 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f69431-1e53-49bc-837d-6146876531f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:19.244821 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f69431-1e53-49bc-837d-6146876531f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:19.245129 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f69431-1e53-49bc-837d-6146876531f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:19.246603 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f69431-1e53-49bc-837d-6146876531f8 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:19.259109 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 533/1044] 10.222.0.85 () {56 vars in 1148 bytes} [Thu Jun 16 14:44:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:19.265441 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceeab74-9cf0-4b0e-a0a9-5bff07eed846 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:19.315592 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:19.379031 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceeab74-9cf0-4b0e-a0a9-5bff07eed846 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:19.417374 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721a9e0-c630-4e9b-a2b2-52b078aa1888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:19.418049 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721a9e0-c630-4e9b-a2b2-52b078aa1888 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:19.418329 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721a9e0-c630-4e9b-a2b2-52b078aa1888 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:19.418603 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721a9e0-c630-4e9b-a2b2-52b078aa1888 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:19.419434 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721a9e0-c630-4e9b-a2b2-52b078aa1888 None admin] RBAC: Adding query filter params (role.id=12e6cac1ace0476da69b56800ec15fbc, scope.project.id=80e309a3b3784ba9943734a41949b222, user.id=c74e4d1bdaa64ed280cc5f4c8e79b842) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:19.419747 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721a9e0-c630-4e9b-a2b2-52b078aa1888 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:19.421686 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721a9e0-c630-4e9b-a2b2-52b078aa1888 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:19.428785 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 512/1045] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:44:19 2022] GET /identity/v3/role_assignments?user.id=c74e4d1bdaa64ed280cc5f4c8e79b842&scope.project.id=80e309a3b3784ba9943734a41949b222&role.id=12e6cac1ace0476da69b56800ec15fbc => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:19.631791 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2ef9d-6bd6-4ffa-bae1-8d8f081e064c None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:19.632056 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2ef9d-6bd6-4ffa-bae1-8d8f081e064c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:19.632305 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2ef9d-6bd6-4ffa-bae1-8d8f081e064c None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:19.634162 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 534/1046] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:44:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:19.639826 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2af77-415c-4ac1-b9f4-34babc38a02a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:19.640153 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2af77-415c-4ac1-b9f4-34babc38a02a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:19.640428 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2af77-415c-4ac1-b9f4-34babc38a02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:19.657723 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-47d2af77-415c-4ac1-b9f4-34babc38a02a None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:19.658899 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-47d2af77-415c-4ac1-b9f4-34babc38a02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:19.738317 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 513/1047] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:19.772958 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2ef9d-6bd6-4ffa-bae1-8d8f081e064c None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:19.879408 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:19.890588 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2ef9d-6bd6-4ffa-bae1-8d8f081e064c None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:19.925530 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03efff-f9a0-4fff-9960-b79fe6ba0f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:19.926769 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03efff-f9a0-4fff-9960-b79fe6ba0f06 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:19.926769 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03efff-f9a0-4fff-9960-b79fe6ba0f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:19.926945 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03efff-f9a0-4fff-9960-b79fe6ba0f06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:19.939018 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03efff-f9a0-4fff-9960-b79fe6ba0f06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:19.947356 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-6c03efff-f9a0-4fff-9960-b79fe6ba0f06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:44:19.947356 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:19.947356 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:19.947356 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:19.947356 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:19.947356 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:19.947356 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:19.947356 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:19.947356 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:19.947356 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:19.947356 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:19.947356 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:19.947356 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:19.947356 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:19.947356 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:19.947356 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:19.948405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:19.948405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:19.948405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:19.948405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:19.948405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:19.948405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:19.948405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:19.948405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:19.948405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:19.948405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:19.948405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:19.948405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:19.948405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:19.948405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:19.948405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:19.948405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:19.949288 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:19.949288 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:19.949288 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:19.949288 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:19.949288 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:19.949288 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:19.949288 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:19.949288 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:19.949288 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:19.949288 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:19.949288 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:44:19.949288 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:19.949288 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 535/1048] 10.222.0.85 () {56 vars in 1096 bytes} [Thu Jun 16 14:44:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:19.956624 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2af77-415c-4ac1-b9f4-34babc38a02a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:19.995391 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:20.065405 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2af77-415c-4ac1-b9f4-34babc38a02a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:20.107662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659143a5-aebd-43d7-a317-5667053a6134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:20.108369 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659143a5-aebd-43d7-a317-5667053a6134 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:20.108651 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659143a5-aebd-43d7-a317-5667053a6134 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:20.111285 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659143a5-aebd-43d7-a317-5667053a6134 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:20.111285 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659143a5-aebd-43d7-a317-5667053a6134 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:20.111285 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659143a5-aebd-43d7-a317-5667053a6134 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:20.112216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659143a5-aebd-43d7-a317-5667053a6134 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:20.122729 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 514/1049] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:44:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:20.128438 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03efff-f9a0-4fff-9960-b79fe6ba0f06 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:20.236794 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03efff-f9a0-4fff-9960-b79fe6ba0f06 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:20.274207 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df488a9-ed9e-4e05-a607-a25c80bccf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:20.275091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df488a9-ed9e-4e05-a607-a25c80bccf8d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:20.275370 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df488a9-ed9e-4e05-a607-a25c80bccf8d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:20.275641 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df488a9-ed9e-4e05-a607-a25c80bccf8d None admin] PATH_INFO: `/v3/users/0fca45c4008542bcbf8edb7ad9772b49` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:20.289492 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df488a9-ed9e-4e05-a607-a25c80bccf8d None admin] RBAC: Authorizing `identity:get_user(user_id=0fca45c4008542bcbf8edb7ad9772b49)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:20.291084 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df488a9-ed9e-4e05-a607-a25c80bccf8d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:20.292994 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 536/1050] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:44:20 2022] GET /identity/v3/users/0fca45c4008542bcbf8edb7ad9772b49 => generated 285 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:20.299994 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659143a5-aebd-43d7-a317-5667053a6134 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:20.407276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:20.411791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659143a5-aebd-43d7-a317-5667053a6134 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:20.455466 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f4eec-5b24-499a-848e-a60f217cd684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:20.456581 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f4eec-5b24-499a-848e-a60f217cd684 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:20.457052 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f4eec-5b24-499a-848e-a60f217cd684 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:20.457510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f4eec-5b24-499a-848e-a60f217cd684 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:20.542445 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f4eec-5b24-499a-848e-a60f217cd684 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:20.543898 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f4eec-5b24-499a-848e-a60f217cd684 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:20.652283 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:20.662793 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 515/1051] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:44:20 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 14:44:20.663633 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df488a9-ed9e-4e05-a607-a25c80bccf8d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:20.680037 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:20.778972 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df488a9-ed9e-4e05-a607-a25c80bccf8d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:20.808386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabb7ae-95b1-448a-9e78-667f92088f70 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:20.808568 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabb7ae-95b1-448a-9e78-667f92088f70 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:20.809024 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabb7ae-95b1-448a-9e78-667f92088f70 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:20.810431 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 516/1052] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:20.816362 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53881344-66ef-4609-935f-d9ab5dc4c7fd None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:20.816684 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53881344-66ef-4609-935f-d9ab5dc4c7fd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:20.816925 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53881344-66ef-4609-935f-d9ab5dc4c7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:20.817325 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ac606-9d88-414f-a6b9-6d2a3599e4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:20.818275 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ac606-9d88-414f-a6b9-6d2a3599e4fe None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:20.818478 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ac606-9d88-414f-a6b9-6d2a3599e4fe None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:20.818756 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ac606-9d88-414f-a6b9-6d2a3599e4fe None admin] PATH_INFO: `/v3/projects/a42900dc30d84f5baeadcb88fcd566d9` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:20.820009 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ac606-9d88-414f-a6b9-6d2a3599e4fe None admin] RBAC: Authorizing `identity:get_project(project_id=a42900dc30d84f5baeadcb88fcd566d9)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:20.823126 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ac606-9d88-414f-a6b9-6d2a3599e4fe None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:20.826337 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 537/1053] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:44:20 2022] GET /identity/v3/projects/a42900dc30d84f5baeadcb88fcd566d9 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:20.832397 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ac606-9d88-414f-a6b9-6d2a3599e4fe None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:20.838465 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-53881344-66ef-4609-935f-d9ab5dc4c7fd None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:20.839676 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-53881344-66ef-4609-935f-d9ab5dc4c7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:20.909668 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 517/1054] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:44:20.924119 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:20.934320 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53881344-66ef-4609-935f-d9ab5dc4c7fd None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:20.948164 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ac606-9d88-414f-a6b9-6d2a3599e4fe None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:20.988205 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49428188-91ae-453d-ba4b-b35cf28020f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:20.988736 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49428188-91ae-453d-ba4b-b35cf28020f1 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:20.989132 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49428188-91ae-453d-ba4b-b35cf28020f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:20.989301 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49428188-91ae-453d-ba4b-b35cf28020f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:20.990125 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49428188-91ae-453d-ba4b-b35cf28020f1 None admin] RBAC: Adding query filter params (role.id=95dcfa6c726a4d01a41d2642554fd338, scope.project.id=a42900dc30d84f5baeadcb88fcd566d9, user.id=0fca45c4008542bcbf8edb7ad9772b49) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:20.990420 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49428188-91ae-453d-ba4b-b35cf28020f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:20.991894 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49428188-91ae-453d-ba4b-b35cf28020f1 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:20.998186 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 538/1055] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:44:20 2022] GET /identity/v3/role_assignments?user.id=0fca45c4008542bcbf8edb7ad9772b49&scope.project.id=a42900dc30d84f5baeadcb88fcd566d9&role.id=95dcfa6c726a4d01a41d2642554fd338 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:21.054157 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53881344-66ef-4609-935f-d9ab5dc4c7fd None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:21.089461 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:21.099470 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a1569a-27d5-4cc9-9ef7-7cdfc95bb115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:21.100401 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1569a-27d5-4cc9-9ef7-7cdfc95bb115 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:21.100726 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1569a-27d5-4cc9-9ef7-7cdfc95bb115 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:21.101017 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1569a-27d5-4cc9-9ef7-7cdfc95bb115 None admin] PATH_INFO: `/v3/services/image` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:21.102351 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a1569a-27d5-4cc9-9ef7-7cdfc95bb115 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:21.103888 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a1569a-27d5-4cc9-9ef7-7cdfc95bb115 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:21.117604 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-85a1569a-27d5-4cc9-9ef7-7cdfc95bb115 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 14:44:21.117604 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:21.117604 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:44:21.117604 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:44:21.117604 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:44:21.117604 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:44:21.117604 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:44:21.117604 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:21.117604 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 14:44:21.117604 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:21.117604 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:21.117604 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:21.117604 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:21.117604 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:21.117604 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:21.117604 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:21.117604 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:21.118712 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:21.118712 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:21.118712 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:21.118712 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:21.118712 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:21.118712 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:21.118712 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:44:21.118712 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:44:21.118712 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:44:21.118712 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:44:21.118712 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:21.118712 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:21.118712 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:21.118712 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:21.118712 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:21.118712 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:21.119563 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:21.119563 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:21.119563 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:21.119563 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:21.119563 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:21.119563 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:21.119563 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:21.119563 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:21.119563 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:21.119563 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:21.119563 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:44:21.119563 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:21.119563 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 14:44:21.119563 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:21.124229 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 518/1056] 10.222.0.85 () {56 vars in 1105 bytes} [Thu Jun 16 14:44:20 2022] GET /identity/v3/services/image => generated 86 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:21.125619 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49428188-91ae-453d-ba4b-b35cf28020f1 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:21.242893 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49428188-91ae-453d-ba4b-b35cf28020f1 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:21.283281 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de676d09-4473-444e-bcb9-b58fdba88505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:21.284012 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de676d09-4473-444e-bcb9-b58fdba88505 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:21.284367 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de676d09-4473-444e-bcb9-b58fdba88505 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:21.284652 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de676d09-4473-444e-bcb9-b58fdba88505 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:21.285414 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de676d09-4473-444e-bcb9-b58fdba88505 None admin] RBAC: Adding query filter params (name=image) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:21.285726 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de676d09-4473-444e-bcb9-b58fdba88505 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:21.287676 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de676d09-4473-444e-bcb9-b58fdba88505 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:21.296361 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 539/1057] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:21.302226 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a1569a-27d5-4cc9-9ef7-7cdfc95bb115 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:21.415814 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a1569a-27d5-4cc9-9ef7-7cdfc95bb115 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:21.452167 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f4f94-f67a-40c9-955f-0e1bde33cc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:21.452836 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f4f94-f67a-40c9-955f-0e1bde33cc50 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:21.453119 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f4f94-f67a-40c9-955f-0e1bde33cc50 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:21.453396 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f4f94-f67a-40c9-955f-0e1bde33cc50 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:21.454106 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f4f94-f67a-40c9-955f-0e1bde33cc50 None admin] RBAC: Adding query filter params (type=image) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:21.454410 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f4f94-f67a-40c9-955f-0e1bde33cc50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:21.455787 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f4f94-f67a-40c9-955f-0e1bde33cc50 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:21.461477 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 519/1058] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:21.467483 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de676d09-4473-444e-bcb9-b58fdba88505 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:21.481850 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:21.584968 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4efab3b-5c34-4de5-9499-c47fa16b85d3 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:21.585217 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4efab3b-5c34-4de5-9499-c47fa16b85d3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:21.585509 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4efab3b-5c34-4de5-9499-c47fa16b85d3 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:21.587670 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 520/1059] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:44:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:21.590087 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de676d09-4473-444e-bcb9-b58fdba88505 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:21.592684 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dec137-a6ff-4c51-b936-2e88e1495ecd None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:21.592972 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dec137-a6ff-4c51-b936-2e88e1495ecd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:21.593251 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dec137-a6ff-4c51-b936-2e88e1495ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:21.610157 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c1dec137-a6ff-4c51-b936-2e88e1495ecd None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:21.611558 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c1dec137-a6ff-4c51-b936-2e88e1495ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:21.630806 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393d980-e5c4-4c11-82f8-41675a36f469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:21.631986 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393d980-e5c4-4c11-82f8-41675a36f469 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:21.632267 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393d980-e5c4-4c11-82f8-41675a36f469 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:21.632539 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393d980-e5c4-4c11-82f8-41675a36f469 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:21.633973 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393d980-e5c4-4c11-82f8-41675a36f469 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:21.635358 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393d980-e5c4-4c11-82f8-41675a36f469 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:21.663912 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 540/1060] 10.222.0.85 () {60 vars in 1144 bytes} [Thu Jun 16 14:44:21 2022] POST /identity/v3/endpoints => generated 327 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:44:21.666836 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:21.698118 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 521/1061] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:44:21.720385 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393d980-e5c4-4c11-82f8-41675a36f469 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:21.792955 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:21.840093 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393d980-e5c4-4c11-82f8-41675a36f469 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:21.879661 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0246b1-f334-479c-a3d2-a45292c42d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:21.880556 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0246b1-f334-479c-a3d2-a45292c42d03 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:21.880854 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0246b1-f334-479c-a3d2-a45292c42d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:21.881112 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0246b1-f334-479c-a3d2-a45292c42d03 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:21.892472 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0246b1-f334-479c-a3d2-a45292c42d03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:21.900963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-5d0246b1-f334-479c-a3d2-a45292c42d03 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 14:44:21.900963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:21.900963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:21.900963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:21.900963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:21.900963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:21.900963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:21.900963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:21.900963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:21.900963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:21.900963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:21.900963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:21.900963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:21.900963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:21.900963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:21.900963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:21.901903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:21.901903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:21.901903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:21.901903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:21.901903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:21.901903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:21.901903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:21.901903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:21.901903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:21.901903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:21.901903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:21.901903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:21.901903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:21.901903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:21.901903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:21.901903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:21.903190 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:21.903190 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:21.903190 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:21.903190 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:21.903190 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:21.903190 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:21.903190 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:21.903190 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:21.903190 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:21.903190 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:21.903190 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 14:44:21.903190 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:21.903190 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 541/1062] 10.222.0.85 () {56 vars in 1120 bytes} [Thu Jun 16 14:44:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:21.908762 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dec137-a6ff-4c51-b936-2e88e1495ecd None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:22.015405 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dec137-a6ff-4c51-b936-2e88e1495ecd None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:22.051765 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99267cf-0522-4e02-8d0f-5ad2c19d58ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:22.052469 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99267cf-0522-4e02-8d0f-5ad2c19d58ce None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:22.052751 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99267cf-0522-4e02-8d0f-5ad2c19d58ce None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:22.053024 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99267cf-0522-4e02-8d0f-5ad2c19d58ce None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:22.053768 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99267cf-0522-4e02-8d0f-5ad2c19d58ce None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:22.054082 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99267cf-0522-4e02-8d0f-5ad2c19d58ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:22.055604 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99267cf-0522-4e02-8d0f-5ad2c19d58ce None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:22.064951 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 522/1063] 10.222.0.85 () {56 vars in 1115 bytes} [Thu Jun 16 14:44:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:22.070874 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0246b1-f334-479c-a3d2-a45292c42d03 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:22.204240 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0246b1-f334-479c-a3d2-a45292c42d03 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:22.229814 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:22.242886 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346da68-e70d-4e8b-9d19-54cb577df259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:22.243701 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346da68-e70d-4e8b-9d19-54cb577df259 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:22.244021 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346da68-e70d-4e8b-9d19-54cb577df259 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:22.244295 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346da68-e70d-4e8b-9d19-54cb577df259 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:22.256988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346da68-e70d-4e8b-9d19-54cb577df259 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:22.258484 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346da68-e70d-4e8b-9d19-54cb577df259 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:22.276313 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-9346da68-e70d-4e8b-9d19-54cb577df259 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:22.276313 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:22.276313 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:22.276313 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:22.276313 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:22.276313 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:22.276313 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:22.276313 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:22.276313 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:22.276313 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:22.276313 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:22.276313 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:22.276313 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:22.276313 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:22.276313 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:22.277251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:22.277251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:22.277251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:22.277251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:22.277251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:22.277251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:22.277251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:22.277251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:22.277251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:22.277251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:22.277251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:22.277251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:22.277251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:22.277251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:22.277251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:22.277251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:22.277251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:22.278190 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:22.278190 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:22.278190 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:22.278190 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:22.278190 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 542/1064] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:22.283343 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99267cf-0522-4e02-8d0f-5ad2c19d58ce None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:22.340487 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:22.399598 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99267cf-0522-4e02-8d0f-5ad2c19d58ce None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:22.437061 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f2671-a148-4d3d-a0be-5f17b62bca68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:22.437728 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f2671-a148-4d3d-a0be-5f17b62bca68 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:22.438005 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f2671-a148-4d3d-a0be-5f17b62bca68 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:22.438275 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f2671-a148-4d3d-a0be-5f17b62bca68 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:22.438991 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f2671-a148-4d3d-a0be-5f17b62bca68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:22.439300 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f2671-a148-4d3d-a0be-5f17b62bca68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:22.440709 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f2671-a148-4d3d-a0be-5f17b62bca68 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:22.453752 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 523/1065] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:22.459279 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346da68-e70d-4e8b-9d19-54cb577df259 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:22.572788 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346da68-e70d-4e8b-9d19-54cb577df259 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:22.607348 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d69c6a-be76-4aff-b5fb-661587e9f1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:22.608188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d69c6a-be76-4aff-b5fb-661587e9f1c8 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:22.608472 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d69c6a-be76-4aff-b5fb-661587e9f1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:22.608746 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d69c6a-be76-4aff-b5fb-661587e9f1c8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:22.616822 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d69c6a-be76-4aff-b5fb-661587e9f1c8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:22.618650 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d69c6a-be76-4aff-b5fb-661587e9f1c8 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:22.633584 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-15d69c6a-be76-4aff-b5fb-661587e9f1c8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:44:22.633584 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:22.633584 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:22.633584 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:22.633584 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:22.633584 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:22.633584 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:22.633584 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:22.633584 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:22.633584 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:22.633584 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:22.633584 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:22.633584 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:44:22.633584 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:44:22.633584 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:44:22.633584 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:44:22.634700 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:22.634700 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:22.634700 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:22.634700 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:22.634700 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:22.634700 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:22.634700 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:22.634700 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:22.634700 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:22.634700 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:22.634700 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:22.634700 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:22.634700 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:22.634700 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:22.634700 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:22.634700 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:22.634700 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:22.634700 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:22.635773 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:22.635773 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:22.635773 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:44:22.635773 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:44:22.635773 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:44:22.635773 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:44:22.635773 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:44:22.635773 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:44:22.635773 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:44:22.635773 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:22.639659 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 543/1066] 10.222.0.85 () {56 vars in 1093 bytes} [Thu Jun 16 14:44:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:22.640702 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f2671-a148-4d3d-a0be-5f17b62bca68 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:22.750108 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f2671-a148-4d3d-a0be-5f17b62bca68 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:22.752569 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:22.787378 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12455dcb-8de5-4813-a453-8913e3806a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:22.788094 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12455dcb-8de5-4813-a453-8913e3806a13 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:22.788436 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12455dcb-8de5-4813-a453-8913e3806a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:22.788638 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12455dcb-8de5-4813-a453-8913e3806a13 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:22.789928 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12455dcb-8de5-4813-a453-8913e3806a13 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:22.790244 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12455dcb-8de5-4813-a453-8913e3806a13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:22.791720 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12455dcb-8de5-4813-a453-8913e3806a13 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:22.811142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 524/1067] 10.222.0.85 () {56 vars in 1133 bytes} [Thu Jun 16 14:44:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:22.816968 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d69c6a-be76-4aff-b5fb-661587e9f1c8 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:22.856772 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:22.940427 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d69c6a-be76-4aff-b5fb-661587e9f1c8 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:22.980141 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f8f2f-7e5c-4671-b655-eea81ac96bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:22.980980 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f8f2f-7e5c-4671-b655-eea81ac96bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:22.981280 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f8f2f-7e5c-4671-b655-eea81ac96bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:22.981578 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f8f2f-7e5c-4671-b655-eea81ac96bf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:22.993675 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f8f2f-7e5c-4671-b655-eea81ac96bf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:22.995311 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f8f2f-7e5c-4671-b655-eea81ac96bf9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:23.014378 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-7e0f8f2f-7e5c-4671-b655-eea81ac96bf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:23.014378 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:23.014378 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:23.014378 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:23.014378 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:23.014378 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:23.014378 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:23.014378 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:23.014378 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:23.014378 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:23.014378 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:23.014378 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:23.014378 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:23.014378 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:23.014378 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:23.015410 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:23.015410 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:23.015410 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:23.015410 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:23.015410 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:23.015410 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:23.015410 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:23.015410 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:23.015410 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:23.015410 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:23.015410 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:23.015410 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:23.015410 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:23.015410 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:23.015410 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:23.015410 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:23.015410 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:23.020978 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:23.020978 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:23.020978 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:23.020978 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:23.020978 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 544/1068] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:23.021647 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12455dcb-8de5-4813-a453-8913e3806a13 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:23.130812 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12455dcb-8de5-4813-a453-8913e3806a13 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:23.172289 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14d01d-807f-413c-ac7a-c68f25551407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:23.172962 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14d01d-807f-413c-ac7a-c68f25551407 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:23.173238 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14d01d-807f-413c-ac7a-c68f25551407 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:23.173508 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14d01d-807f-413c-ac7a-c68f25551407 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:23.174232 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14d01d-807f-413c-ac7a-c68f25551407 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:23.174538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14d01d-807f-413c-ac7a-c68f25551407 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:23.175944 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14d01d-807f-413c-ac7a-c68f25551407 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:23.196003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 525/1069] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:23.199459 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f8f2f-7e5c-4671-b655-eea81ac96bf9 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:23.206410 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9d0ca-d212-4dfa-a478-d243cf00192e None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:23.213602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9d0ca-d212-4dfa-a478-d243cf00192e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:23.213602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9d0ca-d212-4dfa-a478-d243cf00192e None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:23.213602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 526/1070] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:23.214051 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad114fb-21ab-43c7-91c2-78c4e7aa829d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:23.214270 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad114fb-21ab-43c7-91c2-78c4e7aa829d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:23.214549 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad114fb-21ab-43c7-91c2-78c4e7aa829d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:23.233276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1ad114fb-21ab-43c7-91c2-78c4e7aa829d None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:23.234459 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1ad114fb-21ab-43c7-91c2-78c4e7aa829d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:23.254476 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:23.314170 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 527/1071] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:44:23.316113 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:23.332391 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f8f2f-7e5c-4671-b655-eea81ac96bf9 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:23.338407 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad114fb-21ab-43c7-91c2-78c4e7aa829d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:23.371178 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c3ba9-2b33-4bfb-9a75-7980851343f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:23.372015 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c3ba9-2b33-4bfb-9a75-7980851343f7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:23.372527 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c3ba9-2b33-4bfb-9a75-7980851343f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:23.372822 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c3ba9-2b33-4bfb-9a75-7980851343f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:23.381625 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c3ba9-2b33-4bfb-9a75-7980851343f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:23.384057 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c3ba9-2b33-4bfb-9a75-7980851343f7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:23.404061 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-8b2c3ba9-2b33-4bfb-9a75-7980851343f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:23.404061 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:23.404061 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:23.404061 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:23.404061 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:23.404061 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:23.404061 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:23.404061 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:23.404061 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:23.404061 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:23.404061 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:23.404061 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:23.404061 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:44:23.404061 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:44:23.404061 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:44:23.405011 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:44:23.405011 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:23.405011 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:23.405011 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:23.405011 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:23.405011 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:23.405011 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:23.405011 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:23.405011 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:23.405011 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:23.405011 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:23.405011 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:23.405011 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:23.405011 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:23.405011 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:23.405011 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:23.405011 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:23.406121 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:44:23.406121 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:44:23.406121 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:23.406121 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:23.406121 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:23.406121 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:23.406121 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:23.406121 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:23.406121 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 545/1072] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:23.411087 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c3ba9-2b33-4bfb-9a75-7980851343f7 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:23.448412 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad114fb-21ab-43c7-91c2-78c4e7aa829d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:23.484839 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf201f-e470-4e8d-a5eb-3f4d32d7cd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:23.487045 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf201f-e470-4e8d-a5eb-3f4d32d7cd54 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:23.487333 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf201f-e470-4e8d-a5eb-3f4d32d7cd54 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:23.487615 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf201f-e470-4e8d-a5eb-3f4d32d7cd54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:23.499272 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf201f-e470-4e8d-a5eb-3f4d32d7cd54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:23.506980 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-2fdf201f-e470-4e8d-a5eb-3f4d32d7cd54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:44:23.506980 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:23.506980 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:23.506980 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:23.506980 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:23.506980 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:23.506980 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:23.506980 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:23.506980 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:23.506980 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:23.506980 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:23.506980 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:23.506980 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:23.506980 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:23.506980 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:23.506980 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:23.508062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:23.508062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:23.508062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:23.508062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:23.508062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:23.508062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:23.508062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:23.508062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:23.508062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:23.508062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:23.508062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:23.508062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:23.508062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:23.508062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:23.508062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:23.508062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:23.508957 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:23.508957 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:23.508957 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:23.508957 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:23.508957 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:23.508957 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:23.508957 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:23.508957 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:23.508957 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:23.508957 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:23.508957 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:44:23.508957 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:23.508957 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 528/1073] 10.222.0.85 () {56 vars in 1096 bytes} [Thu Jun 16 14:44:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:44:23.514602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf201f-e470-4e8d-a5eb-3f4d32d7cd54 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:23.531029 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c3ba9-2b33-4bfb-9a75-7980851343f7 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:23.538568 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:23.579901 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203cc06-9c55-4a96-a31c-ea182f57fad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:23.580673 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203cc06-9c55-4a96-a31c-ea182f57fad7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:23.580952 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203cc06-9c55-4a96-a31c-ea182f57fad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:23.581241 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203cc06-9c55-4a96-a31c-ea182f57fad7 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:23.582006 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a203cc06-9c55-4a96-a31c-ea182f57fad7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:23.582311 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a203cc06-9c55-4a96-a31c-ea182f57fad7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:23.583753 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a203cc06-9c55-4a96-a31c-ea182f57fad7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:23.596432 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 546/1074] 10.222.0.85 () {56 vars in 1148 bytes} [Thu Jun 16 14:44:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:23.602467 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203cc06-9c55-4a96-a31c-ea182f57fad7 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:23.613983 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:23.642347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf201f-e470-4e8d-a5eb-3f4d32d7cd54 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:23.680758 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b431f-c3fa-4b70-aa07-d1cd992e6782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:23.681512 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b431f-c3fa-4b70-aa07-d1cd992e6782 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:23.681795 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b431f-c3fa-4b70-aa07-d1cd992e6782 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:23.682071 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b431f-c3fa-4b70-aa07-d1cd992e6782 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:23.682878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b431f-c3fa-4b70-aa07-d1cd992e6782 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:23.683186 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b431f-c3fa-4b70-aa07-d1cd992e6782 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:23.684647 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b431f-c3fa-4b70-aa07-d1cd992e6782 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:23.694685 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 529/1075] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:44:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:23.700741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b431f-c3fa-4b70-aa07-d1cd992e6782 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:23.718699 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203cc06-9c55-4a96-a31c-ea182f57fad7 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:23.754854 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cab32d-fc73-425c-b777-54dce312c483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:23.755747 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cab32d-fc73-425c-b777-54dce312c483 None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:23.756299 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cab32d-fc73-425c-b777-54dce312c483 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:23.756299 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cab32d-fc73-425c-b777-54dce312c483 None admin] PATH_INFO: `/v3/projects/80e309a3b3784ba9943734a41949b222/users/c74e4d1bdaa64ed280cc5f4c8e79b842/roles/12e6cac1ace0476da69b56800ec15fbc` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:23.758800 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cab32d-fc73-425c-b777-54dce312c483 None admin] RBAC: Authorizing `identity:create_grant(project_id=80e309a3b3784ba9943734a41949b222, user_id=c74e4d1bdaa64ed280cc5f4c8e79b842, role_id=12e6cac1ace0476da69b56800ec15fbc)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:23.760284 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cab32d-fc73-425c-b777-54dce312c483 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:23.774394 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 547/1076] 10.222.0.85 () {58 vars in 1439 bytes} [Thu Jun 16 14:44:23 2022] PUT /identity/v3/projects/80e309a3b3784ba9943734a41949b222/users/c74e4d1bdaa64ed280cc5f4c8e79b842/roles/12e6cac1ace0476da69b56800ec15fbc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:44:23.791437 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:23.822071 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b431f-c3fa-4b70-aa07-d1cd992e6782 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:23.861926 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01681741-1c0a-4b3d-be33-a8e0cb41975b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:23.862836 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01681741-1c0a-4b3d-be33-a8e0cb41975b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:23.863096 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01681741-1c0a-4b3d-be33-a8e0cb41975b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:23.863393 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01681741-1c0a-4b3d-be33-a8e0cb41975b None admin] PATH_INFO: `/v3/users/0fca45c4008542bcbf8edb7ad9772b49` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:23.864687 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01681741-1c0a-4b3d-be33-a8e0cb41975b None admin] RBAC: Authorizing `identity:get_user(user_id=0fca45c4008542bcbf8edb7ad9772b49)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:23.866147 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01681741-1c0a-4b3d-be33-a8e0cb41975b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:23.868360 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 530/1077] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:44:23 2022] GET /identity/v3/users/0fca45c4008542bcbf8edb7ad9772b49 => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:23.874877 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cab32d-fc73-425c-b777-54dce312c483 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:23.892218 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d1544-1616-4110-9fb7-79871a83ab8a None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:23.892888 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d1544-1616-4110-9fb7-79871a83ab8a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:23.893558 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d1544-1616-4110-9fb7-79871a83ab8a None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:23.895273 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 531/1078] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:44:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:23.902516 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a64ba-87ae-4825-b8a8-33d114e18715 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:23.902856 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a64ba-87ae-4825-b8a8-33d114e18715 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:23.903067 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a64ba-87ae-4825-b8a8-33d114e18715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:23.929015 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e03a64ba-87ae-4825-b8a8-33d114e18715 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:23.930908 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e03a64ba-87ae-4825-b8a8-33d114e18715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:23.954532 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:23.997716 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cab32d-fc73-425c-b777-54dce312c483 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:24.015478 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 532/1079] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:44:24.035101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85facd-7c84-463b-a777-bebcff9570e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:24.036004 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85facd-7c84-463b-a777-bebcff9570e7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:24.036289 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85facd-7c84-463b-a777-bebcff9570e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:24.036567 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85facd-7c84-463b-a777-bebcff9570e7 None admin] PATH_INFO: `/v3/projects/a42900dc30d84f5baeadcb88fcd566d9` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:24.037760 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85facd-7c84-463b-a777-bebcff9570e7 None admin] RBAC: Authorizing `identity:get_project(project_id=a42900dc30d84f5baeadcb88fcd566d9)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:24.038209 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a64ba-87ae-4825-b8a8-33d114e18715 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:24.039368 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85facd-7c84-463b-a777-bebcff9570e7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:24.041411 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 548/1080] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:44:23 2022] GET /identity/v3/projects/a42900dc30d84f5baeadcb88fcd566d9 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:24.049553 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85facd-7c84-463b-a777-bebcff9570e7 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:24.116041 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:24.149697 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a64ba-87ae-4825-b8a8-33d114e18715 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:24.157116 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85facd-7c84-463b-a777-bebcff9570e7 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:24.188760 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c022548-90cb-447c-9747-40e4be2ba235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:24.189827 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c022548-90cb-447c-9747-40e4be2ba235 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:24.190207 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c022548-90cb-447c-9747-40e4be2ba235 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:24.190492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c022548-90cb-447c-9747-40e4be2ba235 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:24.192464 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38122ea6-bed9-46b7-8337-96468bdb08b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:24.193363 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38122ea6-bed9-46b7-8337-96468bdb08b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:24.193645 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38122ea6-bed9-46b7-8337-96468bdb08b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:24.193924 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38122ea6-bed9-46b7-8337-96468bdb08b4 None admin] PATH_INFO: `/v3/projects/a42900dc30d84f5baeadcb88fcd566d9/users/0fca45c4008542bcbf8edb7ad9772b49/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:24.196131 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38122ea6-bed9-46b7-8337-96468bdb08b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=a42900dc30d84f5baeadcb88fcd566d9, user_id=0fca45c4008542bcbf8edb7ad9772b49, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:24.197590 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38122ea6-bed9-46b7-8337-96468bdb08b4 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:24.201169 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:24.223916 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 549/1081] 10.222.0.85 () {58 vars in 1439 bytes} [Thu Jun 16 14:44:24 2022] PUT /identity/v3/projects/a42900dc30d84f5baeadcb88fcd566d9/users/0fca45c4008542bcbf8edb7ad9772b49/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:44:24.285216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c022548-90cb-447c-9747-40e4be2ba235 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:24.286737 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c022548-90cb-447c-9747-40e4be2ba235 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:24.375216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:24.424238 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 533/1082] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:44:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 14:44:24.430260 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38122ea6-bed9-46b7-8337-96468bdb08b4 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:24.540231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38122ea6-bed9-46b7-8337-96468bdb08b4 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:24.580863 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162cc0a-c82b-488f-b993-408b2e5c1d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:24.581666 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162cc0a-c82b-488f-b993-408b2e5c1d34 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:24.581940 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162cc0a-c82b-488f-b993-408b2e5c1d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:24.582208 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162cc0a-c82b-488f-b993-408b2e5c1d34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:24.594560 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162cc0a-c82b-488f-b993-408b2e5c1d34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:24.596066 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162cc0a-c82b-488f-b993-408b2e5c1d34 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:24.614217 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-f162cc0a-c82b-488f-b993-408b2e5c1d34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:24.614217 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:24.614217 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:24.614217 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:24.614217 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:24.614217 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:24.614217 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:24.614217 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:24.614217 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:24.614217 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:24.614217 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:24.614217 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:24.614217 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:24.614217 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:24.614217 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:24.615211 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:24.615211 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:24.615211 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:24.615211 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:24.615211 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:24.615211 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:24.615211 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:24.615211 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:24.615211 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:24.615211 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:24.615211 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:24.615211 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:24.615211 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:24.615211 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:24.615211 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:24.615211 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:24.615211 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:24.616205 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:24.616205 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:24.616205 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:24.616205 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:24.617122 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 550/1083] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:24.621904 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c022548-90cb-447c-9747-40e4be2ba235 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:24.727052 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c022548-90cb-447c-9747-40e4be2ba235 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:24.763061 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd6f75-1d34-4f10-add8-8254a8cd719d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:24.763728 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd6f75-1d34-4f10-add8-8254a8cd719d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:24.764031 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd6f75-1d34-4f10-add8-8254a8cd719d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:24.764303 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd6f75-1d34-4f10-add8-8254a8cd719d None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:24.765016 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd6f75-1d34-4f10-add8-8254a8cd719d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:24.765314 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd6f75-1d34-4f10-add8-8254a8cd719d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:24.766701 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd6f75-1d34-4f10-add8-8254a8cd719d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:24.779420 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 534/1084] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:25.968656 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc69fc6-9c01-47f4-9359-e287441ca44f None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:25.969193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc69fc6-9c01-47f4-9359-e287441ca44f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:25.969399 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc69fc6-9c01-47f4-9359-e287441ca44f None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:25.971622 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 551/1085] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:44:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:25.980844 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e9a53-45f0-495b-a898-194f8a79fc4b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:25.981420 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e9a53-45f0-495b-a898-194f8a79fc4b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:25.981830 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e9a53-45f0-495b-a898-194f8a79fc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:26.006974 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f96e9a53-45f0-495b-a898-194f8a79fc4b None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:26.008358 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f96e9a53-45f0-495b-a898-194f8a79fc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:26.038842 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:26.093105 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 535/1086] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:26.117431 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc69fc6-9c01-47f4-9359-e287441ca44f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:26.182977 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:26.250256 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc69fc6-9c01-47f4-9359-e287441ca44f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:26.290284 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654582aa-227b-4063-a2ec-e0326520949e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:26.291387 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654582aa-227b-4063-a2ec-e0326520949e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:26.291662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654582aa-227b-4063-a2ec-e0326520949e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:26.291965 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654582aa-227b-4063-a2ec-e0326520949e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:26.305107 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654582aa-227b-4063-a2ec-e0326520949e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:26.318114 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-654582aa-227b-4063-a2ec-e0326520949e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 14:44:26.318114 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:26.318114 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:26.318114 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:26.318114 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:26.318114 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:26.318114 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:26.318114 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:26.318114 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:26.318114 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:26.318114 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:26.318114 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:26.318114 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:26.318114 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:26.318114 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:26.318114 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:26.319289 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:26.319289 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:26.319289 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:26.319289 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:26.319289 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:26.319289 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:26.319289 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:26.319289 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:26.319289 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:26.319289 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:26.319289 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:26.319289 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:26.319289 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:26.319289 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:26.319289 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:26.319289 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:26.320319 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:26.320319 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:26.320319 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:26.320319 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:26.320319 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:26.320319 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:26.320319 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:26.320319 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:26.320319 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:26.320319 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:26.320319 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 14:44:26.320319 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:26.321341 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 552/1087] 10.222.0.85 () {56 vars in 1120 bytes} [Thu Jun 16 14:44:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:26.329068 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e9a53-45f0-495b-a898-194f8a79fc4b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:26.385273 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433c456-a338-4d2b-b1e0-51aa7cefb255 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:26.385557 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433c456-a338-4d2b-b1e0-51aa7cefb255 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:26.385836 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433c456-a338-4d2b-b1e0-51aa7cefb255 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:26.387211 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 553/1088] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:44:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:26.393923 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006afc75-3749-43a7-a074-9813b6a17b1b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:26.394153 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006afc75-3749-43a7-a074-9813b6a17b1b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:26.394424 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006afc75-3749-43a7-a074-9813b6a17b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:26.413216 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-006afc75-3749-43a7-a074-9813b6a17b1b None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:26.414675 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-006afc75-3749-43a7-a074-9813b6a17b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:26.450002 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e9a53-45f0-495b-a898-194f8a79fc4b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:26.496315 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 554/1089] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:26.497471 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9006be-898a-4931-8491-38213758e3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:26.498177 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9006be-898a-4931-8491-38213758e3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:26.498459 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9006be-898a-4931-8491-38213758e3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:26.498736 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9006be-898a-4931-8491-38213758e3a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:26.499517 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9006be-898a-4931-8491-38213758e3a9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:26.499846 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9006be-898a-4931-8491-38213758e3a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:26.501990 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9006be-898a-4931-8491-38213758e3a9 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:26.511804 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 536/1090] 10.222.0.85 () {56 vars in 1115 bytes} [Thu Jun 16 14:44:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:26.518178 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006afc75-3749-43a7-a074-9813b6a17b1b None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:26.521235 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9006be-898a-4931-8491-38213758e3a9 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:26.552074 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:26.574373 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:26.646715 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006afc75-3749-43a7-a074-9813b6a17b1b None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:26.656904 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9006be-898a-4931-8491-38213758e3a9 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:26.699150 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae162b6e-6883-47e5-88f9-b79ea30206a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:26.700107 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65708c3c-f286-4b11-99c5-e9d85ad3b8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:26.700475 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae162b6e-6883-47e5-88f9-b79ea30206a1 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:26.700901 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae162b6e-6883-47e5-88f9-b79ea30206a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:26.701335 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae162b6e-6883-47e5-88f9-b79ea30206a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:26.701510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65708c3c-f286-4b11-99c5-e9d85ad3b8df None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:26.701780 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65708c3c-f286-4b11-99c5-e9d85ad3b8df None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:26.702213 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65708c3c-f286-4b11-99c5-e9d85ad3b8df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:26.718674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae162b6e-6883-47e5-88f9-b79ea30206a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:26.720290 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65708c3c-f286-4b11-99c5-e9d85ad3b8df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:26.721194 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae162b6e-6883-47e5-88f9-b79ea30206a1 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:26.734165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-65708c3c-f286-4b11-99c5-e9d85ad3b8df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:44:26.734165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:26.734165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:26.734165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:26.734165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:26.734165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:26.734165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:26.734165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:26.734165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:26.734165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:26.734165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:26.734165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:26.734165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:26.734165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:26.734165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:26.734165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:26.735412 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:26.735412 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:26.735412 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:26.735412 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:26.735412 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:26.735412 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:26.735412 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:26.735412 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:26.735412 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:26.735412 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:26.735412 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:26.735412 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:26.735412 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:26.735412 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:26.735412 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:26.735412 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:26.737917 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:26.737917 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:26.737917 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:26.737917 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:26.737917 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:26.737917 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:26.737917 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:26.737917 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:26.737917 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:26.737917 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:26.737917 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:44:26.737917 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:26.737917 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 537/1091] 10.222.0.85 () {56 vars in 1096 bytes} [Thu Jun 16 14:44:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:26.746776 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65708c3c-f286-4b11-99c5-e9d85ad3b8df None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:26.753935 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-ae162b6e-6883-47e5-88f9-b79ea30206a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:26.753935 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:26.753935 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:26.753935 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:26.753935 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:26.753935 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:26.753935 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:26.753935 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:26.753935 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:26.753935 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:26.753935 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:26.753935 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:26.753935 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:26.753935 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:26.753935 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:26.754979 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:26.754979 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:26.754979 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:26.754979 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:26.754979 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:26.754979 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:26.754979 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:26.754979 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:26.754979 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:26.754979 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:26.754979 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:26.754979 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:26.754979 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:26.754979 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:26.754979 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:26.754979 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:26.754979 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:26.756193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:26.756193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:26.756193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:26.756193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:26.756193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 555/1092] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:26.765194 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae162b6e-6883-47e5-88f9-b79ea30206a1 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:26.885944 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:26.905611 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65708c3c-f286-4b11-99c5-e9d85ad3b8df None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:26.919118 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:26.934205 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae162b6e-6883-47e5-88f9-b79ea30206a1 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:26.944638 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f3cba-db56-4f19-9cc7-9d2014d9103d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:26.945435 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f3cba-db56-4f19-9cc7-9d2014d9103d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:26.945717 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f3cba-db56-4f19-9cc7-9d2014d9103d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:26.945944 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f3cba-db56-4f19-9cc7-9d2014d9103d None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:26.946767 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f3cba-db56-4f19-9cc7-9d2014d9103d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:26.947074 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f3cba-db56-4f19-9cc7-9d2014d9103d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:26.948532 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f3cba-db56-4f19-9cc7-9d2014d9103d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:26.957449 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 538/1093] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:44:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:26.964113 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f3cba-db56-4f19-9cc7-9d2014d9103d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:26.976935 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e45aa-b0fc-407b-bb34-be6b2c70c0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:26.978350 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e45aa-b0fc-407b-bb34-be6b2c70c0b3 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:26.978350 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e45aa-b0fc-407b-bb34-be6b2c70c0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:26.978622 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e45aa-b0fc-407b-bb34-be6b2c70c0b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:26.979257 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e45aa-b0fc-407b-bb34-be6b2c70c0b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:26.979857 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e45aa-b0fc-407b-bb34-be6b2c70c0b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:26.982102 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e45aa-b0fc-407b-bb34-be6b2c70c0b3 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:26.996942 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 556/1094] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:27.002922 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e45aa-b0fc-407b-bb34-be6b2c70c0b3 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:27.087018 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f3cba-db56-4f19-9cc7-9d2014d9103d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:27.132963 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e1814-eb53-4bc6-a0b2-248fc7006ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:27.133978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e1814-eb53-4bc6-a0b2-248fc7006ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:27.134267 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e1814-eb53-4bc6-a0b2-248fc7006ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:27.134695 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e1814-eb53-4bc6-a0b2-248fc7006ef3 None admin] PATH_INFO: `/v3/users/0fca45c4008542bcbf8edb7ad9772b49` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:27.135923 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e1814-eb53-4bc6-a0b2-248fc7006ef3 None admin] RBAC: Authorizing `identity:get_user(user_id=0fca45c4008542bcbf8edb7ad9772b49)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:27.137392 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e1814-eb53-4bc6-a0b2-248fc7006ef3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:27.139409 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 539/1095] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:44:26 2022] GET /identity/v3/users/0fca45c4008542bcbf8edb7ad9772b49 => generated 285 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:27.144833 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e1814-eb53-4bc6-a0b2-248fc7006ef3 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:27.146188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e45aa-b0fc-407b-bb34-be6b2c70c0b3 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:27.163182 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:27.190743 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e31d39-4686-463f-befe-0e601a16d8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:27.191763 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e31d39-4686-463f-befe-0e601a16d8bf None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:27.195005 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e31d39-4686-463f-befe-0e601a16d8bf None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:27.198062 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e31d39-4686-463f-befe-0e601a16d8bf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:27.207045 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e31d39-4686-463f-befe-0e601a16d8bf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:27.208568 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e31d39-4686-463f-befe-0e601a16d8bf None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:27.229730 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-48e31d39-4686-463f-befe-0e601a16d8bf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:44:27.229730 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:27.229730 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:27.229730 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:27.229730 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:27.229730 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:27.229730 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:27.229730 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:27.229730 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:27.229730 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:27.229730 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:27.229730 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:27.229730 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:44:27.229730 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:44:27.229730 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:44:27.229730 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:44:27.230933 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:27.230933 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:27.230933 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:27.230933 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:27.230933 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:27.230933 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:27.230933 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:27.230933 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:27.230933 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:27.230933 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:27.230933 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:27.230933 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:27.230933 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:27.230933 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:27.230933 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:27.230933 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:27.230933 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:27.230933 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:27.231930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:27.231930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:27.231930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:44:27.231930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:44:27.231930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:44:27.231930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:44:27.231930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:44:27.231930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:44:27.231930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:44:27.231930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:27.231930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 557/1096] 10.222.0.85 () {56 vars in 1093 bytes} [Thu Jun 16 14:44:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:44:27.237687 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e31d39-4686-463f-befe-0e601a16d8bf None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:27.253104 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:27.288639 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e1814-eb53-4bc6-a0b2-248fc7006ef3 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:27.336471 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c104587-e8e5-4a84-8a47-e6ad43750de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:27.337579 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c104587-e8e5-4a84-8a47-e6ad43750de8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:27.337963 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c104587-e8e5-4a84-8a47-e6ad43750de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:27.338407 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c104587-e8e5-4a84-8a47-e6ad43750de8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:27.383310 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e31d39-4686-463f-befe-0e601a16d8bf None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:27.421669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bdc0a-cdac-4cb9-9ca6-f3408c19b871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:27.422419 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bdc0a-cdac-4cb9-9ca6-f3408c19b871 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:27.422699 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bdc0a-cdac-4cb9-9ca6-f3408c19b871 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:27.422943 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c104587-e8e5-4a84-8a47-e6ad43750de8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:27.423095 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bdc0a-cdac-4cb9-9ca6-f3408c19b871 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:27.423845 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bdc0a-cdac-4cb9-9ca6-f3408c19b871 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:27.424219 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bdc0a-cdac-4cb9-9ca6-f3408c19b871 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:27.424600 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c104587-e8e5-4a84-8a47-e6ad43750de8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:27.425666 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bdc0a-cdac-4cb9-9ca6-f3408c19b871 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:27.440130 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:27.446323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 558/1097] 10.222.0.85 () {56 vars in 1133 bytes} [Thu Jun 16 14:44:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:27.452593 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bdc0a-cdac-4cb9-9ca6-f3408c19b871 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:27.535427 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:27.539196 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 540/1098] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:44:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 14:44:27.548365 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c104587-e8e5-4a84-8a47-e6ad43750de8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:27.578500 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bdc0a-cdac-4cb9-9ca6-f3408c19b871 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:27.617879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a42628-c1cb-4635-be22-0fcfb2e99b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:27.617879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a42628-c1cb-4635-be22-0fcfb2e99b31 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:27.617879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a42628-c1cb-4635-be22-0fcfb2e99b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:27.618214 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a42628-c1cb-4635-be22-0fcfb2e99b31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:27.672020 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c104587-e8e5-4a84-8a47-e6ad43750de8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:27.692505 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:27.706161 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a42628-c1cb-4635-be22-0fcfb2e99b31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:27.707645 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a42628-c1cb-4635-be22-0fcfb2e99b31 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:27.717496 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31a6a8-f61c-4181-8318-23ea9230496e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:27.718375 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31a6a8-f61c-4181-8318-23ea9230496e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:27.718652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31a6a8-f61c-4181-8318-23ea9230496e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:27.718923 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31a6a8-f61c-4181-8318-23ea9230496e None admin] PATH_INFO: `/v3/projects/a42900dc30d84f5baeadcb88fcd566d9` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:27.720171 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af31a6a8-f61c-4181-8318-23ea9230496e None admin] RBAC: Authorizing `identity:get_project(project_id=a42900dc30d84f5baeadcb88fcd566d9)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:27.721615 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af31a6a8-f61c-4181-8318-23ea9230496e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:27.723375 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 541/1099] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:44:27 2022] GET /identity/v3/projects/a42900dc30d84f5baeadcb88fcd566d9 => generated 311 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:27.732271 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31a6a8-f61c-4181-8318-23ea9230496e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:27.787386 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:27.825142 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 559/1100] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:44:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 14:44:27.834688 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a42628-c1cb-4635-be22-0fcfb2e99b31 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:27.854032 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31a6a8-f61c-4181-8318-23ea9230496e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:27.890773 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e8d79-9d7a-4908-839f-0bf4de216c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:27.891251 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e8d79-9d7a-4908-839f-0bf4de216c1b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:27.891529 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e8d79-9d7a-4908-839f-0bf4de216c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:27.891798 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e8d79-9d7a-4908-839f-0bf4de216c1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:27.892663 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e8d79-9d7a-4908-839f-0bf4de216c1b None admin] RBAC: Adding query filter params (role.id=95dcfa6c726a4d01a41d2642554fd338, scope.project.id=a42900dc30d84f5baeadcb88fcd566d9, user.id=0fca45c4008542bcbf8edb7ad9772b49) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:27.892968 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e8d79-9d7a-4908-839f-0bf4de216c1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:27.894407 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e8d79-9d7a-4908-839f-0bf4de216c1b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:27.900811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 542/1101] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:44:27 2022] GET /identity/v3/role_assignments?user.id=0fca45c4008542bcbf8edb7ad9772b49&scope.project.id=a42900dc30d84f5baeadcb88fcd566d9&role.id=95dcfa6c726a4d01a41d2642554fd338 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:27.964899 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a42628-c1cb-4635-be22-0fcfb2e99b31 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:28.012975 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55827731-4b0d-46d1-83b2-c008b942fd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:28.014339 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55827731-4b0d-46d1-83b2-c008b942fd29 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:28.014824 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55827731-4b0d-46d1-83b2-c008b942fd29 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:28.015305 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55827731-4b0d-46d1-83b2-c008b942fd29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:28.027780 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55827731-4b0d-46d1-83b2-c008b942fd29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:28.029341 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55827731-4b0d-46d1-83b2-c008b942fd29 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:28.049362 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-55827731-4b0d-46d1-83b2-c008b942fd29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:28.049362 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:28.049362 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:28.049362 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:28.049362 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:28.049362 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:28.049362 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:28.049362 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:28.049362 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:28.049362 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:28.049362 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:28.049362 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:28.049362 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:28.049362 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:28.049362 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:28.050929 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:28.050929 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:28.050929 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:28.050929 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:28.050929 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:28.050929 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:28.050929 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:28.050929 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:28.050929 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:28.050929 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:28.050929 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:28.050929 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:28.050929 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:28.050929 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:28.050929 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:28.050929 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:28.050929 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:28.052669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:28.052669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:28.052669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:28.052669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:28.052669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 560/1102] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:44:28.056880 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e8d79-9d7a-4908-839f-0bf4de216c1b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:28.120265 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:28.196084 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e8d79-9d7a-4908-839f-0bf4de216c1b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:28.233104 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c24a00-cc73-43ca-aeaf-da1d95e54773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:28.233779 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c24a00-cc73-43ca-aeaf-da1d95e54773 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:28.234062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c24a00-cc73-43ca-aeaf-da1d95e54773 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:28.234339 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c24a00-cc73-43ca-aeaf-da1d95e54773 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:28.235066 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c24a00-cc73-43ca-aeaf-da1d95e54773 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:28.235366 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c24a00-cc73-43ca-aeaf-da1d95e54773 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:28.236800 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c24a00-cc73-43ca-aeaf-da1d95e54773 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:28.248819 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 543/1103] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:28.254695 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55827731-4b0d-46d1-83b2-c008b942fd29 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:28.282655 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:28.371066 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55827731-4b0d-46d1-83b2-c008b942fd29 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:28.407406 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d2798-dcbc-4aca-a328-6fd3df23aa80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:28.408251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d2798-dcbc-4aca-a328-6fd3df23aa80 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:28.408522 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d2798-dcbc-4aca-a328-6fd3df23aa80 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:28.408792 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d2798-dcbc-4aca-a328-6fd3df23aa80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:28.415850 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d2798-dcbc-4aca-a328-6fd3df23aa80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:28.417353 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d2798-dcbc-4aca-a328-6fd3df23aa80 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:28.432300 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-172d2798-dcbc-4aca-a328-6fd3df23aa80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:28.432300 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:28.432300 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:28.432300 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:28.432300 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:28.432300 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:28.432300 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:28.432300 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:28.432300 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:28.432300 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:28.432300 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:28.432300 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:28.432300 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:44:28.432300 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:44:28.432300 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:44:28.433314 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:44:28.433314 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:28.433314 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:28.433314 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:28.433314 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:28.433314 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:28.433314 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:28.433314 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:28.433314 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:28.433314 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:28.433314 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:28.433314 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:28.433314 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:28.433314 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:28.433314 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:28.433314 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:28.433314 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:28.434222 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:44:28.434222 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:44:28.434222 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:28.434222 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:28.434222 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:28.434222 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:28.434222 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:28.434222 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:28.434222 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 561/1104] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:28.439630 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c24a00-cc73-43ca-aeaf-da1d95e54773 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:28.549106 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c24a00-cc73-43ca-aeaf-da1d95e54773 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:28.556411 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:28.588056 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a78826-4852-4517-ab9e-e03d08ba046b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:28.588727 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a78826-4852-4517-ab9e-e03d08ba046b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:28.589057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a78826-4852-4517-ab9e-e03d08ba046b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:28.589361 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a78826-4852-4517-ab9e-e03d08ba046b None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:28.590181 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a78826-4852-4517-ab9e-e03d08ba046b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:28.590491 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a78826-4852-4517-ab9e-e03d08ba046b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:28.591930 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a78826-4852-4517-ab9e-e03d08ba046b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:28.605013 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 544/1105] 10.222.0.85 () {56 vars in 1148 bytes} [Thu Jun 16 14:44:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:28.611238 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d2798-dcbc-4aca-a328-6fd3df23aa80 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:28.699147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:28.720539 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d2798-dcbc-4aca-a328-6fd3df23aa80 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:28.756057 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919eee3-a0d8-4fc8-8019-0dcc19b73ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:28.756697 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919eee3-a0d8-4fc8-8019-0dcc19b73ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:28.756981 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919eee3-a0d8-4fc8-8019-0dcc19b73ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:28.757251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919eee3-a0d8-4fc8-8019-0dcc19b73ba7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:28.758295 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919eee3-a0d8-4fc8-8019-0dcc19b73ba7 None admin] RBAC: Adding query filter params (role.id=12e6cac1ace0476da69b56800ec15fbc, scope.project.id=80e309a3b3784ba9943734a41949b222, user.id=c74e4d1bdaa64ed280cc5f4c8e79b842) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:28.758619 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919eee3-a0d8-4fc8-8019-0dcc19b73ba7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:28.760117 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919eee3-a0d8-4fc8-8019-0dcc19b73ba7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:28.766739 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 562/1106] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:44:28 2022] GET /identity/v3/role_assignments?user.id=c74e4d1bdaa64ed280cc5f4c8e79b842&scope.project.id=80e309a3b3784ba9943734a41949b222&role.id=12e6cac1ace0476da69b56800ec15fbc => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:30.151799 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3dddeb-04af-40fb-8d69-01cc4fcbf080 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:30.152432 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3dddeb-04af-40fb-8d69-01cc4fcbf080 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:30.152432 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3dddeb-04af-40fb-8d69-01cc4fcbf080 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:30.153890 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 545/1107] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:44:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:30.161443 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d200388-1b62-4cfb-89ac-497e14629a16 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:30.162160 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d200388-1b62-4cfb-89ac-497e14629a16 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:30.162307 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d200388-1b62-4cfb-89ac-497e14629a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:30.192147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-6d200388-1b62-4cfb-89ac-497e14629a16 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:30.193941 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6d200388-1b62-4cfb-89ac-497e14629a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:30.271203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 563/1108] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:30.296973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3dddeb-04af-40fb-8d69-01cc4fcbf080 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:30.416573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3dddeb-04af-40fb-8d69-01cc4fcbf080 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:30.454905 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c87f5-9519-4edd-845f-0a40a51f2778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:30.455700 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c87f5-9519-4edd-845f-0a40a51f2778 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:30.456017 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c87f5-9519-4edd-845f-0a40a51f2778 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:30.456289 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c87f5-9519-4edd-845f-0a40a51f2778 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:30.457498 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c87f5-9519-4edd-845f-0a40a51f2778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:30.458957 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c87f5-9519-4edd-845f-0a40a51f2778 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:30.460771 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 546/1109] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:30.468082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d200388-1b62-4cfb-89ac-497e14629a16 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:30.555935 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:30.593532 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d200388-1b62-4cfb-89ac-497e14629a16 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:30.641347 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a3213-b2a9-40b1-adf5-2714b61cd196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:30.642027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a3213-b2a9-40b1-adf5-2714b61cd196 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:30.642310 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a3213-b2a9-40b1-adf5-2714b61cd196 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:30.642584 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a3213-b2a9-40b1-adf5-2714b61cd196 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:30.643302 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a3213-b2a9-40b1-adf5-2714b61cd196 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:30.644775 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a3213-b2a9-40b1-adf5-2714b61cd196 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:30.671482 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 564/1110] 10.222.0.85 () {60 vars in 1132 bytes} [Thu Jun 16 14:44:30 2022] POST /identity/v3/users => generated 286 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:44:32.890802 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbe8e8-1215-4a47-8f1c-e353dba376ec None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:32.891664 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbe8e8-1215-4a47-8f1c-e353dba376ec None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:32.891664 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbe8e8-1215-4a47-8f1c-e353dba376ec None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:32.893807 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 547/1111] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:44:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:32.902475 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dc243-3f06-4537-b6e5-1f39224ce5c2 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:32.903159 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dc243-3f06-4537-b6e5-1f39224ce5c2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:32.903442 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dc243-3f06-4537-b6e5-1f39224ce5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:32.925067 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-166dc243-3f06-4537-b6e5-1f39224ce5c2 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:32.926900 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-166dc243-3f06-4537-b6e5-1f39224ce5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:33.018428 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 565/1112] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:33.060086 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbe8e8-1215-4a47-8f1c-e353dba376ec None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:33.109123 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:33.187854 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbe8e8-1215-4a47-8f1c-e353dba376ec None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:33.225689 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8162627-35cc-433e-a2bd-e8293c3f6e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:33.226570 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8162627-35cc-433e-a2bd-e8293c3f6e6f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:33.226847 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8162627-35cc-433e-a2bd-e8293c3f6e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:33.227120 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8162627-35cc-433e-a2bd-e8293c3f6e6f None admin] PATH_INFO: `/v3/roles/2f7fa8924ea9447aab26981f0329ad43` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:33.228667 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8162627-35cc-433e-a2bd-e8293c3f6e6f None admin] RBAC: Authorizing `identity:get_role(role_id=2f7fa8924ea9447aab26981f0329ad43)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:33.230039 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8162627-35cc-433e-a2bd-e8293c3f6e6f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:33.231427 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 548/1113] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:44:33 2022] GET /identity/v3/roles/2f7fa8924ea9447aab26981f0329ad43 => generated 223 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:33.238864 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166dc243-3f06-4537-b6e5-1f39224ce5c2 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:33.308184 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:33.351087 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166dc243-3f06-4537-b6e5-1f39224ce5c2 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:33.389251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141a322-a36b-40ca-a85b-4bd4482c4b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:33.390141 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141a322-a36b-40ca-a85b-4bd4482c4b7e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:33.390419 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141a322-a36b-40ca-a85b-4bd4482c4b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:33.390690 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141a322-a36b-40ca-a85b-4bd4482c4b7e None admin] PATH_INFO: `/v3/users/ef8936cf03dd4741b4eefca407645916` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:33.405103 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141a322-a36b-40ca-a85b-4bd4482c4b7e None admin] RBAC: Authorizing `identity:get_user(user_id=ef8936cf03dd4741b4eefca407645916)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:33.406565 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141a322-a36b-40ca-a85b-4bd4482c4b7e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:33.408295 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 566/1114] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:44:33 2022] GET /identity/v3/users/ef8936cf03dd4741b4eefca407645916 => generated 286 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:33.416849 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8162627-35cc-433e-a2bd-e8293c3f6e6f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:33.533636 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8162627-35cc-433e-a2bd-e8293c3f6e6f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:33.535194 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:33.572528 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7474246-a067-4fbd-9d40-fa01f778d500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:33.573263 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7474246-a067-4fbd-9d40-fa01f778d500 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:33.573547 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7474246-a067-4fbd-9d40-fa01f778d500 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:33.573807 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7474246-a067-4fbd-9d40-fa01f778d500 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:33.657780 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7474246-a067-4fbd-9d40-fa01f778d500 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:33.660067 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7474246-a067-4fbd-9d40-fa01f778d500 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:33.769234 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 549/1115] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:44:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:44:33.776250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141a322-a36b-40ca-a85b-4bd4482c4b7e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:33.892122 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141a322-a36b-40ca-a85b-4bd4482c4b7e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:33.909549 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:33.928519 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41b6b7-337b-481e-848c-d219a811b505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:33.929379 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41b6b7-337b-481e-848c-d219a811b505 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:33.929713 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41b6b7-337b-481e-848c-d219a811b505 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:33.930124 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41b6b7-337b-481e-848c-d219a811b505 None admin] PATH_INFO: `/v3/projects/a42900dc30d84f5baeadcb88fcd566d9` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:33.931340 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41b6b7-337b-481e-848c-d219a811b505 None admin] RBAC: Authorizing `identity:get_project(project_id=a42900dc30d84f5baeadcb88fcd566d9)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:33.932821 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41b6b7-337b-481e-848c-d219a811b505 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:33.934537 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 567/1116] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:44:33 2022] GET /identity/v3/projects/a42900dc30d84f5baeadcb88fcd566d9 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:33.941035 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7474246-a067-4fbd-9d40-fa01f778d500 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:33.943458 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:34.055714 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7474246-a067-4fbd-9d40-fa01f778d500 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:34.097507 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84dca84-3841-46b3-9731-f4bdaa516410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:34.098171 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dca84-3841-46b3-9731-f4bdaa516410 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:34.098458 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dca84-3841-46b3-9731-f4bdaa516410 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:34.098831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dca84-3841-46b3-9731-f4bdaa516410 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:34.099735 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84dca84-3841-46b3-9731-f4bdaa516410 None admin] RBAC: Adding query filter params (role.id=2f7fa8924ea9447aab26981f0329ad43, scope.project.id=a42900dc30d84f5baeadcb88fcd566d9, user.id=ef8936cf03dd4741b4eefca407645916) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:34.100105 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84dca84-3841-46b3-9731-f4bdaa516410 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:34.101562 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84dca84-3841-46b3-9731-f4bdaa516410 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:34.107437 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 550/1117] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:44:33 2022] GET /identity/v3/role_assignments?user.id=ef8936cf03dd4741b4eefca407645916&scope.project.id=a42900dc30d84f5baeadcb88fcd566d9&role.id=2f7fa8924ea9447aab26981f0329ad43 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:36.244815 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9353c-ef36-4c34-85f9-2cc465fb9cfc None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:36.245728 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9353c-ef36-4c34-85f9-2cc465fb9cfc None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:36.245728 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9353c-ef36-4c34-85f9-2cc465fb9cfc None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:36.247931 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 568/1118] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:44:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:36.256996 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772c8ba-088c-4be7-856b-08abfaaa3d62 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:36.257972 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772c8ba-088c-4be7-856b-08abfaaa3d62 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:36.257972 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772c8ba-088c-4be7-856b-08abfaaa3d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:36.281782 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-6772c8ba-088c-4be7-856b-08abfaaa3d62 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:36.282973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6772c8ba-088c-4be7-856b-08abfaaa3d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:36.349935 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:36.363163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 551/1119] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:36.386868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9353c-ef36-4c34-85f9-2cc465fb9cfc None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:36.505260 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9353c-ef36-4c34-85f9-2cc465fb9cfc None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:36.540460 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96a6de-9234-4cae-bea4-98c7297d2875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:36.541325 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96a6de-9234-4cae-bea4-98c7297d2875 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:36.541722 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96a6de-9234-4cae-bea4-98c7297d2875 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:36.542027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96a6de-9234-4cae-bea4-98c7297d2875 None admin] PATH_INFO: `/v3/roles/2f7fa8924ea9447aab26981f0329ad43` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:36.543532 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96a6de-9234-4cae-bea4-98c7297d2875 None admin] RBAC: Authorizing `identity:get_role(role_id=2f7fa8924ea9447aab26981f0329ad43)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:36.544969 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96a6de-9234-4cae-bea4-98c7297d2875 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:36.546722 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 569/1120] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:44:36 2022] GET /identity/v3/roles/2f7fa8924ea9447aab26981f0329ad43 => generated 223 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:36.556466 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772c8ba-088c-4be7-856b-08abfaaa3d62 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:36.663445 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772c8ba-088c-4be7-856b-08abfaaa3d62 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:36.700960 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7938e-0898-4111-b68b-8030370e804f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:36.701830 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7938e-0898-4111-b68b-8030370e804f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:36.702105 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7938e-0898-4111-b68b-8030370e804f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:36.702375 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7938e-0898-4111-b68b-8030370e804f None admin] PATH_INFO: `/v3/users/ef8936cf03dd4741b4eefca407645916` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:36.703669 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7938e-0898-4111-b68b-8030370e804f None admin] RBAC: Authorizing `identity:get_user(user_id=ef8936cf03dd4741b4eefca407645916)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:36.705136 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7938e-0898-4111-b68b-8030370e804f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:36.706776 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 552/1121] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:44:36 2022] GET /identity/v3/users/ef8936cf03dd4741b4eefca407645916 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:36.712894 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96a6de-9234-4cae-bea4-98c7297d2875 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:36.771517 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:36.822803 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96a6de-9234-4cae-bea4-98c7297d2875 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:36.857949 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e306e07-e3dd-4135-ac35-cda55d3408ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:36.858806 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e306e07-e3dd-4135-ac35-cda55d3408ff None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:36.859081 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e306e07-e3dd-4135-ac35-cda55d3408ff None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:36.859355 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e306e07-e3dd-4135-ac35-cda55d3408ff None admin] PATH_INFO: `/v3/projects/a42900dc30d84f5baeadcb88fcd566d9` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:36.860551 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e306e07-e3dd-4135-ac35-cda55d3408ff None admin] RBAC: Authorizing `identity:get_project(project_id=a42900dc30d84f5baeadcb88fcd566d9)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:36.861987 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e306e07-e3dd-4135-ac35-cda55d3408ff None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:36.863712 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 570/1122] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:44:36 2022] GET /identity/v3/projects/a42900dc30d84f5baeadcb88fcd566d9 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:36.870471 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7938e-0898-4111-b68b-8030370e804f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:36.939081 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:36.978869 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7938e-0898-4111-b68b-8030370e804f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:37.014023 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e746d-821e-4e39-88a2-6bdf0a5e8aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:37.014924 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e746d-821e-4e39-88a2-6bdf0a5e8aa4 None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:37.015203 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e746d-821e-4e39-88a2-6bdf0a5e8aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:37.015483 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e746d-821e-4e39-88a2-6bdf0a5e8aa4 None admin] PATH_INFO: `/v3/projects/a42900dc30d84f5baeadcb88fcd566d9/users/ef8936cf03dd4741b4eefca407645916/roles/2f7fa8924ea9447aab26981f0329ad43` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:37.017978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e746d-821e-4e39-88a2-6bdf0a5e8aa4 None admin] RBAC: Authorizing `identity:create_grant(project_id=a42900dc30d84f5baeadcb88fcd566d9, user_id=ef8936cf03dd4741b4eefca407645916, role_id=2f7fa8924ea9447aab26981f0329ad43)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:37.019428 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e746d-821e-4e39-88a2-6bdf0a5e8aa4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:37.035596 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 553/1123] 10.222.0.85 () {58 vars in 1439 bytes} [Thu Jun 16 14:44:36 2022] PUT /identity/v3/projects/a42900dc30d84f5baeadcb88fcd566d9/users/ef8936cf03dd4741b4eefca407645916/roles/2f7fa8924ea9447aab26981f0329ad43 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:44:39.137716 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7022c5-500b-40dd-ab08-a49921cd72bf None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:39.138578 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7022c5-500b-40dd-ab08-a49921cd72bf None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:39.138578 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7022c5-500b-40dd-ab08-a49921cd72bf None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:39.140889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 571/1124] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:44:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:39.146354 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0fbad-62ce-406e-ba24-1034c43da5e8 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:39.146809 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0fbad-62ce-406e-ba24-1034c43da5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:39.146901 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0fbad-62ce-406e-ba24-1034c43da5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:39.164721 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-bea0fbad-62ce-406e-ba24-1034c43da5e8 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:39.165900 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-bea0fbad-62ce-406e-ba24-1034c43da5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:39.239727 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 554/1125] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:39.263965 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7022c5-500b-40dd-ab08-a49921cd72bf None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:39.381311 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7022c5-500b-40dd-ab08-a49921cd72bf None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:39.407439 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:39.428279 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8b863-c7bf-4379-8f55-647d1360620a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:39.429486 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8b863-c7bf-4379-8f55-647d1360620a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:39.429767 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8b863-c7bf-4379-8f55-647d1360620a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:39.430039 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8b863-c7bf-4379-8f55-647d1360620a None admin] PATH_INFO: `/v3/roles/2f7fa8924ea9447aab26981f0329ad43` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:39.431632 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8b863-c7bf-4379-8f55-647d1360620a None admin] RBAC: Authorizing `identity:get_role(role_id=2f7fa8924ea9447aab26981f0329ad43)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:39.433061 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8b863-c7bf-4379-8f55-647d1360620a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:39.434464 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 572/1126] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:44:39 2022] GET /identity/v3/roles/2f7fa8924ea9447aab26981f0329ad43 => generated 223 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:39.440704 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0fbad-62ce-406e-ba24-1034c43da5e8 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:39.498363 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:39.554087 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0fbad-62ce-406e-ba24-1034c43da5e8 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:39.593844 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713cb80-48bd-41b2-b993-93c99435fdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:39.594719 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713cb80-48bd-41b2-b993-93c99435fdaa None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:39.594994 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713cb80-48bd-41b2-b993-93c99435fdaa None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:39.595263 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713cb80-48bd-41b2-b993-93c99435fdaa None admin] PATH_INFO: `/v3/users/ef8936cf03dd4741b4eefca407645916` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:39.596570 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713cb80-48bd-41b2-b993-93c99435fdaa None admin] RBAC: Authorizing `identity:get_user(user_id=ef8936cf03dd4741b4eefca407645916)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:39.598016 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713cb80-48bd-41b2-b993-93c99435fdaa None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:39.599679 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 555/1127] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:44:39 2022] GET /identity/v3/users/ef8936cf03dd4741b4eefca407645916 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:39.606243 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8b863-c7bf-4379-8f55-647d1360620a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:39.712658 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8b863-c7bf-4379-8f55-647d1360620a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:39.749604 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e56783-b4ee-4b38-8f0f-69d07f18a3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:39.750249 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e56783-b4ee-4b38-8f0f-69d07f18a3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:39.750526 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e56783-b4ee-4b38-8f0f-69d07f18a3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:39.750799 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e56783-b4ee-4b38-8f0f-69d07f18a3e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:39.811118 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:39.822727 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e56783-b4ee-4b38-8f0f-69d07f18a3e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:39.824206 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e56783-b4ee-4b38-8f0f-69d07f18a3e4 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:39.933887 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 573/1128] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:44:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:44:39.943627 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713cb80-48bd-41b2-b993-93c99435fdaa None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:40.061599 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713cb80-48bd-41b2-b993-93c99435fdaa None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:40.084835 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:40.099687 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba7885-4cd9-43b8-aa8b-622549b7b798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:40.100588 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba7885-4cd9-43b8-aa8b-622549b7b798 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:40.100867 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba7885-4cd9-43b8-aa8b-622549b7b798 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:40.101141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba7885-4cd9-43b8-aa8b-622549b7b798 None admin] PATH_INFO: `/v3/projects/a42900dc30d84f5baeadcb88fcd566d9` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:40.102551 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba7885-4cd9-43b8-aa8b-622549b7b798 None admin] RBAC: Authorizing `identity:get_project(project_id=a42900dc30d84f5baeadcb88fcd566d9)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:40.104022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba7885-4cd9-43b8-aa8b-622549b7b798 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:40.105761 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 556/1129] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:44:39 2022] GET /identity/v3/projects/a42900dc30d84f5baeadcb88fcd566d9 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:40.112912 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e56783-b4ee-4b38-8f0f-69d07f18a3e4 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:40.222775 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:40.233517 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e56783-b4ee-4b38-8f0f-69d07f18a3e4 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:40.277317 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd7f2e7-669b-4b05-a266-c0c4e062f0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:40.277965 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7f2e7-669b-4b05-a266-c0c4e062f0e4 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:40.278266 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7f2e7-669b-4b05-a266-c0c4e062f0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:40.278534 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7f2e7-669b-4b05-a266-c0c4e062f0e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:40.279558 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd7f2e7-669b-4b05-a266-c0c4e062f0e4 None admin] RBAC: Adding query filter params (role.id=2f7fa8924ea9447aab26981f0329ad43, scope.project.id=a42900dc30d84f5baeadcb88fcd566d9, user.id=ef8936cf03dd4741b4eefca407645916) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:40.280074 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd7f2e7-669b-4b05-a266-c0c4e062f0e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:40.281554 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd7f2e7-669b-4b05-a266-c0c4e062f0e4 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:40.288315 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 574/1130] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:44:40 2022] GET /identity/v3/role_assignments?user.id=ef8936cf03dd4741b4eefca407645916&scope.project.id=a42900dc30d84f5baeadcb88fcd566d9&role.id=2f7fa8924ea9447aab26981f0329ad43 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:42.417905 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3b230-a3d8-4c42-989c-dd10c8377269 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:42.418837 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3b230-a3d8-4c42-989c-dd10c8377269 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:42.418837 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3b230-a3d8-4c42-989c-dd10c8377269 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:42.421399 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 557/1131] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:44:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:42.430363 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ec85b-d728-439e-9438-b781087a0788 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:42.431248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ec85b-d728-439e-9438-b781087a0788 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:42.431248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ec85b-d728-439e-9438-b781087a0788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:42.457969 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-192ec85b-d728-439e-9438-b781087a0788 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:42.459749 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-192ec85b-d728-439e-9438-b781087a0788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:42.538840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 575/1132] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:42.573113 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3b230-a3d8-4c42-989c-dd10c8377269 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:42.688138 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3b230-a3d8-4c42-989c-dd10c8377269 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:42.728781 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d19764-494c-4243-aca3-0cf6214f76e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:42.729588 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d19764-494c-4243-aca3-0cf6214f76e2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:42.729867 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d19764-494c-4243-aca3-0cf6214f76e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:42.730125 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d19764-494c-4243-aca3-0cf6214f76e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:42.731459 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d19764-494c-4243-aca3-0cf6214f76e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:42.732941 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d19764-494c-4243-aca3-0cf6214f76e2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:42.734618 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 558/1133] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:42.743676 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ec85b-d728-439e-9438-b781087a0788 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:42.840074 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:42.858843 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ec85b-d728-439e-9438-b781087a0788 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:42.897590 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b988cd-e20e-42d3-a551-2fee2f39333e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:42.898404 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b988cd-e20e-42d3-a551-2fee2f39333e None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:42.898939 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b988cd-e20e-42d3-a551-2fee2f39333e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:42.899225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b988cd-e20e-42d3-a551-2fee2f39333e None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:42.899978 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b988cd-e20e-42d3-a551-2fee2f39333e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:42.901464 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b988cd-e20e-42d3-a551-2fee2f39333e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:42.934813 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 576/1134] 10.222.0.85 () {60 vars in 1141 bytes} [Thu Jun 16 14:44:42 2022] POST /identity/v3/projects => generated 311 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:44:45.126693 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e3cf6-2217-4ef5-a3a9-ecba72c2bef4 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:45.127532 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e3cf6-2217-4ef5-a3a9-ecba72c2bef4 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:45.127724 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e3cf6-2217-4ef5-a3a9-ecba72c2bef4 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:45.129809 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 559/1135] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:44:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:45.136756 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef15ff-1138-43d9-9fc5-cc384e53fd8f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:45.137167 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef15ff-1138-43d9-9fc5-cc384e53fd8f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:45.137314 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef15ff-1138-43d9-9fc5-cc384e53fd8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:45.156500 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-15ef15ff-1138-43d9-9fc5-cc384e53fd8f None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:45.157709 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-15ef15ff-1138-43d9-9fc5-cc384e53fd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:45.232061 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 577/1136] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:45.257211 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e3cf6-2217-4ef5-a3a9-ecba72c2bef4 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:45.326126 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:45.376435 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e3cf6-2217-4ef5-a3a9-ecba72c2bef4 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:45.416684 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f95b8d-6797-47ec-95aa-9bb0e255f868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:45.417417 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f95b8d-6797-47ec-95aa-9bb0e255f868 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:45.417699 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f95b8d-6797-47ec-95aa-9bb0e255f868 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:45.417977 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f95b8d-6797-47ec-95aa-9bb0e255f868 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:45.419230 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f95b8d-6797-47ec-95aa-9bb0e255f868 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:45.421079 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f95b8d-6797-47ec-95aa-9bb0e255f868 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:45.422800 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 560/1137] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:45.428817 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef15ff-1138-43d9-9fc5-cc384e53fd8f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:45.495797 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:45.540244 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef15ff-1138-43d9-9fc5-cc384e53fd8f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:45.578772 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898bdbeb-92e4-46c1-879c-f7e95aac738d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:45.579446 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bdbeb-92e4-46c1-879c-f7e95aac738d None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:45.579726 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bdbeb-92e4-46c1-879c-f7e95aac738d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:45.580039 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bdbeb-92e4-46c1-879c-f7e95aac738d None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:45.580765 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898bdbeb-92e4-46c1-879c-f7e95aac738d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:45.582205 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898bdbeb-92e4-46c1-879c-f7e95aac738d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:45.606221 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 578/1138] 10.222.0.85 () {60 vars in 1132 bytes} [Thu Jun 16 14:44:45 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:44:47.775752 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdfe13-c88e-4067-91d5-e302e33cf9c8 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:47.776402 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdfe13-c88e-4067-91d5-e302e33cf9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:47.776752 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdfe13-c88e-4067-91d5-e302e33cf9c8 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:47.779217 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 561/1139] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:44:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:47.787353 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895ca47-8bcc-44d1-a0f2-4aefc417f5af None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:47.787823 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895ca47-8bcc-44d1-a0f2-4aefc417f5af None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:47.787966 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895ca47-8bcc-44d1-a0f2-4aefc417f5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:47.805706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-8895ca47-8bcc-44d1-a0f2-4aefc417f5af None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:47.806904 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8895ca47-8bcc-44d1-a0f2-4aefc417f5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:47.901784 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 579/1140] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:47.927259 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdfe13-c88e-4067-91d5-e302e33cf9c8 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:48.040081 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdfe13-c88e-4067-91d5-e302e33cf9c8 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:48.072575 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:48.082572 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e220ed0-db97-4569-857d-794cfeddd9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:48.083381 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e220ed0-db97-4569-857d-794cfeddd9ee None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:48.083663 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e220ed0-db97-4569-857d-794cfeddd9ee None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:48.083967 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e220ed0-db97-4569-857d-794cfeddd9ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:48.094698 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e220ed0-db97-4569-857d-794cfeddd9ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:48.102570 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-2e220ed0-db97-4569-857d-794cfeddd9ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:44:48.102570 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:48.102570 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:48.102570 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:48.102570 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:48.102570 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:48.102570 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:48.102570 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:48.102570 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:48.102570 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:48.102570 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:48.102570 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:48.102570 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:48.102570 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:48.102570 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:48.102570 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:48.103732 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:48.103732 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:48.103732 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:48.103732 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:48.103732 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:48.103732 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:48.103732 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:48.103732 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:48.103732 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:48.103732 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:48.103732 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:48.103732 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:48.103732 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:48.103732 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:48.103732 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:48.103732 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:48.105319 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:48.105319 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:48.105319 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:48.105319 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:48.105319 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:48.105319 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:48.105319 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:48.105319 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:48.105319 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:48.105319 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:48.105319 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:44:48.105319 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:48.105319 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 562/1141] 10.222.0.85 () {56 vars in 1096 bytes} [Thu Jun 16 14:44:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:48.111061 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895ca47-8bcc-44d1-a0f2-4aefc417f5af None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:48.168879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:48.230663 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895ca47-8bcc-44d1-a0f2-4aefc417f5af None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:48.267018 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3dfd9e-13d0-4c75-b166-701fa9537cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:48.267697 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3dfd9e-13d0-4c75-b166-701fa9537cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:48.268009 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3dfd9e-13d0-4c75-b166-701fa9537cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:48.268255 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3dfd9e-13d0-4c75-b166-701fa9537cb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:48.269024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3dfd9e-13d0-4c75-b166-701fa9537cb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:48.269321 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3dfd9e-13d0-4c75-b166-701fa9537cb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:48.270714 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3dfd9e-13d0-4c75-b166-701fa9537cb1 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:48.282479 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 580/1142] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:44:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:48.289105 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e220ed0-db97-4569-857d-794cfeddd9ee None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:48.423076 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e220ed0-db97-4569-857d-794cfeddd9ee None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:48.457856 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e8b7a-e7c1-4c10-85c5-a7090bafe91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:48.458723 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e8b7a-e7c1-4c10-85c5-a7090bafe91d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:48.459005 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e8b7a-e7c1-4c10-85c5-a7090bafe91d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:48.459274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e8b7a-e7c1-4c10-85c5-a7090bafe91d None admin] PATH_INFO: `/v3/users/113613f83898479aa004a11810474a75` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:48.474770 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e8b7a-e7c1-4c10-85c5-a7090bafe91d None admin] RBAC: Authorizing `identity:get_user(user_id=113613f83898479aa004a11810474a75)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:48.476467 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e8b7a-e7c1-4c10-85c5-a7090bafe91d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:48.478245 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 563/1143] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:44:48 2022] GET /identity/v3/users/113613f83898479aa004a11810474a75 => generated 286 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:48.484300 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3dfd9e-13d0-4c75-b166-701fa9537cb1 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:48.593965 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3dfd9e-13d0-4c75-b166-701fa9537cb1 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:48.609002 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:48.629710 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03710022-c7e6-4166-a894-dea81ffd40c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:48.630356 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03710022-c7e6-4166-a894-dea81ffd40c4 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:48.630636 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03710022-c7e6-4166-a894-dea81ffd40c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:48.631002 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03710022-c7e6-4166-a894-dea81ffd40c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:48.709785 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03710022-c7e6-4166-a894-dea81ffd40c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:48.711776 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03710022-c7e6-4166-a894-dea81ffd40c4 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:48.821758 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 581/1144] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:44:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:44:48.828173 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e8b7a-e7c1-4c10-85c5-a7090bafe91d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:48.878287 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:48.941310 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e8b7a-e7c1-4c10-85c5-a7090bafe91d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:48.979312 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6305d-bb14-4aa0-b1c3-2d65ba4161e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:48.980116 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6305d-bb14-4aa0-b1c3-2d65ba4161e6 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:48.980393 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6305d-bb14-4aa0-b1c3-2d65ba4161e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:48.980645 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6305d-bb14-4aa0-b1c3-2d65ba4161e6 None admin] PATH_INFO: `/v3/projects/279f28ac4c30447ea6d61a41442e0f73` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:48.981839 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6305d-bb14-4aa0-b1c3-2d65ba4161e6 None admin] RBAC: Authorizing `identity:get_project(project_id=279f28ac4c30447ea6d61a41442e0f73)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:48.983271 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6305d-bb14-4aa0-b1c3-2d65ba4161e6 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:48.985022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 564/1145] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:44:48 2022] GET /identity/v3/projects/279f28ac4c30447ea6d61a41442e0f73 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:48.991314 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03710022-c7e6-4166-a894-dea81ffd40c4 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:49.014337 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:49.114166 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03710022-c7e6-4166-a894-dea81ffd40c4 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:49.150234 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b75f14-aaf8-4a62-a0e5-973a0a608772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:49.150880 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b75f14-aaf8-4a62-a0e5-973a0a608772 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:49.151164 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b75f14-aaf8-4a62-a0e5-973a0a608772 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:49.151429 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b75f14-aaf8-4a62-a0e5-973a0a608772 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:49.152280 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b75f14-aaf8-4a62-a0e5-973a0a608772 None admin] RBAC: Adding query filter params (role.id=95dcfa6c726a4d01a41d2642554fd338, scope.project.id=279f28ac4c30447ea6d61a41442e0f73, user.id=113613f83898479aa004a11810474a75) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:49.152588 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b75f14-aaf8-4a62-a0e5-973a0a608772 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:49.154017 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b75f14-aaf8-4a62-a0e5-973a0a608772 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:49.159821 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 582/1146] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:44:48 2022] GET /identity/v3/role_assignments?user.id=113613f83898479aa004a11810474a75&scope.project.id=279f28ac4c30447ea6d61a41442e0f73&role.id=95dcfa6c726a4d01a41d2642554fd338 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:51.284815 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136498c-cc65-4f00-aae3-bf24e0f71bba None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:51.285366 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136498c-cc65-4f00-aae3-bf24e0f71bba None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:51.285366 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136498c-cc65-4f00-aae3-bf24e0f71bba None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:51.286748 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 565/1147] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:44:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:51.292660 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25991646-6edf-4a83-aed3-5915e9e20e31 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:51.293175 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25991646-6edf-4a83-aed3-5915e9e20e31 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:51.293175 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25991646-6edf-4a83-aed3-5915e9e20e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:51.311027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-25991646-6edf-4a83-aed3-5915e9e20e31 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:51.312258 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-25991646-6edf-4a83-aed3-5915e9e20e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:51.389312 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 583/1148] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:51.412494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136498c-cc65-4f00-aae3-bf24e0f71bba None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:51.537566 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136498c-cc65-4f00-aae3-bf24e0f71bba None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:51.554291 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:51.581850 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5bca7-3ce4-4e2f-b0f6-11729472d601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:51.582720 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5bca7-3ce4-4e2f-b0f6-11729472d601 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:51.583050 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5bca7-3ce4-4e2f-b0f6-11729472d601 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:51.583369 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5bca7-3ce4-4e2f-b0f6-11729472d601 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:51.594796 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5bca7-3ce4-4e2f-b0f6-11729472d601 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:51.603493 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-1eb5bca7-3ce4-4e2f-b0f6-11729472d601 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:44:51.603493 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:51.603493 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:51.603493 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:51.603493 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:51.603493 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:51.603493 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:51.603493 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:51.603493 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:51.603493 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:51.603493 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:51.603493 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:51.603493 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:51.603493 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:51.603493 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:51.603493 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:51.604655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:51.604655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:51.604655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:51.604655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:51.604655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:51.604655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:51.604655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:51.604655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:51.604655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:51.604655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:51.604655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:51.604655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:51.604655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:51.604655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:51.604655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:51.604655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:51.605731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:51.605731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:51.605731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:51.605731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:51.605731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:51.605731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:51.605731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:51.605731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:51.605731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:51.605731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:51.605731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:44:51.605731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:51.605731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 566/1149] 10.222.0.85 () {56 vars in 1096 bytes} [Thu Jun 16 14:44:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:51.611372 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25991646-6edf-4a83-aed3-5915e9e20e31 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:51.623157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:51.720530 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25991646-6edf-4a83-aed3-5915e9e20e31 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:51.756512 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774834a-5451-437a-bfcd-2acaab83363e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:51.757196 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774834a-5451-437a-bfcd-2acaab83363e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:51.757479 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774834a-5451-437a-bfcd-2acaab83363e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:51.757917 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774834a-5451-437a-bfcd-2acaab83363e None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:51.758966 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1774834a-5451-437a-bfcd-2acaab83363e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:51.759269 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1774834a-5451-437a-bfcd-2acaab83363e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:51.760676 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1774834a-5451-437a-bfcd-2acaab83363e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:51.769238 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 584/1150] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:44:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:51.777023 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5bca7-3ce4-4e2f-b0f6-11729472d601 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:51.905164 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5bca7-3ce4-4e2f-b0f6-11729472d601 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:51.942397 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5f931-7b57-4989-b6d7-841f78ca2f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:51.943262 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5f931-7b57-4989-b6d7-841f78ca2f74 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:51.943562 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5f931-7b57-4989-b6d7-841f78ca2f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:51.943838 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5f931-7b57-4989-b6d7-841f78ca2f74 None admin] PATH_INFO: `/v3/users/113613f83898479aa004a11810474a75` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:51.945137 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5f931-7b57-4989-b6d7-841f78ca2f74 None admin] RBAC: Authorizing `identity:get_user(user_id=113613f83898479aa004a11810474a75)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:51.946807 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5f931-7b57-4989-b6d7-841f78ca2f74 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:51.948507 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 567/1151] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:44:51 2022] GET /identity/v3/users/113613f83898479aa004a11810474a75 => generated 286 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:51.954619 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774834a-5451-437a-bfcd-2acaab83363e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:52.032234 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:52.067409 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774834a-5451-437a-bfcd-2acaab83363e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:52.104535 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76111c-e1d3-44be-808f-3e9f454d3807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:52.105420 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76111c-e1d3-44be-808f-3e9f454d3807 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:52.105700 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76111c-e1d3-44be-808f-3e9f454d3807 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:52.105963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76111c-e1d3-44be-808f-3e9f454d3807 None admin] PATH_INFO: `/v3/projects/279f28ac4c30447ea6d61a41442e0f73` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:52.107324 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76111c-e1d3-44be-808f-3e9f454d3807 None admin] RBAC: Authorizing `identity:get_project(project_id=279f28ac4c30447ea6d61a41442e0f73)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:52.108814 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76111c-e1d3-44be-808f-3e9f454d3807 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:52.110546 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 585/1152] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:44:51 2022] GET /identity/v3/projects/279f28ac4c30447ea6d61a41442e0f73 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:52.117083 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5f931-7b57-4989-b6d7-841f78ca2f74 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:52.166186 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:52.228451 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5f931-7b57-4989-b6d7-841f78ca2f74 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:52.266414 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66760f2-f66d-49a8-b2da-bb420eb4d49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:52.267367 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66760f2-f66d-49a8-b2da-bb420eb4d49b None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:52.267611 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66760f2-f66d-49a8-b2da-bb420eb4d49b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:52.267912 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66760f2-f66d-49a8-b2da-bb420eb4d49b None admin] PATH_INFO: `/v3/projects/279f28ac4c30447ea6d61a41442e0f73/users/113613f83898479aa004a11810474a75/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:52.269864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66760f2-f66d-49a8-b2da-bb420eb4d49b None admin] RBAC: Authorizing `identity:create_grant(project_id=279f28ac4c30447ea6d61a41442e0f73, user_id=113613f83898479aa004a11810474a75, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:52.271345 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66760f2-f66d-49a8-b2da-bb420eb4d49b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:52.291818 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 568/1153] 10.222.0.85 () {58 vars in 1439 bytes} [Thu Jun 16 14:44:52 2022] PUT /identity/v3/projects/279f28ac4c30447ea6d61a41442e0f73/users/113613f83898479aa004a11810474a75/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:44:54.452773 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933646d4-8fca-46b6-a0b2-7dec3c7f60c2 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:54.453424 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933646d4-8fca-46b6-a0b2-7dec3c7f60c2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:54.453424 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933646d4-8fca-46b6-a0b2-7dec3c7f60c2 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:54.454685 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 586/1154] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:54.460332 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19b565-495d-483c-ab72-e92455e68c2c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:54.460986 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19b565-495d-483c-ab72-e92455e68c2c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:54.460986 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19b565-495d-483c-ab72-e92455e68c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:54.479281 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-9e19b565-495d-483c-ab72-e92455e68c2c None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:54.480527 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9e19b565-495d-483c-ab72-e92455e68c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:54.567890 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 569/1155] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:54.595832 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933646d4-8fca-46b6-a0b2-7dec3c7f60c2 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:54.709848 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933646d4-8fca-46b6-a0b2-7dec3c7f60c2 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:54.747303 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f729a-fe8f-4408-9e8d-0751948a5352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:54.748210 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f729a-fe8f-4408-9e8d-0751948a5352 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:54.748484 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f729a-fe8f-4408-9e8d-0751948a5352 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:54.748760 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f729a-fe8f-4408-9e8d-0751948a5352 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:54.756490 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:54.762338 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f729a-fe8f-4408-9e8d-0751948a5352 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:54.770923 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-821f729a-fe8f-4408-9e8d-0751948a5352 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:44:54.770923 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:54.770923 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:54.770923 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:54.770923 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:54.770923 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:54.770923 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:54.770923 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:54.770923 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:54.770923 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:54.770923 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:54.770923 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:54.770923 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:54.770923 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:54.770923 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:54.770923 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:54.772091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:54.772091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:54.772091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:54.772091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:54.772091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:54.772091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:54.772091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:54.772091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:54.772091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:54.772091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:54.772091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:54.772091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:54.772091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:54.772091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:54.772091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:54.772091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:54.773171 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:54.773171 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:54.773171 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:54.773171 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:54.773171 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:54.773171 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:54.773171 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:54.773171 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:54.773171 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:54.773171 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:54.773171 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:44:54.773171 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:44:54.773171 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 587/1156] 10.222.0.85 () {56 vars in 1096 bytes} [Thu Jun 16 14:44:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:54.778927 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19b565-495d-483c-ab72-e92455e68c2c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:54.813488 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:54.902989 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19b565-495d-483c-ab72-e92455e68c2c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:54.945436 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d24717-b196-4739-9c9a-8d575b9ee952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:54.946597 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d24717-b196-4739-9c9a-8d575b9ee952 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:54.946970 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d24717-b196-4739-9c9a-8d575b9ee952 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:54.947321 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d24717-b196-4739-9c9a-8d575b9ee952 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:54.948499 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d24717-b196-4739-9c9a-8d575b9ee952 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:54.948910 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d24717-b196-4739-9c9a-8d575b9ee952 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:54.950736 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d24717-b196-4739-9c9a-8d575b9ee952 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:54.963833 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 570/1157] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:44:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:54.970181 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f729a-fe8f-4408-9e8d-0751948a5352 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:55.081100 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f729a-fe8f-4408-9e8d-0751948a5352 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:55.120170 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8506b92-0964-4b11-93e5-42c771312e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:55.121076 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8506b92-0964-4b11-93e5-42c771312e1a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:55.121354 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8506b92-0964-4b11-93e5-42c771312e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:55.121625 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8506b92-0964-4b11-93e5-42c771312e1a None admin] PATH_INFO: `/v3/users/113613f83898479aa004a11810474a75` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:55.122973 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8506b92-0964-4b11-93e5-42c771312e1a None admin] RBAC: Authorizing `identity:get_user(user_id=113613f83898479aa004a11810474a75)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:55.124490 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8506b92-0964-4b11-93e5-42c771312e1a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:55.126165 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 588/1158] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:44:54 2022] GET /identity/v3/users/113613f83898479aa004a11810474a75 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:55.132385 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d24717-b196-4739-9c9a-8d575b9ee952 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:55.236373 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:55.246409 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d24717-b196-4739-9c9a-8d575b9ee952 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:55.283040 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468a584-d114-4f98-a9d3-0a825d2c0663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:55.283700 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468a584-d114-4f98-a9d3-0a825d2c0663 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:55.284012 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468a584-d114-4f98-a9d3-0a825d2c0663 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:55.284289 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468a584-d114-4f98-a9d3-0a825d2c0663 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:55.368925 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468a584-d114-4f98-a9d3-0a825d2c0663 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:55.370421 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468a584-d114-4f98-a9d3-0a825d2c0663 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:55.470759 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:55.481234 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 571/1159] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:44:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:44:55.487571 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8506b92-0964-4b11-93e5-42c771312e1a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:55.558887 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:55.596691 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8506b92-0964-4b11-93e5-42c771312e1a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:55.632587 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807a9f5-25a0-4777-a0dd-49291a68e75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:55.633465 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807a9f5-25a0-4777-a0dd-49291a68e75d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:55.633745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807a9f5-25a0-4777-a0dd-49291a68e75d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:55.634024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807a9f5-25a0-4777-a0dd-49291a68e75d None admin] PATH_INFO: `/v3/projects/279f28ac4c30447ea6d61a41442e0f73` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:55.635297 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807a9f5-25a0-4777-a0dd-49291a68e75d None admin] RBAC: Authorizing `identity:get_project(project_id=279f28ac4c30447ea6d61a41442e0f73)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:55.636782 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807a9f5-25a0-4777-a0dd-49291a68e75d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:55.638561 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 589/1160] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:44:55 2022] GET /identity/v3/projects/279f28ac4c30447ea6d61a41442e0f73 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:55.644943 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468a584-d114-4f98-a9d3-0a825d2c0663 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:55.757830 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468a584-d114-4f98-a9d3-0a825d2c0663 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:55.799896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f31482-0433-4ed7-a93f-7d086ea7b9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:55.801813 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f31482-0433-4ed7-a93f-7d086ea7b9af None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:55.801813 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f31482-0433-4ed7-a93f-7d086ea7b9af None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:55.801813 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f31482-0433-4ed7-a93f-7d086ea7b9af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:55.802126 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f31482-0433-4ed7-a93f-7d086ea7b9af None admin] RBAC: Adding query filter params (role.id=95dcfa6c726a4d01a41d2642554fd338, scope.project.id=279f28ac4c30447ea6d61a41442e0f73, user.id=113613f83898479aa004a11810474a75) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:55.802218 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f31482-0433-4ed7-a93f-7d086ea7b9af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:55.803732 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f31482-0433-4ed7-a93f-7d086ea7b9af None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:55.810545 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 572/1161] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:44:55 2022] GET /identity/v3/role_assignments?user.id=113613f83898479aa004a11810474a75&scope.project.id=279f28ac4c30447ea6d61a41442e0f73&role.id=95dcfa6c726a4d01a41d2642554fd338 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:57.987819 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469da74-d27d-4579-b3e6-bead51c098e5 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:57.988701 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469da74-d27d-4579-b3e6-bead51c098e5 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:57.989188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469da74-d27d-4579-b3e6-bead51c098e5 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:57.991685 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 590/1162] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:44:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:57.997697 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b05be2-1048-4246-ab6f-6893dea76b41 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:57.998148 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b05be2-1048-4246-ab6f-6893dea76b41 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:57.998261 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b05be2-1048-4246-ab6f-6893dea76b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:58.016754 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-49b05be2-1048-4246-ab6f-6893dea76b41 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:58.017937 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-49b05be2-1048-4246-ab6f-6893dea76b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:58.086248 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:58.110082 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 573/1163] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:44:58.147172 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469da74-d27d-4579-b3e6-bead51c098e5 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:58.279160 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469da74-d27d-4579-b3e6-bead51c098e5 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:58.319933 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d1207-0386-47d6-9ca6-9b43f8d03fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:58.321423 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d1207-0386-47d6-9ca6-9b43f8d03fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:58.322036 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d1207-0386-47d6-9ca6-9b43f8d03fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:58.322527 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d1207-0386-47d6-9ca6-9b43f8d03fd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:58.327935 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:58.432243 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d1207-0386-47d6-9ca6-9b43f8d03fd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:58.433718 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d1207-0386-47d6-9ca6-9b43f8d03fd9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:58.542648 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 591/1164] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:44:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:44:58.550391 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b05be2-1048-4246-ab6f-6893dea76b41 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:58.668741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b05be2-1048-4246-ab6f-6893dea76b41 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:58.708420 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35878b9-3925-40b5-9d29-0ac7dd875bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:58.709262 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35878b9-3925-40b5-9d29-0ac7dd875bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:58.709546 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35878b9-3925-40b5-9d29-0ac7dd875bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:58.709820 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35878b9-3925-40b5-9d29-0ac7dd875bb6 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:58.717352 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35878b9-3925-40b5-9d29-0ac7dd875bb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:58.718950 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35878b9-3925-40b5-9d29-0ac7dd875bb6 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:58.734218 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-a35878b9-3925-40b5-9d29-0ac7dd875bb6 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 16 14:44:58.734218 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:58.734218 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 16 14:44:58.734218 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 16 14:44:58.734218 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:58.734218 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:58.734218 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:58.734218 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:58.734218 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 16 14:44:58.734218 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:58.734218 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:58.734218 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:58.734218 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:58.734218 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:58.734218 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:58.734218 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:58.734218 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:58.735495 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:58.735495 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:58.735495 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:58.735495 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:58.735495 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:58.735495 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:58.735495 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:58.735495 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:58.735495 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:58.735495 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:58.735495 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:58.735495 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:58.735495 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:58.735495 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:58.735495 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:58.735495 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:58.736736 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:58.736736 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:58.736736 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:58.736736 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:58.736736 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:58.736736 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:58.736736 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:58.736736 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:58.736736 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:58.736736 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:58.736736 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 16 14:44:58.736736 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:58.736736 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 16 14:44:58.736736 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:44:58.736736 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 574/1165] 10.222.0.85 () {56 vars in 1117 bytes} [Thu Jun 16 14:44:58 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:58.741872 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d1207-0386-47d6-9ca6-9b43f8d03fd9 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:58.785659 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:58.881675 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d1207-0386-47d6-9ca6-9b43f8d03fd9 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:58.920509 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c660ff-74f6-4958-aa40-e373a5c8addc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:58.925909 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c660ff-74f6-4958-aa40-e373a5c8addc None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:58.926191 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c660ff-74f6-4958-aa40-e373a5c8addc None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:58.926472 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c660ff-74f6-4958-aa40-e373a5c8addc None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:58.927354 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c660ff-74f6-4958-aa40-e373a5c8addc None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:58.927717 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c660ff-74f6-4958-aa40-e373a5c8addc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:58.930053 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c660ff-74f6-4958-aa40-e373a5c8addc None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:58.940803 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 592/1166] 10.222.0.85 () {56 vars in 1115 bytes} [Thu Jun 16 14:44:58 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:01.141668 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d9fff-7601-4732-9871-2278fd1ee0c0 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:01.142570 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d9fff-7601-4732-9871-2278fd1ee0c0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:01.142570 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d9fff-7601-4732-9871-2278fd1ee0c0 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:01.144734 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 575/1167] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:45:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:45:01.153342 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70f799-eade-41bf-8674-97e497f3867f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:01.153785 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70f799-eade-41bf-8674-97e497f3867f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:01.153922 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70f799-eade-41bf-8674-97e497f3867f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:01.181948 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-5d70f799-eade-41bf-8674-97e497f3867f None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:45:01.183164 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5d70f799-eade-41bf-8674-97e497f3867f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:45:01.259715 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 593/1168] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:45:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:45:01.287817 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d9fff-7601-4732-9871-2278fd1ee0c0 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:01.350380 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:01.412185 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d9fff-7601-4732-9871-2278fd1ee0c0 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:01.458165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbbd1e-9bf0-4e7c-88cd-1c1f58def317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:01.458851 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbbd1e-9bf0-4e7c-88cd-1c1f58def317 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:01.459132 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbbd1e-9bf0-4e7c-88cd-1c1f58def317 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:01.459405 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbbd1e-9bf0-4e7c-88cd-1c1f58def317 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:01.460278 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddbbd1e-9bf0-4e7c-88cd-1c1f58def317 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:01.461730 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddbbd1e-9bf0-4e7c-88cd-1c1f58def317 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:01.488928 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 576/1169] 10.222.0.85 () {60 vars in 1138 bytes} [Thu Jun 16 14:45:01 2022] POST /identity/v3/domains => generated 267 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:45:03.787654 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434dd33c-1901-4068-b979-af6ed830e3a9 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:03.788557 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434dd33c-1901-4068-b979-af6ed830e3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:03.788557 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434dd33c-1901-4068-b979-af6ed830e3a9 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:03.790553 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 594/1170] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:45:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:45:03.798829 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9049ea-09fa-477d-b693-eed83526cf6b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:03.799349 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9049ea-09fa-477d-b693-eed83526cf6b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:03.799349 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9049ea-09fa-477d-b693-eed83526cf6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:03.820619 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-9d9049ea-09fa-477d-b693-eed83526cf6b None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:45:03.821728 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9d9049ea-09fa-477d-b693-eed83526cf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:45:03.896911 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 577/1171] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:45:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:45:03.931636 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434dd33c-1901-4068-b979-af6ed830e3a9 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:03.973389 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:04.078883 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434dd33c-1901-4068-b979-af6ed830e3a9 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:04.123065 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289d5b2-b294-400b-9053-f5db86fbd2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:04.123975 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289d5b2-b294-400b-9053-f5db86fbd2ee None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:04.124252 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289d5b2-b294-400b-9053-f5db86fbd2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:04.124781 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289d5b2-b294-400b-9053-f5db86fbd2ee None admin] PATH_INFO: `/v3/domains/8b8e9cf2aadc4dbea72ddaab4ee790d7` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:04.136974 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6289d5b2-b294-400b-9053-f5db86fbd2ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=8b8e9cf2aadc4dbea72ddaab4ee790d7)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:04.138436 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6289d5b2-b294-400b-9053-f5db86fbd2ee None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:04.140211 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 595/1172] 10.222.0.85 () {56 vars in 1183 bytes} [Thu Jun 16 14:45:03 2022] GET /identity/v3/domains/8b8e9cf2aadc4dbea72ddaab4ee790d7 => generated 267 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:04.146605 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9049ea-09fa-477d-b693-eed83526cf6b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:04.184807 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:04.266974 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9049ea-09fa-477d-b693-eed83526cf6b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:04.303808 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88f7d1-6e92-47b3-a058-393e04392183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:04.304586 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88f7d1-6e92-47b3-a058-393e04392183 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:04.304863 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88f7d1-6e92-47b3-a058-393e04392183 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:04.305139 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88f7d1-6e92-47b3-a058-393e04392183 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:04.305847 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e88f7d1-6e92-47b3-a058-393e04392183 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:04.307303 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e88f7d1-6e92-47b3-a058-393e04392183 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:04.340002 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 578/1173] 10.222.0.85 () {60 vars in 1141 bytes} [Thu Jun 16 14:45:04 2022] POST /identity/v3/projects => generated 361 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:45:06.540799 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0a5b3-4277-405a-9ab5-25f4dc57ab41 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:06.541673 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0a5b3-4277-405a-9ab5-25f4dc57ab41 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:06.541673 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0a5b3-4277-405a-9ab5-25f4dc57ab41 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:06.543796 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 596/1174] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:45:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:45:06.550062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902ae19-1fc8-4b88-aea5-8f999188e77f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:06.550878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902ae19-1fc8-4b88-aea5-8f999188e77f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:06.551052 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902ae19-1fc8-4b88-aea5-8f999188e77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:06.574172 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b902ae19-1fc8-4b88-aea5-8f999188e77f None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:45:06.575388 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b902ae19-1fc8-4b88-aea5-8f999188e77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:45:06.652827 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 579/1175] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:45:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:45:06.682382 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0a5b3-4277-405a-9ab5-25f4dc57ab41 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:06.796992 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:06.814077 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0a5b3-4277-405a-9ab5-25f4dc57ab41 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:06.854954 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51457634-a7af-4cfb-bfc9-23c53142e23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:06.855844 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51457634-a7af-4cfb-bfc9-23c53142e23c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:06.856191 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51457634-a7af-4cfb-bfc9-23c53142e23c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:06.856467 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51457634-a7af-4cfb-bfc9-23c53142e23c None admin] PATH_INFO: `/v3/domains/8b8e9cf2aadc4dbea72ddaab4ee790d7` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:06.857747 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51457634-a7af-4cfb-bfc9-23c53142e23c None admin] RBAC: Authorizing `identity:get_domain(domain_id=8b8e9cf2aadc4dbea72ddaab4ee790d7)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:06.859200 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51457634-a7af-4cfb-bfc9-23c53142e23c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:06.860958 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 597/1176] 10.222.0.85 () {56 vars in 1183 bytes} [Thu Jun 16 14:45:06 2022] GET /identity/v3/domains/8b8e9cf2aadc4dbea72ddaab4ee790d7 => generated 267 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:45:06.867486 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902ae19-1fc8-4b88-aea5-8f999188e77f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:06.892557 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:06.984776 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902ae19-1fc8-4b88-aea5-8f999188e77f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:07.023696 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e57f2b-4478-4970-b74b-2da4c5d14cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:07.024114 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e57f2b-4478-4970-b74b-2da4c5d14cdb None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:07.024395 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e57f2b-4478-4970-b74b-2da4c5d14cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:07.024666 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e57f2b-4478-4970-b74b-2da4c5d14cdb None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:07.025358 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e57f2b-4478-4970-b74b-2da4c5d14cdb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:07.026810 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e57f2b-4478-4970-b74b-2da4c5d14cdb None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:07.049334 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 580/1177] 10.222.0.85 () {60 vars in 1132 bytes} [Thu Jun 16 14:45:06 2022] POST /identity/v3/users => generated 311 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:45:09.274943 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357bfb9-1111-458d-8351-99117c94fc74 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:09.275523 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357bfb9-1111-458d-8351-99117c94fc74 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:09.275523 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357bfb9-1111-458d-8351-99117c94fc74 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:09.276878 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 598/1178] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:45:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:45:09.282952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baaff46-d48d-451a-bb4e-99e06507102d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:09.283689 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baaff46-d48d-451a-bb4e-99e06507102d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:09.283847 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baaff46-d48d-451a-bb4e-99e06507102d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:09.309016 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4baaff46-d48d-451a-bb4e-99e06507102d None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:45:09.310234 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4baaff46-d48d-451a-bb4e-99e06507102d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:45:09.385390 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 581/1179] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:45:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:45:09.409183 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e357bfb9-1111-458d-8351-99117c94fc74 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:09.532239 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e357bfb9-1111-458d-8351-99117c94fc74 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:09.572808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624f93f-92d8-4f71-a8b5-a576beb3fe46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:09.573620 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624f93f-92d8-4f71-a8b5-a576beb3fe46 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:09.573896 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624f93f-92d8-4f71-a8b5-a576beb3fe46 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:09.574165 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624f93f-92d8-4f71-a8b5-a576beb3fe46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:09.586774 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5624f93f-92d8-4f71-a8b5-a576beb3fe46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:45:09.594349 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-5624f93f-92d8-4f71-a8b5-a576beb3fe46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:45:09.594349 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:09.594349 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:09.594349 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:09.594349 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:09.594349 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:09.594349 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:09.594349 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:09.594349 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:09.594349 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:09.594349 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:09.594349 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:09.594349 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:45:09.594349 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:45:09.594349 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:45:09.594349 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:45:09.595510 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:45:09.595510 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:45:09.595510 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:45:09.595510 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:45:09.595510 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:09.595510 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:09.595510 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:09.595510 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:09.595510 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:09.595510 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:09.595510 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:09.595510 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:09.595510 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:09.595510 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:09.595510 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:09.595510 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:09.596618 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:09.596618 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:09.596618 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:09.596618 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:09.596618 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:45:09.596618 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:45:09.596618 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:45:09.596618 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:45:09.596618 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:45:09.596618 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:45:09.596618 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:45:09.596618 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:45:09.596618 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 599/1180] 10.222.0.85 () {56 vars in 1096 bytes} [Thu Jun 16 14:45:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:09.602170 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baaff46-d48d-451a-bb4e-99e06507102d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:09.605511 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:09.720138 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baaff46-d48d-451a-bb4e-99e06507102d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:09.758635 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72461cdc-d8ef-481e-b025-88653f89bd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:09.759320 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72461cdc-d8ef-481e-b025-88653f89bd6d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:09.759599 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72461cdc-d8ef-481e-b025-88653f89bd6d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:09.759900 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72461cdc-d8ef-481e-b025-88653f89bd6d None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:09.760635 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72461cdc-d8ef-481e-b025-88653f89bd6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:09.760959 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72461cdc-d8ef-481e-b025-88653f89bd6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:09.762336 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72461cdc-d8ef-481e-b025-88653f89bd6d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:09.770995 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 582/1181] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:45:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:09.778661 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624f93f-92d8-4f71-a8b5-a576beb3fe46 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:09.799010 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:09.901954 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624f93f-92d8-4f71-a8b5-a576beb3fe46 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:09.938879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f4d0d-5ed5-48c3-bdb9-4a778f1f67da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:09.939754 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f4d0d-5ed5-48c3-bdb9-4a778f1f67da None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:09.940071 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f4d0d-5ed5-48c3-bdb9-4a778f1f67da None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:09.940343 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f4d0d-5ed5-48c3-bdb9-4a778f1f67da None admin] PATH_INFO: `/v3/users/59899039b88c4df2b2afce374a463d70` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:09.956671 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f4d0d-5ed5-48c3-bdb9-4a778f1f67da None admin] RBAC: Authorizing `identity:get_user(user_id=59899039b88c4df2b2afce374a463d70)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:09.958134 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f4d0d-5ed5-48c3-bdb9-4a778f1f67da None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:09.959838 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 600/1182] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:45:09 2022] GET /identity/v3/users/59899039b88c4df2b2afce374a463d70 => generated 311 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:09.967717 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72461cdc-d8ef-481e-b025-88653f89bd6d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:10.043954 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:10.083262 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72461cdc-d8ef-481e-b025-88653f89bd6d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:10.126808 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0ebc2-48c1-4830-a6c7-f7f9aaa13907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:10.127662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0ebc2-48c1-4830-a6c7-f7f9aaa13907 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:10.128205 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0ebc2-48c1-4830-a6c7-f7f9aaa13907 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:10.128487 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0ebc2-48c1-4830-a6c7-f7f9aaa13907 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:10.207830 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0ebc2-48c1-4830-a6c7-f7f9aaa13907 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:10.209130 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0ebc2-48c1-4830-a6c7-f7f9aaa13907 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:10.280028 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:10.318560 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 583/1183] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:45:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:45:10.326097 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f4d0d-5ed5-48c3-bdb9-4a778f1f67da None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:10.424953 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:10.454614 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f4d0d-5ed5-48c3-bdb9-4a778f1f67da None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:10.490542 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59811bea-7f2d-4896-9bfa-6a8bb4a230a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:10.491407 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59811bea-7f2d-4896-9bfa-6a8bb4a230a0 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:10.491859 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59811bea-7f2d-4896-9bfa-6a8bb4a230a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:10.492166 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59811bea-7f2d-4896-9bfa-6a8bb4a230a0 None admin] PATH_INFO: `/v3/projects/f3f6ecbe5052412ca784c2f7ece4d784` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:10.493524 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59811bea-7f2d-4896-9bfa-6a8bb4a230a0 None admin] RBAC: Authorizing `identity:get_project(project_id=f3f6ecbe5052412ca784c2f7ece4d784)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:10.494962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59811bea-7f2d-4896-9bfa-6a8bb4a230a0 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:10.496701 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 601/1184] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:45:10 2022] GET /identity/v3/projects/f3f6ecbe5052412ca784c2f7ece4d784 => generated 361 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:10.503004 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0ebc2-48c1-4830-a6c7-f7f9aaa13907 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:10.614360 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0ebc2-48c1-4830-a6c7-f7f9aaa13907 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:10.659388 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d7a7c-8a6a-4c2d-8373-8fd4402d18a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:10.660074 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d7a7c-8a6a-4c2d-8373-8fd4402d18a2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:10.660361 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d7a7c-8a6a-4c2d-8373-8fd4402d18a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:10.660661 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d7a7c-8a6a-4c2d-8373-8fd4402d18a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:10.661497 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d7a7c-8a6a-4c2d-8373-8fd4402d18a2 None admin] RBAC: Adding query filter params (role.id=95dcfa6c726a4d01a41d2642554fd338, scope.project.id=f3f6ecbe5052412ca784c2f7ece4d784, user.id=59899039b88c4df2b2afce374a463d70) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:10.661811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d7a7c-8a6a-4c2d-8373-8fd4402d18a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:10.663252 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d7a7c-8a6a-4c2d-8373-8fd4402d18a2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:10.669072 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 584/1185] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:45:10 2022] GET /identity/v3/role_assignments?user.id=59899039b88c4df2b2afce374a463d70&scope.project.id=f3f6ecbe5052412ca784c2f7ece4d784&role.id=95dcfa6c726a4d01a41d2642554fd338 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:12.792634 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218016b-92b2-4ad7-82e7-5ccf6fa0b124 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:12.793220 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218016b-92b2-4ad7-82e7-5ccf6fa0b124 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:12.793220 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218016b-92b2-4ad7-82e7-5ccf6fa0b124 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:12.795585 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 602/1186] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:45:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:45:12.803359 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16112d7e-05c8-496d-bcf9-ead2ae1db715 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:12.803909 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16112d7e-05c8-496d-bcf9-ead2ae1db715 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:12.803909 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16112d7e-05c8-496d-bcf9-ead2ae1db715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:12.823005 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-16112d7e-05c8-496d-bcf9-ead2ae1db715 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:45:12.824197 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-16112d7e-05c8-496d-bcf9-ead2ae1db715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:45:12.852567 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:12.907765 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 585/1187] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:45:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:45:12.932276 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218016b-92b2-4ad7-82e7-5ccf6fa0b124 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:13.052050 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218016b-92b2-4ad7-82e7-5ccf6fa0b124 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:13.091755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019df062-846c-478c-a02e-dbb5e4623b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:13.092492 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019df062-846c-478c-a02e-dbb5e4623b6d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:13.092763 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019df062-846c-478c-a02e-dbb5e4623b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:13.093094 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019df062-846c-478c-a02e-dbb5e4623b6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:13.105906 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019df062-846c-478c-a02e-dbb5e4623b6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:45:13.113621 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-019df062-846c-478c-a02e-dbb5e4623b6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:45:13.113621 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:13.113621 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:13.113621 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:13.113621 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:13.113621 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:13.113621 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:13.113621 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:13.113621 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:13.113621 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:13.113621 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:13.113621 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:13.113621 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:45:13.113621 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:45:13.113621 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:45:13.113621 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:45:13.114706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:45:13.114706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:45:13.114706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:45:13.114706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:45:13.114706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:13.114706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:13.114706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:13.114706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:13.114706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:13.114706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:13.114706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:13.114706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:13.114706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:13.114706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:13.114706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:13.114706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:13.115669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:13.115669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:13.115669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:13.115669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:13.115669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:45:13.115669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:45:13.115669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:45:13.115669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:45:13.115669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:45:13.115669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:45:13.115669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:45:13.115669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:45:13.115669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 603/1188] 10.222.0.85 () {56 vars in 1096 bytes} [Thu Jun 16 14:45:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:13.121658 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16112d7e-05c8-496d-bcf9-ead2ae1db715 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:13.243151 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16112d7e-05c8-496d-bcf9-ead2ae1db715 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:13.287857 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72936a8-6b78-406a-bd7f-4a25b9ef7b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:13.288817 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72936a8-6b78-406a-bd7f-4a25b9ef7b0a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:13.289096 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72936a8-6b78-406a-bd7f-4a25b9ef7b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:13.289366 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72936a8-6b78-406a-bd7f-4a25b9ef7b0a None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:13.290125 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72936a8-6b78-406a-bd7f-4a25b9ef7b0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:13.290431 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72936a8-6b78-406a-bd7f-4a25b9ef7b0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:13.291832 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72936a8-6b78-406a-bd7f-4a25b9ef7b0a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:13.300854 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 586/1189] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:45:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:13.307112 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019df062-846c-478c-a02e-dbb5e4623b6d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:13.310309 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:13.417233 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019df062-846c-478c-a02e-dbb5e4623b6d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:13.461903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72f348-68c7-499e-a230-8faaa65ea55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:13.463008 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72f348-68c7-499e-a230-8faaa65ea55d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:13.463390 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72f348-68c7-499e-a230-8faaa65ea55d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:13.464061 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72f348-68c7-499e-a230-8faaa65ea55d None admin] PATH_INFO: `/v3/users/59899039b88c4df2b2afce374a463d70` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:13.466465 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf72f348-68c7-499e-a230-8faaa65ea55d None admin] RBAC: Authorizing `identity:get_user(user_id=59899039b88c4df2b2afce374a463d70)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:13.468881 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf72f348-68c7-499e-a230-8faaa65ea55d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:13.470627 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 604/1190] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:45:13 2022] GET /identity/v3/users/59899039b88c4df2b2afce374a463d70 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:13.476862 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72936a8-6b78-406a-bd7f-4a25b9ef7b0a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:13.507897 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:13.591432 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72936a8-6b78-406a-bd7f-4a25b9ef7b0a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:13.626574 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff703c-335c-4b48-b5ec-a054bcf346f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:13.627499 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff703c-335c-4b48-b5ec-a054bcf346f7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:13.627723 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff703c-335c-4b48-b5ec-a054bcf346f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:13.628022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff703c-335c-4b48-b5ec-a054bcf346f7 None admin] PATH_INFO: `/v3/projects/f3f6ecbe5052412ca784c2f7ece4d784` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:13.629246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff703c-335c-4b48-b5ec-a054bcf346f7 None admin] RBAC: Authorizing `identity:get_project(project_id=f3f6ecbe5052412ca784c2f7ece4d784)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:13.630666 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff703c-335c-4b48-b5ec-a054bcf346f7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:13.632529 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 587/1191] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:45:13 2022] GET /identity/v3/projects/f3f6ecbe5052412ca784c2f7ece4d784 => generated 361 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:13.639425 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72f348-68c7-499e-a230-8faaa65ea55d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:13.716828 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:13.753897 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72f348-68c7-499e-a230-8faaa65ea55d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:13.790955 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c8a43-79f5-4f14-baf6-1febb6932552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:13.791866 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c8a43-79f5-4f14-baf6-1febb6932552 None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:13.792175 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c8a43-79f5-4f14-baf6-1febb6932552 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:13.792449 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c8a43-79f5-4f14-baf6-1febb6932552 None admin] PATH_INFO: `/v3/projects/f3f6ecbe5052412ca784c2f7ece4d784/users/59899039b88c4df2b2afce374a463d70/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:13.794828 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c8a43-79f5-4f14-baf6-1febb6932552 None admin] RBAC: Authorizing `identity:create_grant(project_id=f3f6ecbe5052412ca784c2f7ece4d784, user_id=59899039b88c4df2b2afce374a463d70, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:13.796434 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c8a43-79f5-4f14-baf6-1febb6932552 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:13.812161 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 605/1192] 10.222.0.85 () {58 vars in 1439 bytes} [Thu Jun 16 14:45:13 2022] PUT /identity/v3/projects/f3f6ecbe5052412ca784c2f7ece4d784/users/59899039b88c4df2b2afce374a463d70/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:45:16.007062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf12392-51d0-4ed9-8e7e-e6be3481a26c None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:16.007842 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf12392-51d0-4ed9-8e7e-e6be3481a26c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:16.007842 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf12392-51d0-4ed9-8e7e-e6be3481a26c None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:16.009087 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 588/1193] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:45:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:45:16.015052 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7a660-5f31-4032-8daa-2628b7f8b7ed None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:16.015596 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7a660-5f31-4032-8daa-2628b7f8b7ed None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:16.015596 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7a660-5f31-4032-8daa-2628b7f8b7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:16.039156 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-08c7a660-5f31-4032-8daa-2628b7f8b7ed None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:45:16.040461 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-08c7a660-5f31-4032-8daa-2628b7f8b7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:45:16.133058 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 606/1194] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:45:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:45:16.156850 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf12392-51d0-4ed9-8e7e-e6be3481a26c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:16.278662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:16.294845 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf12392-51d0-4ed9-8e7e-e6be3481a26c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:16.342089 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0bde9-baf8-4a6c-9684-6082b705d8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:16.342899 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0bde9-baf8-4a6c-9684-6082b705d8d6 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:16.343175 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0bde9-baf8-4a6c-9684-6082b705d8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:16.343443 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0bde9-baf8-4a6c-9684-6082b705d8d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:16.358608 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0bde9-baf8-4a6c-9684-6082b705d8d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:45:16.370035 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-94c0bde9-baf8-4a6c-9684-6082b705d8d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:45:16.370035 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:16.370035 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:16.370035 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:16.370035 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:16.370035 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:16.370035 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:16.370035 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:16.370035 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:16.370035 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:16.370035 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:16.370035 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:16.370035 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:45:16.370035 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:45:16.370035 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:45:16.370035 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:45:16.371154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:45:16.371154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:45:16.371154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:45:16.371154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:45:16.371154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:16.371154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:16.371154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:16.371154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:16.371154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:16.371154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:16.371154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:16.371154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:16.371154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:16.371154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:16.371154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:16.371154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:16.372249 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:16.372249 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:16.372249 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:16.372249 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:16.372249 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:45:16.372249 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:45:16.372249 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:45:16.372249 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:45:16.372249 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:45:16.372249 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:45:16.372249 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:45:16.372249 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:45:16.376062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 589/1195] 10.222.0.85 () {56 vars in 1096 bytes} [Thu Jun 16 14:45:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:16.377406 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7a660-5f31-4032-8daa-2628b7f8b7ed None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:16.440956 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:16.486183 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7a660-5f31-4032-8daa-2628b7f8b7ed None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:16.524342 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7928727-47c9-4a18-91ef-73e5ff8d1c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:16.525018 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7928727-47c9-4a18-91ef-73e5ff8d1c6b None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:16.525301 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7928727-47c9-4a18-91ef-73e5ff8d1c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:16.525575 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7928727-47c9-4a18-91ef-73e5ff8d1c6b None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:16.526327 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7928727-47c9-4a18-91ef-73e5ff8d1c6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:16.526637 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7928727-47c9-4a18-91ef-73e5ff8d1c6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:16.528048 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7928727-47c9-4a18-91ef-73e5ff8d1c6b None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:16.538029 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 607/1196] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:45:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:16.548155 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0bde9-baf8-4a6c-9684-6082b705d8d6 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:16.667629 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0bde9-baf8-4a6c-9684-6082b705d8d6 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:16.705832 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6df26-83b0-49ea-9ab6-1e6db7f958bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:16.706493 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6df26-83b0-49ea-9ab6-1e6db7f958bd None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:16.706779 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6df26-83b0-49ea-9ab6-1e6db7f958bd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:16.707057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6df26-83b0-49ea-9ab6-1e6db7f958bd None admin] PATH_INFO: `/v3/users/59899039b88c4df2b2afce374a463d70` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:16.708313 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6df26-83b0-49ea-9ab6-1e6db7f958bd None admin] RBAC: Authorizing `identity:get_user(user_id=59899039b88c4df2b2afce374a463d70)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:16.709755 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6df26-83b0-49ea-9ab6-1e6db7f958bd None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:16.711594 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 590/1197] 10.222.0.85 () {56 vars in 1177 bytes} [Thu Jun 16 14:45:16 2022] GET /identity/v3/users/59899039b88c4df2b2afce374a463d70 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:16.718159 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7928727-47c9-4a18-91ef-73e5ff8d1c6b None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:16.848636 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7928727-47c9-4a18-91ef-73e5ff8d1c6b None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:16.886509 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:16.899540 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda6e5f-316e-4efb-b080-8c478b7a05f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:16.900212 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda6e5f-316e-4efb-b080-8c478b7a05f3 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:16.900491 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda6e5f-316e-4efb-b080-8c478b7a05f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:16.900763 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda6e5f-316e-4efb-b080-8c478b7a05f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:16.972330 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda6e5f-316e-4efb-b080-8c478b7a05f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:16.973782 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda6e5f-316e-4efb-b080-8c478b7a05f3 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:17.086614 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 608/1198] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:45:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:45:17.095060 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6df26-83b0-49ea-9ab6-1e6db7f958bd None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:17.124038 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:17.235647 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6df26-83b0-49ea-9ab6-1e6db7f958bd None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:17.270797 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53a388-6719-4840-9b65-14e893cc245e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:17.271663 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53a388-6719-4840-9b65-14e893cc245e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:17.271969 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53a388-6719-4840-9b65-14e893cc245e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:17.272238 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53a388-6719-4840-9b65-14e893cc245e None admin] PATH_INFO: `/v3/projects/f3f6ecbe5052412ca784c2f7ece4d784` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:17.273803 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53a388-6719-4840-9b65-14e893cc245e None admin] RBAC: Authorizing `identity:get_project(project_id=f3f6ecbe5052412ca784c2f7ece4d784)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:17.275270 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53a388-6719-4840-9b65-14e893cc245e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:17.277045 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 591/1199] 10.222.0.85 () {56 vars in 1186 bytes} [Thu Jun 16 14:45:17 2022] GET /identity/v3/projects/f3f6ecbe5052412ca784c2f7ece4d784 => generated 361 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:17.283301 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda6e5f-316e-4efb-b080-8c478b7a05f3 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:17.309599 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:17.405714 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda6e5f-316e-4efb-b080-8c478b7a05f3 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:17.443133 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176075b-6448-4f72-841d-e01c3643c779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:17.443828 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176075b-6448-4f72-841d-e01c3643c779 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:17.444169 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176075b-6448-4f72-841d-e01c3643c779 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:17.444498 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176075b-6448-4f72-841d-e01c3643c779 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:17.445320 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176075b-6448-4f72-841d-e01c3643c779 None admin] RBAC: Adding query filter params (role.id=95dcfa6c726a4d01a41d2642554fd338, scope.project.id=f3f6ecbe5052412ca784c2f7ece4d784, user.id=59899039b88c4df2b2afce374a463d70) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:17.445656 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176075b-6448-4f72-841d-e01c3643c779 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:17.447125 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176075b-6448-4f72-841d-e01c3643c779 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:17.453942 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 609/1200] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:45:17 2022] GET /identity/v3/role_assignments?user.id=59899039b88c4df2b2afce374a463d70&scope.project.id=f3f6ecbe5052412ca784c2f7ece4d784&role.id=95dcfa6c726a4d01a41d2642554fd338 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:27.266526 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=57 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:27.450861 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=57 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:14.833994 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ec46b-2631-4ae0-b46f-00e137034964 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:14.834587 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ec46b-2631-4ae0-b46f-00e137034964 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:14.834587 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ec46b-2631-4ae0-b46f-00e137034964 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:14.838209 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 592/1201] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:46:14.842282 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1506b-951b-40b8-abf0-e40cc8506fcf None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:14.842771 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1506b-951b-40b8-abf0-e40cc8506fcf None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:14.842859 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1506b-951b-40b8-abf0-e40cc8506fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:14.873468 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-8bf1506b-951b-40b8-abf0-e40cc8506fcf None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:46:14.875159 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8bf1506b-951b-40b8-abf0-e40cc8506fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:14.973743 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 610/1202] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:46:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:46:14.999658 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ec46b-2631-4ae0-b46f-00e137034964 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:15.134386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ec46b-2631-4ae0-b46f-00e137034964 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:15.187362 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae0c0f-343d-4402-9bd4-b5934b041ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:15.188235 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae0c0f-343d-4402-9bd4-b5934b041ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:15.188574 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae0c0f-343d-4402-9bd4-b5934b041ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:15.188807 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae0c0f-343d-4402-9bd4-b5934b041ec2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:15.206456 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae0c0f-343d-4402-9bd4-b5934b041ec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:15.207922 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae0c0f-343d-4402-9bd4-b5934b041ec2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:15.234901 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-75ae0c0f-343d-4402-9bd4-b5934b041ec2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:46:15.234901 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:15.234901 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:46:15.234901 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:46:15.234901 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:46:15.234901 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:46:15.234901 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:46:15.234901 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:46:15.234901 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:46:15.234901 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:46:15.234901 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:46:15.234901 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:46:15.234901 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:46:15.234901 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:46:15.234901 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:46:15.236465 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:46:15.236465 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:46:15.236465 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:46:15.236465 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:46:15.236465 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:46:15.236465 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:46:15.236465 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:46:15.236465 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:46:15.236465 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:46:15.236465 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:46:15.236465 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:46:15.236465 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:46:15.236465 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:46:15.236465 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:46:15.236465 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:46:15.236465 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:46:15.236465 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:46:15.237649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:46:15.237649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:46:15.237649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:46:15.237649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:46:15.239686 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 593/1203] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:46:15.246366 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1506b-951b-40b8-abf0-e40cc8506fcf None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:15.397433 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1506b-951b-40b8-abf0-e40cc8506fcf None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:15.433992 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:15.442522 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f3fd8-c9d7-4958-9d93-5a9fdf21aa0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:15.443417 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f3fd8-c9d7-4958-9d93-5a9fdf21aa0f None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:15.443739 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f3fd8-c9d7-4958-9d93-5a9fdf21aa0f None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:15.444075 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f3fd8-c9d7-4958-9d93-5a9fdf21aa0f None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:15.444824 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f3fd8-c9d7-4958-9d93-5a9fdf21aa0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:15.445130 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f3fd8-c9d7-4958-9d93-5a9fdf21aa0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:15.446827 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f3fd8-c9d7-4958-9d93-5a9fdf21aa0f None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:15.460885 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 611/1204] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:46:15.466740 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae0c0f-343d-4402-9bd4-b5934b041ec2 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:15.540158 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:15.611511 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae0c0f-343d-4402-9bd4-b5934b041ec2 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:15.658330 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9f73b-600a-4e8a-ba37-4ab31e6b0311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:15.659398 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9f73b-600a-4e8a-ba37-4ab31e6b0311 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:15.660000 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9f73b-600a-4e8a-ba37-4ab31e6b0311 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:15.660352 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9f73b-600a-4e8a-ba37-4ab31e6b0311 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:15.661211 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c9f73b-600a-4e8a-ba37-4ab31e6b0311 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:15.662863 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c9f73b-600a-4e8a-ba37-4ab31e6b0311 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:15.692212 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 594/1205] 10.222.0.85 () {60 vars in 1132 bytes} [Thu Jun 16 14:46:15 2022] POST /identity/v3/users => generated 251 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:46:18.002439 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb01a20-11b9-4891-88d2-c3e79bc8e727 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:18.003015 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb01a20-11b9-4891-88d2-c3e79bc8e727 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:18.003015 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb01a20-11b9-4891-88d2-c3e79bc8e727 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:18.004497 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 612/1206] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:46:18.009913 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da7488-b90a-4aec-a240-5c852dad70e5 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:18.010381 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da7488-b90a-4aec-a240-5c852dad70e5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:18.010483 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da7488-b90a-4aec-a240-5c852dad70e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:18.028254 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-65da7488-b90a-4aec-a240-5c852dad70e5 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:46:18.029461 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-65da7488-b90a-4aec-a240-5c852dad70e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:18.109414 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 595/1207] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:46:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:46:18.133445 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb01a20-11b9-4891-88d2-c3e79bc8e727 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:18.256601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb01a20-11b9-4891-88d2-c3e79bc8e727 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:18.296700 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06376c88-8ebe-4d6a-8944-34888a00a171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:18.297538 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06376c88-8ebe-4d6a-8944-34888a00a171 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:18.297816 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06376c88-8ebe-4d6a-8944-34888a00a171 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:18.298193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06376c88-8ebe-4d6a-8944-34888a00a171 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:18.311080 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06376c88-8ebe-4d6a-8944-34888a00a171 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:46:18.319421 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-06376c88-8ebe-4d6a-8944-34888a00a171 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:46:18.319421 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:18.319421 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:46:18.319421 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:46:18.319421 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:46:18.319421 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:46:18.319421 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:46:18.319421 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:46:18.319421 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:46:18.319421 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:46:18.319421 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:46:18.319421 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:46:18.319421 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:46:18.319421 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:46:18.319421 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:46:18.319421 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:46:18.320477 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:46:18.320477 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:46:18.320477 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:46:18.320477 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:46:18.320477 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:46:18.320477 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:46:18.320477 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:46:18.320477 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:46:18.320477 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:46:18.320477 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:46:18.320477 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:46:18.320477 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:46:18.320477 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:46:18.320477 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:46:18.320477 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:46:18.320477 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:46:18.322376 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:46:18.322376 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:46:18.322376 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:46:18.322376 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:46:18.322376 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:46:18.322376 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:46:18.322376 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:46:18.322376 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:46:18.322376 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:46:18.322376 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:46:18.322376 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:46:18.322376 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:46:18.322376 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 613/1208] 10.222.0.85 () {56 vars in 1102 bytes} [Thu Jun 16 14:46:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:46:18.327914 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da7488-b90a-4aec-a240-5c852dad70e5 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:18.376124 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:18.445793 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da7488-b90a-4aec-a240-5c852dad70e5 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:18.487768 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b8c72d-5632-4ff4-8dcc-24959b3ec67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:18.488587 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8c72d-5632-4ff4-8dcc-24959b3ec67e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:18.488937 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8c72d-5632-4ff4-8dcc-24959b3ec67e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:18.489401 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8c72d-5632-4ff4-8dcc-24959b3ec67e None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:18.490173 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b8c72d-5632-4ff4-8dcc-24959b3ec67e None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:18.490557 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b8c72d-5632-4ff4-8dcc-24959b3ec67e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:18.492031 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b8c72d-5632-4ff4-8dcc-24959b3ec67e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:18.501297 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 596/1209] 10.222.0.85 () {56 vars in 1103 bytes} [Thu Jun 16 14:46:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:46:18.506744 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06376c88-8ebe-4d6a-8944-34888a00a171 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:18.572010 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:18.632780 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06376c88-8ebe-4d6a-8944-34888a00a171 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:18.673360 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace11be3-84f1-48c1-9572-727f5191a4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:18.674439 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace11be3-84f1-48c1-9572-727f5191a4ad None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:18.674878 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace11be3-84f1-48c1-9572-727f5191a4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:18.675306 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace11be3-84f1-48c1-9572-727f5191a4ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:18.687106 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace11be3-84f1-48c1-9572-727f5191a4ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:18.688609 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace11be3-84f1-48c1-9572-727f5191a4ad None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:18.712064 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-ace11be3-84f1-48c1-9572-727f5191a4ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:46:18.712064 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:18.712064 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:46:18.712064 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:46:18.712064 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:46:18.712064 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:46:18.712064 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:46:18.712064 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:46:18.712064 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:46:18.712064 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:46:18.712064 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:46:18.712064 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:46:18.712064 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:46:18.712064 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:46:18.712064 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:46:18.713225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:46:18.713225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:46:18.713225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:46:18.713225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:46:18.713225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:46:18.713225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:46:18.713225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:46:18.713225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:46:18.713225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:46:18.713225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:46:18.713225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:46:18.713225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:46:18.713225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:46:18.713225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:46:18.713225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:46:18.713225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:46:18.713225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:46:18.714440 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:46:18.714440 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:46:18.714440 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:46:18.714440 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:46:18.716268 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 614/1210] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:46:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:46:18.722443 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b8c72d-5632-4ff4-8dcc-24959b3ec67e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:18.841749 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:18.845281 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b8c72d-5632-4ff4-8dcc-24959b3ec67e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:18.890681 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e3658-4cdc-48ef-ae12-2fdc3d8a1937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:18.891402 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e3658-4cdc-48ef-ae12-2fdc3d8a1937 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:18.891773 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e3658-4cdc-48ef-ae12-2fdc3d8a1937 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:18.892181 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e3658-4cdc-48ef-ae12-2fdc3d8a1937 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:18.893058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e3658-4cdc-48ef-ae12-2fdc3d8a1937 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:18.893424 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e3658-4cdc-48ef-ae12-2fdc3d8a1937 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:18.895444 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e3658-4cdc-48ef-ae12-2fdc3d8a1937 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:18.908820 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 597/1211] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:46:18.914783 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace11be3-84f1-48c1-9572-727f5191a4ad None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:19.035505 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace11be3-84f1-48c1-9572-727f5191a4ad None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:19.037533 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:19.075461 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0908a-baaa-49bb-9577-a4db8fd3e0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:19.076354 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0908a-baaa-49bb-9577-a4db8fd3e0ed None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:19.076621 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0908a-baaa-49bb-9577-a4db8fd3e0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:19.076892 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0908a-baaa-49bb-9577-a4db8fd3e0ed None admin] PATH_INFO: `/v3/users/placement` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:19.085611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0908a-baaa-49bb-9577-a4db8fd3e0ed None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:19.087420 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0908a-baaa-49bb-9577-a4db8fd3e0ed None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:19.103111 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-2ca0908a-baaa-49bb-9577-a4db8fd3e0ed None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 14:46:19.103111 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:19.103111 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:46:19.103111 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:46:19.103111 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:46:19.103111 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:46:19.103111 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:46:19.103111 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:46:19.103111 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:46:19.103111 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:46:19.103111 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:46:19.103111 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:46:19.103111 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:46:19.103111 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:46:19.103111 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:46:19.103111 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:46:19.104361 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:46:19.104361 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:46:19.104361 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:46:19.104361 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:46:19.104361 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:46:19.104361 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:46:19.104361 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:46:19.104361 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:46:19.104361 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:46:19.104361 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:46:19.104361 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:46:19.104361 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:46:19.104361 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:46:19.104361 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:46:19.104361 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:46:19.104361 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:46:19.104361 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:46:19.104361 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:46:19.105503 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:46:19.105503 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:46:19.105503 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:46:19.105503 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:46:19.105503 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:46:19.105503 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:46:19.105503 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:46:19.105503 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:46:19.105503 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 14:46:19.105503 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:46:19.110576 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 615/1212] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:46:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:46:19.110730 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e3658-4cdc-48ef-ae12-2fdc3d8a1937 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:19.226048 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e3658-4cdc-48ef-ae12-2fdc3d8a1937 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:19.266600 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95b35a-2c11-47d3-83b4-4ccbe4ebd25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:19.267431 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95b35a-2c11-47d3-83b4-4ccbe4ebd25e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:19.267803 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95b35a-2c11-47d3-83b4-4ccbe4ebd25e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:19.268249 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95b35a-2c11-47d3-83b4-4ccbe4ebd25e None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:19.269064 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95b35a-2c11-47d3-83b4-4ccbe4ebd25e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:19.269372 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95b35a-2c11-47d3-83b4-4ccbe4ebd25e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:19.270853 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95b35a-2c11-47d3-83b4-4ccbe4ebd25e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:19.299514 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 598/1213] 10.222.0.85 () {56 vars in 1143 bytes} [Thu Jun 16 14:46:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:46:19.300857 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0908a-baaa-49bb-9577-a4db8fd3e0ed None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:19.413248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0908a-baaa-49bb-9577-a4db8fd3e0ed None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:19.452609 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f5836-dd57-4546-b10f-ec305a876ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:19.453548 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f5836-dd57-4546-b10f-ec305a876ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:19.453839 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f5836-dd57-4546-b10f-ec305a876ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:19.454121 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f5836-dd57-4546-b10f-ec305a876ec9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:19.488948 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:19.530740 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f5836-dd57-4546-b10f-ec305a876ec9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:19.532333 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f5836-dd57-4546-b10f-ec305a876ec9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:19.645572 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 616/1214] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:46:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:46:19.651967 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95b35a-2c11-47d3-83b4-4ccbe4ebd25e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:19.672910 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:19.775062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95b35a-2c11-47d3-83b4-4ccbe4ebd25e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:19.813444 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64782e6-b9a3-43f8-b6d6-020efd9fb002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:19.814414 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64782e6-b9a3-43f8-b6d6-020efd9fb002 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:19.814785 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64782e6-b9a3-43f8-b6d6-020efd9fb002 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:19.815153 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64782e6-b9a3-43f8-b6d6-020efd9fb002 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:19.827078 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64782e6-b9a3-43f8-b6d6-020efd9fb002 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:19.828731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64782e6-b9a3-43f8-b6d6-020efd9fb002 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:19.848061 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-b64782e6-b9a3-43f8-b6d6-020efd9fb002 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:46:19.848061 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:19.848061 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:46:19.848061 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:46:19.848061 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:46:19.848061 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:46:19.848061 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:46:19.848061 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:46:19.848061 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:46:19.848061 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:46:19.848061 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:46:19.848061 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:46:19.848061 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:46:19.848061 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:46:19.848061 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:46:19.849203 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:46:19.849203 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:46:19.849203 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:46:19.849203 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:46:19.849203 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:46:19.849203 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:46:19.849203 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:46:19.849203 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:46:19.849203 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:46:19.849203 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:46:19.849203 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:46:19.849203 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:46:19.849203 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:46:19.849203 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:46:19.849203 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:46:19.849203 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:46:19.849203 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:46:19.850322 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:46:19.850322 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:46:19.850322 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:46:19.850322 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:46:19.850322 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 599/1215] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:46:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:46:19.855918 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f5836-dd57-4546-b10f-ec305a876ec9 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:19.938613 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:19.982721 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f5836-dd57-4546-b10f-ec305a876ec9 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:20.023402 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e5462-b894-4955-87d5-0bdbff068e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:20.024115 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e5462-b894-4955-87d5-0bdbff068e6d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:20.024985 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e5462-b894-4955-87d5-0bdbff068e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:20.025257 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e5462-b894-4955-87d5-0bdbff068e6d None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:20.026324 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e5462-b894-4955-87d5-0bdbff068e6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:20.026641 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e5462-b894-4955-87d5-0bdbff068e6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:20.028266 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e5462-b894-4955-87d5-0bdbff068e6d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:20.041497 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 617/1216] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:46:20.047453 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64782e6-b9a3-43f8-b6d6-020efd9fb002 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:20.140815 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:20.183345 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64782e6-b9a3-43f8-b6d6-020efd9fb002 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:20.227019 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf9705-3fd3-4d1f-869d-ef0e130daba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:20.229739 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf9705-3fd3-4d1f-869d-ef0e130daba5 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:20.230027 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf9705-3fd3-4d1f-869d-ef0e130daba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:20.230304 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf9705-3fd3-4d1f-869d-ef0e130daba5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:20.238045 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf9705-3fd3-4d1f-869d-ef0e130daba5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:20.239512 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf9705-3fd3-4d1f-869d-ef0e130daba5 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:20.253590 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-bfbf9705-3fd3-4d1f-869d-ef0e130daba5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:46:20.253590 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:20.253590 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:46:20.253590 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:46:20.253590 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:46:20.253590 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:46:20.253590 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:46:20.253590 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:46:20.253590 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:46:20.253590 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:46:20.253590 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:46:20.253590 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:46:20.253590 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:46:20.253590 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:46:20.253590 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:46:20.254727 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:46:20.254727 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:46:20.254727 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:46:20.254727 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:46:20.254727 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:46:20.254727 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:46:20.254727 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:46:20.254727 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:46:20.254727 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:46:20.254727 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:46:20.254727 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:46:20.254727 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:46:20.254727 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:46:20.254727 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:46:20.254727 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:46:20.254727 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:46:20.254727 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:46:20.255663 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:46:20.255663 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:46:20.255663 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:46:20.255663 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:46:20.255663 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:46:20.255663 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:46:20.255663 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:46:20.255663 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:46:20.260693 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 600/1217] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:46:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:46:20.261784 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e5462-b894-4955-87d5-0bdbff068e6d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:20.380226 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e5462-b894-4955-87d5-0bdbff068e6d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:20.411466 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:20.431238 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471aa09-7ee1-4ca9-8106-33313f9d7ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:20.432373 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471aa09-7ee1-4ca9-8106-33313f9d7ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:20.433195 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471aa09-7ee1-4ca9-8106-33313f9d7ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:20.433509 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471aa09-7ee1-4ca9-8106-33313f9d7ef8 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:20.434618 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471aa09-7ee1-4ca9-8106-33313f9d7ef8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:20.434977 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471aa09-7ee1-4ca9-8106-33313f9d7ef8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:20.436963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471aa09-7ee1-4ca9-8106-33313f9d7ef8 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:20.453094 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 618/1218] 10.222.0.85 () {56 vars in 1148 bytes} [Thu Jun 16 14:46:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:46:20.459978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf9705-3fd3-4d1f-869d-ef0e130daba5 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:20.584571 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf9705-3fd3-4d1f-869d-ef0e130daba5 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:20.615661 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:20.625274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a84c1-1b0e-4581-84d6-efc4f45a5e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:20.626570 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a84c1-1b0e-4581-84d6-efc4f45a5e81 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:20.627107 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a84c1-1b0e-4581-84d6-efc4f45a5e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:20.627605 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a84c1-1b0e-4581-84d6-efc4f45a5e81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:20.629112 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a84c1-1b0e-4581-84d6-efc4f45a5e81 None admin] RBAC: Adding query filter params (role.id=17fa92022f834aa5bf5cb9e3a506a478, scope.project.id=80e309a3b3784ba9943734a41949b222, user.id=819ad532defb4adaa2f4fd06b47630d2) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:20.629413 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a84c1-1b0e-4581-84d6-efc4f45a5e81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:20.631317 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a84c1-1b0e-4581-84d6-efc4f45a5e81 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:20.638992 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 601/1219] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:46:20 2022] GET /identity/v3/role_assignments?user.id=819ad532defb4adaa2f4fd06b47630d2&scope.project.id=80e309a3b3784ba9943734a41949b222&role.id=17fa92022f834aa5bf5cb9e3a506a478 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:46:22.759409 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f944bd-81c6-4050-ab66-ee8f4f96ef59 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:22.760220 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f944bd-81c6-4050-ab66-ee8f4f96ef59 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:22.760220 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f944bd-81c6-4050-ab66-ee8f4f96ef59 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:22.762398 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 619/1220] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:46:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:46:22.768053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd11818-713c-4acd-92cc-054a833c0080 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:22.768491 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd11818-713c-4acd-92cc-054a833c0080 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:22.768593 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd11818-713c-4acd-92cc-054a833c0080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:22.786429 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-8cd11818-713c-4acd-92cc-054a833c0080 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:46:22.787766 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8cd11818-713c-4acd-92cc-054a833c0080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:22.859109 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 602/1221] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:46:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:46:22.884682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f944bd-81c6-4050-ab66-ee8f4f96ef59 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:23.008868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f944bd-81c6-4050-ab66-ee8f4f96ef59 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:23.047615 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca91d91-3b2d-45d4-bba6-275739a818f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:23.048443 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca91d91-3b2d-45d4-bba6-275739a818f5 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:23.048722 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca91d91-3b2d-45d4-bba6-275739a818f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:23.048990 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca91d91-3b2d-45d4-bba6-275739a818f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:23.062441 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca91d91-3b2d-45d4-bba6-275739a818f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:46:23.070335 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-3ca91d91-3b2d-45d4-bba6-275739a818f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:46:23.070335 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:23.070335 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:46:23.070335 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:46:23.070335 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:46:23.070335 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:46:23.070335 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:46:23.070335 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:46:23.070335 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:46:23.070335 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:46:23.070335 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:46:23.070335 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:46:23.070335 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:46:23.070335 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:46:23.070335 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:46:23.070335 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:46:23.071466 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:46:23.071466 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:46:23.071466 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:46:23.071466 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:46:23.071466 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:46:23.071466 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:46:23.071466 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:46:23.071466 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:46:23.071466 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:46:23.071466 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:46:23.071466 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:46:23.071466 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:46:23.071466 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:46:23.071466 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:46:23.071466 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:46:23.071466 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:46:23.072423 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:46:23.072423 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:46:23.072423 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:46:23.072423 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:46:23.072423 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:46:23.072423 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:46:23.072423 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:46:23.072423 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:46:23.072423 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:46:23.072423 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:46:23.072423 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:46:23.072423 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:46:23.072423 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 620/1222] 10.222.0.85 () {56 vars in 1102 bytes} [Thu Jun 16 14:46:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:46:23.079952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd11818-713c-4acd-92cc-054a833c0080 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:23.185711 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd11818-713c-4acd-92cc-054a833c0080 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:23.209459 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:23.221130 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6186f-0e00-45ed-99c9-43663aea4272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:23.221840 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6186f-0e00-45ed-99c9-43663aea4272 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:23.222349 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6186f-0e00-45ed-99c9-43663aea4272 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:23.222465 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6186f-0e00-45ed-99c9-43663aea4272 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:23.223120 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6186f-0e00-45ed-99c9-43663aea4272 None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:23.223438 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6186f-0e00-45ed-99c9-43663aea4272 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:23.224845 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6186f-0e00-45ed-99c9-43663aea4272 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:23.233912 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 603/1223] 10.222.0.85 () {56 vars in 1103 bytes} [Thu Jun 16 14:46:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:46:23.240369 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca91d91-3b2d-45d4-bba6-275739a818f5 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:23.286893 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:23.351246 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca91d91-3b2d-45d4-bba6-275739a818f5 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:23.392708 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a802de-8c3d-4361-8f0a-5cef8131b4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:23.393542 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a802de-8c3d-4361-8f0a-5cef8131b4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:23.393826 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a802de-8c3d-4361-8f0a-5cef8131b4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:23.394105 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a802de-8c3d-4361-8f0a-5cef8131b4c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:23.407606 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a802de-8c3d-4361-8f0a-5cef8131b4c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:23.409136 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a802de-8c3d-4361-8f0a-5cef8131b4c7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:23.428089 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-27a802de-8c3d-4361-8f0a-5cef8131b4c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:46:23.428089 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:23.428089 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:46:23.428089 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:46:23.428089 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:46:23.428089 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:46:23.428089 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:46:23.428089 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:46:23.428089 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:46:23.428089 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:46:23.428089 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:46:23.428089 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:46:23.428089 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:46:23.428089 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:46:23.428089 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:46:23.429248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:46:23.429248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:46:23.429248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:46:23.429248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:46:23.429248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:46:23.429248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:46:23.429248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:46:23.429248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:46:23.429248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:46:23.429248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:46:23.429248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:46:23.429248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:46:23.429248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:46:23.429248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:46:23.429248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:46:23.429248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:46:23.429248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:46:23.430363 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:46:23.430363 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:46:23.430363 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:46:23.430363 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:46:23.432051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 621/1224] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:46:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:46:23.437022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6186f-0e00-45ed-99c9-43663aea4272 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:23.549430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6186f-0e00-45ed-99c9-43663aea4272 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:23.587092 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b44a0b-5d3c-42e6-90b8-9c731b9bed71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:23.587862 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b44a0b-5d3c-42e6-90b8-9c731b9bed71 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:23.587862 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b44a0b-5d3c-42e6-90b8-9c731b9bed71 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:23.588666 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b44a0b-5d3c-42e6-90b8-9c731b9bed71 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:23.589531 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b44a0b-5d3c-42e6-90b8-9c731b9bed71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:23.589844 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b44a0b-5d3c-42e6-90b8-9c731b9bed71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:23.591432 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b44a0b-5d3c-42e6-90b8-9c731b9bed71 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:23.605272 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 604/1225] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:46:23.611772 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a802de-8c3d-4361-8f0a-5cef8131b4c7 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:23.718597 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:23.726512 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a802de-8c3d-4361-8f0a-5cef8131b4c7 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:23.765781 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ccb37-5800-4ac1-a1c0-d37a1c6c9fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:23.766731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ccb37-5800-4ac1-a1c0-d37a1c6c9fac None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:23.767009 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ccb37-5800-4ac1-a1c0-d37a1c6c9fac None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:23.767277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ccb37-5800-4ac1-a1c0-d37a1c6c9fac None admin] PATH_INFO: `/v3/users/placement` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:23.775446 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ccb37-5800-4ac1-a1c0-d37a1c6c9fac None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:23.777372 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ccb37-5800-4ac1-a1c0-d37a1c6c9fac None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:23.793982 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-072ccb37-5800-4ac1-a1c0-d37a1c6c9fac None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 14:46:23.793982 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:23.793982 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:46:23.793982 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:46:23.793982 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:46:23.793982 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:46:23.793982 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:46:23.793982 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:46:23.793982 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:46:23.793982 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:46:23.793982 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:46:23.793982 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:46:23.793982 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:46:23.793982 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:46:23.793982 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:46:23.793982 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:46:23.795175 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:46:23.795175 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:46:23.795175 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:46:23.795175 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:46:23.795175 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:46:23.795175 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:46:23.795175 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:46:23.795175 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:46:23.795175 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:46:23.795175 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:46:23.795175 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:46:23.795175 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:46:23.795175 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:46:23.795175 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:46:23.795175 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:46:23.795175 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:46:23.795175 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:46:23.795175 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:46:23.796180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:46:23.796180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:46:23.796180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:46:23.796180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:46:23.796180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:46:23.796180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:46:23.796180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:46:23.796180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:46:23.796180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 14:46:23.796180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:46:23.796180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 622/1226] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:46:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:46:23.801812 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b44a0b-5d3c-42e6-90b8-9c731b9bed71 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:23.861213 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:23.918711 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b44a0b-5d3c-42e6-90b8-9c731b9bed71 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:23.955819 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53be1a5-4d8a-46b9-8266-2f5f919fd9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:23.956511 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53be1a5-4d8a-46b9-8266-2f5f919fd9b0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:23.956795 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53be1a5-4d8a-46b9-8266-2f5f919fd9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:23.957074 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53be1a5-4d8a-46b9-8266-2f5f919fd9b0 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:23.957903 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53be1a5-4d8a-46b9-8266-2f5f919fd9b0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:23.958253 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53be1a5-4d8a-46b9-8266-2f5f919fd9b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:23.959741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53be1a5-4d8a-46b9-8266-2f5f919fd9b0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:23.987267 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 605/1227] 10.222.0.85 () {56 vars in 1143 bytes} [Thu Jun 16 14:46:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:46:23.993444 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ccb37-5800-4ac1-a1c0-d37a1c6c9fac None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:24.133567 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ccb37-5800-4ac1-a1c0-d37a1c6c9fac None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:24.172516 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4807f-a652-4eec-bf1b-8874ae51b886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:24.173327 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4807f-a652-4eec-bf1b-8874ae51b886 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:24.173675 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4807f-a652-4eec-bf1b-8874ae51b886 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:24.173927 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4807f-a652-4eec-bf1b-8874ae51b886 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:24.184942 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4807f-a652-4eec-bf1b-8874ae51b886 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:24.186485 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4807f-a652-4eec-bf1b-8874ae51b886 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:24.204858 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-5bf4807f-a652-4eec-bf1b-8874ae51b886 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:46:24.204858 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:24.204858 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:46:24.204858 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:46:24.204858 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:46:24.204858 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:46:24.204858 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:46:24.204858 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:46:24.204858 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:46:24.204858 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:46:24.204858 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:46:24.204858 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:46:24.204858 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:46:24.204858 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:46:24.204858 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:46:24.206301 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:46:24.206301 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:46:24.206301 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:46:24.206301 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:46:24.206301 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:46:24.206301 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:46:24.206301 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:46:24.206301 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:46:24.206301 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:46:24.206301 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:46:24.206301 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:46:24.206301 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:46:24.206301 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:46:24.206301 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:46:24.206301 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:46:24.206301 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:46:24.206301 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:46:24.207406 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:46:24.207406 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:46:24.207406 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:46:24.207406 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:46:24.207406 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 623/1228] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:46:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:46:24.212443 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53be1a5-4d8a-46b9-8266-2f5f919fd9b0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:24.323005 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53be1a5-4d8a-46b9-8266-2f5f919fd9b0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:24.325470 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:24.359180 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace45cf-4668-4fb1-af0f-325829ae8e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:24.359859 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace45cf-4668-4fb1-af0f-325829ae8e9a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:24.360214 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace45cf-4668-4fb1-af0f-325829ae8e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:24.360446 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace45cf-4668-4fb1-af0f-325829ae8e9a None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:24.361290 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace45cf-4668-4fb1-af0f-325829ae8e9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:24.361585 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace45cf-4668-4fb1-af0f-325829ae8e9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:24.363034 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace45cf-4668-4fb1-af0f-325829ae8e9a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:24.375214 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 606/1229] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:46:24.380996 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4807f-a652-4eec-bf1b-8874ae51b886 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:24.390639 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:24.500787 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4807f-a652-4eec-bf1b-8874ae51b886 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:24.539148 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03968885-dcc0-4648-a6ab-8ac270f994e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:24.540282 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03968885-dcc0-4648-a6ab-8ac270f994e7 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:24.540563 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03968885-dcc0-4648-a6ab-8ac270f994e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:24.540938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03968885-dcc0-4648-a6ab-8ac270f994e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:24.548932 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03968885-dcc0-4648-a6ab-8ac270f994e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:24.550580 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03968885-dcc0-4648-a6ab-8ac270f994e7 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:24.565840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-03968885-dcc0-4648-a6ab-8ac270f994e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:46:24.565840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:24.565840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:46:24.565840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:46:24.565840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:46:24.565840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:46:24.565840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:46:24.565840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:46:24.565840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:46:24.565840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:46:24.565840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:46:24.565840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:46:24.565840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:46:24.565840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:46:24.565840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:46:24.567193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:46:24.567193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:46:24.567193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:46:24.567193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:46:24.567193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:46:24.567193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:46:24.567193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:46:24.567193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:46:24.567193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:46:24.567193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:46:24.567193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:46:24.567193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:46:24.567193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:46:24.567193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:46:24.567193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:46:24.567193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:46:24.567193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:46:24.568418 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:46:24.568418 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:46:24.568418 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:46:24.568418 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:46:24.568418 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:46:24.568418 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:46:24.568418 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:46:24.568418 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:46:24.568418 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 624/1230] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:46:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:46:24.573769 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace45cf-4668-4fb1-af0f-325829ae8e9a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:24.689358 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace45cf-4668-4fb1-af0f-325829ae8e9a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:24.728285 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88385e72-8ada-42b8-af46-ea45f6fe73ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:24.728981 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88385e72-8ada-42b8-af46-ea45f6fe73ed None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:24.729263 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88385e72-8ada-42b8-af46-ea45f6fe73ed None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:24.729560 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88385e72-8ada-42b8-af46-ea45f6fe73ed None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:24.730380 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88385e72-8ada-42b8-af46-ea45f6fe73ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:24.730698 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88385e72-8ada-42b8-af46-ea45f6fe73ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:24.732187 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88385e72-8ada-42b8-af46-ea45f6fe73ed None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:24.745426 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 607/1231] 10.222.0.85 () {56 vars in 1148 bytes} [Thu Jun 16 14:46:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:46:24.751720 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03968885-dcc0-4648-a6ab-8ac270f994e7 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:24.829433 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:24.867185 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03968885-dcc0-4648-a6ab-8ac270f994e7 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:24.907808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73f821-0ffe-4a87-ba01-48e6326eeb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:24.908765 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73f821-0ffe-4a87-ba01-48e6326eeb87 None admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:24.909030 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73f821-0ffe-4a87-ba01-48e6326eeb87 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:24.909329 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73f821-0ffe-4a87-ba01-48e6326eeb87 None admin] PATH_INFO: `/v3/projects/80e309a3b3784ba9943734a41949b222/users/819ad532defb4adaa2f4fd06b47630d2/roles/17fa92022f834aa5bf5cb9e3a506a478` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:24.925232 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73f821-0ffe-4a87-ba01-48e6326eeb87 None admin] RBAC: Authorizing `identity:create_grant(project_id=80e309a3b3784ba9943734a41949b222, user_id=819ad532defb4adaa2f4fd06b47630d2, role_id=17fa92022f834aa5bf5cb9e3a506a478)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:24.926862 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73f821-0ffe-4a87-ba01-48e6326eeb87 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:24.940073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 625/1232] 10.222.0.85 () {58 vars in 1439 bytes} [Thu Jun 16 14:46:24 2022] PUT /identity/v3/projects/80e309a3b3784ba9943734a41949b222/users/819ad532defb4adaa2f4fd06b47630d2/roles/17fa92022f834aa5bf5cb9e3a506a478 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:46:27.266014 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a1cc4-99cf-4ed9-bd36-d8cddcfe10bf None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:27.266697 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a1cc4-99cf-4ed9-bd36-d8cddcfe10bf None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:27.266697 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a1cc4-99cf-4ed9-bd36-d8cddcfe10bf None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:27.268014 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 608/1233] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:46:27.273474 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9460de3-82a1-4379-9b85-4d88d8e60f85 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:27.273985 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9460de3-82a1-4379-9b85-4d88d8e60f85 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:27.274377 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9460de3-82a1-4379-9b85-4d88d8e60f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:27.292794 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d9460de3-82a1-4379-9b85-4d88d8e60f85 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:46:27.294116 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d9460de3-82a1-4379-9b85-4d88d8e60f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:27.370834 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 626/1234] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:46:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:46:27.393459 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a1cc4-99cf-4ed9-bd36-d8cddcfe10bf None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:27.421795 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:27.518675 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a1cc4-99cf-4ed9-bd36-d8cddcfe10bf None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:27.567860 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b98e1-3ec7-4e38-8c94-2028fc822792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:27.568728 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b98e1-3ec7-4e38-8c94-2028fc822792 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:27.568996 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b98e1-3ec7-4e38-8c94-2028fc822792 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:27.569269 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b98e1-3ec7-4e38-8c94-2028fc822792 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:27.580928 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b98e1-3ec7-4e38-8c94-2028fc822792 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:46:27.590494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-f32b98e1-3ec7-4e38-8c94-2028fc822792 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:46:27.590494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:27.590494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:46:27.590494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:46:27.590494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:46:27.590494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:46:27.590494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:46:27.590494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:46:27.590494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:46:27.590494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:46:27.590494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:46:27.590494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:46:27.590494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:46:27.590494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:46:27.590494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:46:27.590494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:46:27.591533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:46:27.591533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:46:27.591533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:46:27.591533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:46:27.591533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:46:27.591533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:46:27.591533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:46:27.591533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:46:27.591533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:46:27.591533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:46:27.591533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:46:27.591533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:46:27.591533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:46:27.591533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:46:27.591533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:46:27.591533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:46:27.592471 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:46:27.592471 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:46:27.592471 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:46:27.592471 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:46:27.592471 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:46:27.592471 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:46:27.592471 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:46:27.592471 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:46:27.592471 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:46:27.592471 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:46:27.592471 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:46:27.592471 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:46:27.592471 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 609/1235] 10.222.0.85 () {56 vars in 1102 bytes} [Thu Jun 16 14:46:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:46:27.598661 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9460de3-82a1-4379-9b85-4d88d8e60f85 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:27.654392 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:27.719672 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9460de3-82a1-4379-9b85-4d88d8e60f85 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:27.761517 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8babb990-cb0b-4233-853f-eb2816679e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:27.762176 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babb990-cb0b-4233-853f-eb2816679e61 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:27.762455 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babb990-cb0b-4233-853f-eb2816679e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:27.762720 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babb990-cb0b-4233-853f-eb2816679e61 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:27.763462 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8babb990-cb0b-4233-853f-eb2816679e61 None admin] RBAC: Adding query filter params (name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:27.763761 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8babb990-cb0b-4233-853f-eb2816679e61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:27.765231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8babb990-cb0b-4233-853f-eb2816679e61 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:27.779083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 627/1236] 10.222.0.85 () {56 vars in 1103 bytes} [Thu Jun 16 14:46:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:46:27.780526 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b98e1-3ec7-4e38-8c94-2028fc822792 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:27.874690 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:27.895000 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b98e1-3ec7-4e38-8c94-2028fc822792 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:27.938702 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6dd77-b259-4858-a494-5b7bb8d229f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:27.939513 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6dd77-b259-4858-a494-5b7bb8d229f0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:27.939791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6dd77-b259-4858-a494-5b7bb8d229f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:27.942042 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6dd77-b259-4858-a494-5b7bb8d229f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:27.956187 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6dd77-b259-4858-a494-5b7bb8d229f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:27.958608 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6dd77-b259-4858-a494-5b7bb8d229f0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:27.979361 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-7ea6dd77-b259-4858-a494-5b7bb8d229f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:46:27.979361 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:27.979361 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:46:27.979361 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:46:27.979361 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:46:27.979361 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:46:27.979361 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:46:27.979361 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:46:27.979361 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:46:27.979361 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:46:27.979361 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:46:27.979361 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:46:27.979361 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:46:27.979361 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:46:27.979361 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:46:27.980567 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:46:27.980567 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:46:27.980567 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:46:27.980567 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:46:27.980567 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:46:27.980567 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:46:27.980567 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:46:27.980567 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:46:27.980567 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:46:27.980567 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:46:27.980567 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:46:27.980567 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:46:27.980567 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:46:27.980567 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:46:27.980567 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:46:27.980567 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:46:27.980567 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:46:27.981619 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:46:27.981619 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:46:27.981619 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:46:27.981619 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:46:27.982124 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 610/1237] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:46:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:46:27.986637 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8babb990-cb0b-4233-853f-eb2816679e61 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:28.109413 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8babb990-cb0b-4233-853f-eb2816679e61 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:28.123991 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:28.157894 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083b4d7-772c-406c-ae07-2af99b66102e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:28.158678 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083b4d7-772c-406c-ae07-2af99b66102e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:28.158963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083b4d7-772c-406c-ae07-2af99b66102e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:28.159296 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083b4d7-772c-406c-ae07-2af99b66102e None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:28.160010 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083b4d7-772c-406c-ae07-2af99b66102e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:28.160319 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083b4d7-772c-406c-ae07-2af99b66102e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:28.161696 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083b4d7-772c-406c-ae07-2af99b66102e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:28.174393 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 628/1238] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:46:28.180905 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6dd77-b259-4858-a494-5b7bb8d229f0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:28.300414 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6dd77-b259-4858-a494-5b7bb8d229f0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:28.335847 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8d775-9a89-4980-b3cf-fc8d445ba5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:28.336886 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8d775-9a89-4980-b3cf-fc8d445ba5a5 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:28.337200 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8d775-9a89-4980-b3cf-fc8d445ba5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:28.337434 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8d775-9a89-4980-b3cf-fc8d445ba5a5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:28.340353 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:28.345888 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8d775-9a89-4980-b3cf-fc8d445ba5a5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:28.347538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8d775-9a89-4980-b3cf-fc8d445ba5a5 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:28.369470 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-22e8d775-9a89-4980-b3cf-fc8d445ba5a5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 14:46:28.369470 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:28.369470 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:46:28.369470 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:46:28.369470 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:46:28.369470 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:46:28.369470 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:46:28.369470 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:46:28.369470 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:46:28.369470 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:46:28.369470 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:46:28.369470 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:46:28.369470 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:46:28.369470 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:46:28.369470 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:46:28.369470 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:46:28.371030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:46:28.371030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:46:28.371030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:46:28.371030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:46:28.371030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:46:28.371030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:46:28.371030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:46:28.371030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:46:28.371030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:46:28.371030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:46:28.371030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:46:28.371030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:46:28.371030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:46:28.371030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:46:28.371030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:46:28.371030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:46:28.371030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:46:28.371030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:46:28.372245 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:46:28.372245 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:46:28.372245 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:46:28.372245 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:46:28.372245 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:46:28.372245 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:46:28.372245 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:46:28.372245 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:46:28.372245 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 14:46:28.372245 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:46:28.372245 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 611/1239] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:46:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:46:28.377646 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083b4d7-772c-406c-ae07-2af99b66102e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:28.501058 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083b4d7-772c-406c-ae07-2af99b66102e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:28.543322 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f479ce2-57c8-48f8-8a71-d84db8221b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:28.544025 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f479ce2-57c8-48f8-8a71-d84db8221b13 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:28.544340 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f479ce2-57c8-48f8-8a71-d84db8221b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:28.544617 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f479ce2-57c8-48f8-8a71-d84db8221b13 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:28.545463 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f479ce2-57c8-48f8-8a71-d84db8221b13 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:28.545769 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f479ce2-57c8-48f8-8a71-d84db8221b13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:28.547329 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f479ce2-57c8-48f8-8a71-d84db8221b13 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:28.580493 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 629/1240] 10.222.0.85 () {56 vars in 1143 bytes} [Thu Jun 16 14:46:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:46:28.590960 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8d775-9a89-4980-b3cf-fc8d445ba5a5 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:28.729951 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8d775-9a89-4980-b3cf-fc8d445ba5a5 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:28.770057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4f38d-8c89-431b-b1a4-cc72b697e7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:28.770812 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4f38d-8c89-431b-b1a4-cc72b697e7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:28.771101 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4f38d-8c89-431b-b1a4-cc72b697e7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:28.771378 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4f38d-8c89-431b-b1a4-cc72b697e7a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:28.844394 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:28.853269 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4f38d-8c89-431b-b1a4-cc72b697e7a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:28.854912 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4f38d-8c89-431b-b1a4-cc72b697e7a6 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:28.993128 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 612/1241] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:46:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:46:29.000136 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f479ce2-57c8-48f8-8a71-d84db8221b13 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:29.036444 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:29.131495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f479ce2-57c8-48f8-8a71-d84db8221b13 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:29.181563 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2da99d-e687-4110-8d82-605b1f7a6b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:29.182724 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2da99d-e687-4110-8d82-605b1f7a6b10 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:29.183120 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2da99d-e687-4110-8d82-605b1f7a6b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:29.183511 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2da99d-e687-4110-8d82-605b1f7a6b10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:29.199424 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2da99d-e687-4110-8d82-605b1f7a6b10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:29.201104 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2da99d-e687-4110-8d82-605b1f7a6b10 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:29.224777 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-3f2da99d-e687-4110-8d82-605b1f7a6b10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:46:29.224777 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:29.224777 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:46:29.224777 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:46:29.224777 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:46:29.224777 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:46:29.224777 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:46:29.224777 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:46:29.224777 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:46:29.224777 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:46:29.224777 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:46:29.224777 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:46:29.224777 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:46:29.224777 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:46:29.224777 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:46:29.226024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:46:29.226024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:46:29.226024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:46:29.226024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:46:29.226024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:46:29.226024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:46:29.226024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:46:29.226024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:46:29.226024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:46:29.226024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:46:29.226024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:46:29.226024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:46:29.226024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:46:29.226024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:46:29.226024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:46:29.226024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:46:29.226024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:46:29.227215 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:46:29.227215 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:46:29.227215 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:46:29.227215 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:46:29.227215 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 630/1242] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:46:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:46:29.232199 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4f38d-8c89-431b-b1a4-cc72b697e7a6 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:29.351575 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:29.360490 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4f38d-8c89-431b-b1a4-cc72b697e7a6 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:29.412993 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5f8a0-66ba-4c9e-a763-2f627596f99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:29.413753 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5f8a0-66ba-4c9e-a763-2f627596f99b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:29.414060 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5f8a0-66ba-4c9e-a763-2f627596f99b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:29.414641 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5f8a0-66ba-4c9e-a763-2f627596f99b None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:29.415400 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5f8a0-66ba-4c9e-a763-2f627596f99b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:29.415724 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5f8a0-66ba-4c9e-a763-2f627596f99b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:29.417760 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5f8a0-66ba-4c9e-a763-2f627596f99b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:29.434137 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 613/1243] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:46:29.440245 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2da99d-e687-4110-8d82-605b1f7a6b10 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:29.543652 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:29.577184 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2da99d-e687-4110-8d82-605b1f7a6b10 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:29.621273 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb4fe2-eb7e-4253-bc5d-0a4260102c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:29.621983 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb4fe2-eb7e-4253-bc5d-0a4260102c38 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:29.622261 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb4fe2-eb7e-4253-bc5d-0a4260102c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:29.622547 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb4fe2-eb7e-4253-bc5d-0a4260102c38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:29.631206 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb4fe2-eb7e-4253-bc5d-0a4260102c38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:29.632727 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb4fe2-eb7e-4253-bc5d-0a4260102c38 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:29.647918 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-f0bb4fe2-eb7e-4253-bc5d-0a4260102c38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:46:29.647918 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:29.647918 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:46:29.647918 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:46:29.647918 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:46:29.647918 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:46:29.647918 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:46:29.647918 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:46:29.647918 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:46:29.647918 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:46:29.647918 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:46:29.647918 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:46:29.647918 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:46:29.647918 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:46:29.647918 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:46:29.649782 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:46:29.649782 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:46:29.649782 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:46:29.649782 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:46:29.649782 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:46:29.649782 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:46:29.649782 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:46:29.649782 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:46:29.649782 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:46:29.649782 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:46:29.649782 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:46:29.649782 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:46:29.649782 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:46:29.649782 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:46:29.649782 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:46:29.649782 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:46:29.649782 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:46:29.651168 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:46:29.651168 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:46:29.651168 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:46:29.651168 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:46:29.651168 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:46:29.651168 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:46:29.651168 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:46:29.651168 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:46:29.654727 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 631/1244] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:46:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:46:29.655792 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5f8a0-66ba-4c9e-a763-2f627596f99b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:29.768869 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5f8a0-66ba-4c9e-a763-2f627596f99b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:29.807258 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960daaa8-657e-48ce-8b44-b14fa57603dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:29.808284 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960daaa8-657e-48ce-8b44-b14fa57603dd None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:29.808664 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960daaa8-657e-48ce-8b44-b14fa57603dd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:29.808976 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960daaa8-657e-48ce-8b44-b14fa57603dd None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:29.809827 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960daaa8-657e-48ce-8b44-b14fa57603dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:29.810140 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960daaa8-657e-48ce-8b44-b14fa57603dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:29.811762 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960daaa8-657e-48ce-8b44-b14fa57603dd None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:29.827188 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 614/1245] 10.222.0.85 () {56 vars in 1148 bytes} [Thu Jun 16 14:46:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:46:29.833593 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb4fe2-eb7e-4253-bc5d-0a4260102c38 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:29.949055 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb4fe2-eb7e-4253-bc5d-0a4260102c38 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:29.988946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb907e-89b8-4131-95a1-2646dd5b1c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:29.989660 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb907e-89b8-4131-95a1-2646dd5b1c28 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:29.989992 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb907e-89b8-4131-95a1-2646dd5b1c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:29.990300 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb907e-89b8-4131-95a1-2646dd5b1c28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:29.991299 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb907e-89b8-4131-95a1-2646dd5b1c28 None admin] RBAC: Adding query filter params (role.id=17fa92022f834aa5bf5cb9e3a506a478, scope.project.id=80e309a3b3784ba9943734a41949b222, user.id=819ad532defb4adaa2f4fd06b47630d2) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:29.991721 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb907e-89b8-4131-95a1-2646dd5b1c28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:29.993419 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb907e-89b8-4131-95a1-2646dd5b1c28 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:30.000021 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 632/1246] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:46:29 2022] GET /identity/v3/role_assignments?user.id=819ad532defb4adaa2f4fd06b47630d2&scope.project.id=80e309a3b3784ba9943734a41949b222&role.id=17fa92022f834aa5bf5cb9e3a506a478 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:46:32.495392 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4f5e0-cdd7-4ff5-b7c0-637d509cd720 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:32.496016 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4f5e0-cdd7-4ff5-b7c0-637d509cd720 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:32.496016 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4f5e0-cdd7-4ff5-b7c0-637d509cd720 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:32.497576 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 615/1247] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:46:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:46:32.503973 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68f80a-3d42-435c-8156-6123a4f17bdc None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:32.504604 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68f80a-3d42-435c-8156-6123a4f17bdc None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:32.504604 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68f80a-3d42-435c-8156-6123a4f17bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:32.512365 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:32.525542 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-6d68f80a-3d42-435c-8156-6123a4f17bdc None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:46:32.526778 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6d68f80a-3d42-435c-8156-6123a4f17bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:32.606013 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 633/1248] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:46:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:46:32.631849 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4f5e0-cdd7-4ff5-b7c0-637d509cd720 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:32.652776 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:32.744734 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4f5e0-cdd7-4ff5-b7c0-637d509cd720 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:32.785569 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcb22f-5528-4ad4-aac9-ab7e5017c7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:32.787141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcb22f-5528-4ad4-aac9-ab7e5017c7d0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:32.787489 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcb22f-5528-4ad4-aac9-ab7e5017c7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:32.787787 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcb22f-5528-4ad4-aac9-ab7e5017c7d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:32.805917 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bcb22f-5528-4ad4-aac9-ab7e5017c7d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:46:32.817357 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-84bcb22f-5528-4ad4-aac9-ab7e5017c7d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:46:32.817357 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:32.817357 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:46:32.817357 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:46:32.817357 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:46:32.817357 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:46:32.817357 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:46:32.817357 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:46:32.817357 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:46:32.817357 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:46:32.817357 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:46:32.817357 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:46:32.817357 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:46:32.817357 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:46:32.817357 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:46:32.817357 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:46:32.818347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:46:32.818347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:46:32.818347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:46:32.818347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:46:32.818347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:46:32.818347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:46:32.818347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:46:32.818347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:46:32.818347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:46:32.818347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:46:32.818347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:46:32.818347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:46:32.818347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:46:32.818347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:46:32.818347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:46:32.818347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:46:32.819741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:46:32.819741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:46:32.819741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:46:32.819741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:46:32.819741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:46:32.819741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:46:32.819741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:46:32.819741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:46:32.819741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:46:32.819741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:46:32.819741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:46:32.819741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:46:32.819741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 616/1249] 10.222.0.85 () {56 vars in 1096 bytes} [Thu Jun 16 14:46:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:46:32.825438 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68f80a-3d42-435c-8156-6123a4f17bdc None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:32.955851 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68f80a-3d42-435c-8156-6123a4f17bdc None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:32.997472 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:33.003265 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ffe5c9-d0fb-42dd-befb-8df035b36553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:33.004094 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffe5c9-d0fb-42dd-befb-8df035b36553 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:33.004391 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffe5c9-d0fb-42dd-befb-8df035b36553 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:33.004787 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffe5c9-d0fb-42dd-befb-8df035b36553 None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:33.005740 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ffe5c9-d0fb-42dd-befb-8df035b36553 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:33.006074 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ffe5c9-d0fb-42dd-befb-8df035b36553 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:33.007529 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ffe5c9-d0fb-42dd-befb-8df035b36553 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:33.018350 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 634/1250] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:46:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:46:33.025803 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcb22f-5528-4ad4-aac9-ab7e5017c7d0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:33.139852 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:33.168989 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcb22f-5528-4ad4-aac9-ab7e5017c7d0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:33.212974 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58833d-2b1f-4f88-917f-06f74aa843df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:33.213886 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58833d-2b1f-4f88-917f-06f74aa843df None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:33.214164 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58833d-2b1f-4f88-917f-06f74aa843df None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:33.214436 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58833d-2b1f-4f88-917f-06f74aa843df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:33.228635 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58833d-2b1f-4f88-917f-06f74aa843df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:33.230160 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58833d-2b1f-4f88-917f-06f74aa843df None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:33.250437 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-dd58833d-2b1f-4f88-917f-06f74aa843df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:46:33.250437 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:33.250437 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:46:33.250437 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:46:33.250437 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:46:33.250437 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:46:33.250437 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:46:33.250437 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:46:33.250437 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:46:33.250437 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:46:33.250437 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:46:33.250437 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:46:33.250437 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:46:33.250437 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:46:33.250437 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:46:33.252709 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:46:33.252709 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:46:33.252709 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:46:33.252709 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:46:33.252709 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:46:33.252709 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:46:33.252709 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:46:33.252709 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:46:33.252709 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:46:33.252709 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:46:33.252709 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:46:33.252709 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:46:33.252709 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:46:33.252709 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:46:33.252709 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:46:33.252709 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:46:33.252709 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:46:33.253926 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:46:33.253926 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:46:33.253926 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:46:33.253926 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:46:33.253926 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 617/1251] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:46:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:46:33.258256 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ffe5c9-d0fb-42dd-befb-8df035b36553 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:33.388106 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ffe5c9-d0fb-42dd-befb-8df035b36553 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:33.433060 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b088ab6-9fde-4fc4-a7fd-2445cd5fe6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:33.434065 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b088ab6-9fde-4fc4-a7fd-2445cd5fe6ca None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:33.434481 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b088ab6-9fde-4fc4-a7fd-2445cd5fe6ca None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:33.434893 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b088ab6-9fde-4fc4-a7fd-2445cd5fe6ca None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:33.435731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b088ab6-9fde-4fc4-a7fd-2445cd5fe6ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:33.436187 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b088ab6-9fde-4fc4-a7fd-2445cd5fe6ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:33.437770 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b088ab6-9fde-4fc4-a7fd-2445cd5fe6ca None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:33.452273 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 635/1252] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:46:33.458756 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58833d-2b1f-4f88-917f-06f74aa843df None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:33.589021 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58833d-2b1f-4f88-917f-06f74aa843df None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:33.621862 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:33.631705 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36424b7d-542a-4803-a733-60805a11f505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:33.632561 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36424b7d-542a-4803-a733-60805a11f505 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:33.632974 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36424b7d-542a-4803-a733-60805a11f505 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:33.633191 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36424b7d-542a-4803-a733-60805a11f505 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:33.643374 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36424b7d-542a-4803-a733-60805a11f505 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:33.644826 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36424b7d-542a-4803-a733-60805a11f505 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:33.665968 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-36424b7d-542a-4803-a733-60805a11f505 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 14:46:33.665968 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:33.665968 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:46:33.665968 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:46:33.665968 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:46:33.665968 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:46:33.665968 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:46:33.665968 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:46:33.665968 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:46:33.665968 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:46:33.665968 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:46:33.665968 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:46:33.665968 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:46:33.665968 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:46:33.665968 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:46:33.665968 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:46:33.667494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:46:33.667494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:46:33.667494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:46:33.667494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:46:33.667494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:46:33.667494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:46:33.667494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:46:33.667494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:46:33.667494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:46:33.667494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:46:33.667494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:46:33.667494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:46:33.667494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:46:33.667494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:46:33.667494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:46:33.667494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:46:33.667494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:46:33.667494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:46:33.669016 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:46:33.669016 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:46:33.669016 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:46:33.669016 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:46:33.669016 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:46:33.669016 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:46:33.669016 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:46:33.669016 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:46:33.669016 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 14:46:33.669016 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:46:33.669016 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 618/1253] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:46:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:46:33.675112 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b088ab6-9fde-4fc4-a7fd-2445cd5fe6ca None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:33.749859 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:33.822545 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b088ab6-9fde-4fc4-a7fd-2445cd5fe6ca None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:33.862155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb8c34-8691-43d0-b1e7-a6db93348acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:33.862847 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb8c34-8691-43d0-b1e7-a6db93348acb None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:33.863137 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb8c34-8691-43d0-b1e7-a6db93348acb None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:33.863412 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb8c34-8691-43d0-b1e7-a6db93348acb None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:33.864296 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb8c34-8691-43d0-b1e7-a6db93348acb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:33.864607 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb8c34-8691-43d0-b1e7-a6db93348acb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:33.866048 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb8c34-8691-43d0-b1e7-a6db93348acb None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:33.886205 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 636/1254] 10.222.0.85 () {56 vars in 1143 bytes} [Thu Jun 16 14:46:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:46:33.892212 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36424b7d-542a-4803-a733-60805a11f505 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:34.010958 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36424b7d-542a-4803-a733-60805a11f505 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:34.051173 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de005f4f-af8e-4ff7-a123-ae9593e732eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:34.051850 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de005f4f-af8e-4ff7-a123-ae9593e732eb None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:34.052167 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de005f4f-af8e-4ff7-a123-ae9593e732eb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:34.052474 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de005f4f-af8e-4ff7-a123-ae9593e732eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:34.128571 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:34.145183 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de005f4f-af8e-4ff7-a123-ae9593e732eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:34.146679 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de005f4f-af8e-4ff7-a123-ae9593e732eb None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:34.263978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 619/1255] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:46:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:46:34.266957 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb8c34-8691-43d0-b1e7-a6db93348acb None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:34.391611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb8c34-8691-43d0-b1e7-a6db93348acb None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:34.406373 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:34.434192 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7791c67-d82c-469f-b338-c9555d4c1ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:34.435188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7791c67-d82c-469f-b338-c9555d4c1ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:34.435600 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7791c67-d82c-469f-b338-c9555d4c1ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:34.436038 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7791c67-d82c-469f-b338-c9555d4c1ed9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:34.449996 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7791c67-d82c-469f-b338-c9555d4c1ed9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:34.451647 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7791c67-d82c-469f-b338-c9555d4c1ed9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:34.472207 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-b7791c67-d82c-469f-b338-c9555d4c1ed9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:46:34.472207 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:34.472207 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:46:34.472207 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:46:34.472207 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:46:34.472207 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:46:34.472207 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:46:34.472207 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:46:34.472207 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:46:34.472207 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:46:34.472207 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:46:34.472207 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:46:34.472207 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:46:34.472207 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:46:34.472207 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:46:34.480179 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:46:34.480179 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:46:34.480179 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:46:34.480179 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:46:34.480179 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:46:34.480179 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:46:34.480179 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:46:34.480179 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:46:34.480179 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:46:34.480179 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:46:34.480179 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:46:34.480179 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:46:34.480179 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:46:34.480179 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:46:34.480179 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:46:34.480179 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:46:34.480179 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:46:34.482215 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:46:34.482215 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:46:34.482215 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:46:34.482215 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:46:34.482215 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 637/1256] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:46:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:46:34.482845 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de005f4f-af8e-4ff7-a123-ae9593e732eb None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:34.593578 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:34.606206 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de005f4f-af8e-4ff7-a123-ae9593e732eb None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:34.645791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab43afc-c551-4470-b702-ed83ac8d41b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:34.646603 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab43afc-c551-4470-b702-ed83ac8d41b3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:34.646902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab43afc-c551-4470-b702-ed83ac8d41b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:34.647219 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab43afc-c551-4470-b702-ed83ac8d41b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:34.648091 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab43afc-c551-4470-b702-ed83ac8d41b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:34.648402 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab43afc-c551-4470-b702-ed83ac8d41b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:34.650431 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab43afc-c551-4470-b702-ed83ac8d41b3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:34.663340 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 620/1257] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:46:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:46:34.670386 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7791c67-d82c-469f-b338-c9555d4c1ed9 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:34.778545 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7791c67-d82c-469f-b338-c9555d4c1ed9 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:34.815842 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25006fae-eeca-4199-9dac-100c5d2f6656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:34.816681 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25006fae-eeca-4199-9dac-100c5d2f6656 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:34.817002 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25006fae-eeca-4199-9dac-100c5d2f6656 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:34.817244 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25006fae-eeca-4199-9dac-100c5d2f6656 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:34.824577 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25006fae-eeca-4199-9dac-100c5d2f6656 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:34.826171 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25006fae-eeca-4199-9dac-100c5d2f6656 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:34.840270 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-25006fae-eeca-4199-9dac-100c5d2f6656 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:46:34.840270 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:34.840270 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:46:34.840270 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:46:34.840270 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:46:34.840270 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:46:34.840270 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:46:34.840270 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:46:34.840270 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:46:34.840270 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:46:34.840270 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:46:34.840270 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:46:34.840270 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:46:34.840270 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:46:34.840270 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:46:34.841495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:46:34.841495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:46:34.841495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:46:34.841495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:46:34.841495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:46:34.841495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:46:34.841495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:46:34.841495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:46:34.841495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:46:34.841495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:46:34.841495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:46:34.841495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:46:34.841495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:46:34.841495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:46:34.841495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:46:34.841495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:46:34.841495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:46:34.842606 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:46:34.842606 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:46:34.842606 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:46:34.842606 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:46:34.842606 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:46:34.842606 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:46:34.842606 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:46:34.842606 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:46:34.842606 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 638/1258] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:46:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:46:34.847840 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab43afc-c551-4470-b702-ed83ac8d41b3 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:34.952582 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab43afc-c551-4470-b702-ed83ac8d41b3 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:34.990192 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6af51-dafc-408e-b95c-5cd17c572934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:34.990868 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6af51-dafc-408e-b95c-5cd17c572934 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:34.991147 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6af51-dafc-408e-b95c-5cd17c572934 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:34.991423 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6af51-dafc-408e-b95c-5cd17c572934 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:34.992267 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf6af51-dafc-408e-b95c-5cd17c572934 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:34.992627 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf6af51-dafc-408e-b95c-5cd17c572934 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:34.994254 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf6af51-dafc-408e-b95c-5cd17c572934 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:35.007148 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 621/1259] 10.222.0.85 () {56 vars in 1148 bytes} [Thu Jun 16 14:46:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:46:35.013579 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25006fae-eeca-4199-9dac-100c5d2f6656 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:35.041389 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:35.132351 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25006fae-eeca-4199-9dac-100c5d2f6656 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:35.172090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d5238-59ef-49b3-bce9-5d685c6fe181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:35.172793 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d5238-59ef-49b3-bce9-5d685c6fe181 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:35.173153 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d5238-59ef-49b3-bce9-5d685c6fe181 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:35.173477 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d5238-59ef-49b3-bce9-5d685c6fe181 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:35.174494 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d5238-59ef-49b3-bce9-5d685c6fe181 None admin] RBAC: Adding query filter params (role.id=95dcfa6c726a4d01a41d2642554fd338, scope.project.id=80e309a3b3784ba9943734a41949b222, user.id=819ad532defb4adaa2f4fd06b47630d2) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:35.174797 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d5238-59ef-49b3-bce9-5d685c6fe181 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:35.176307 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d5238-59ef-49b3-bce9-5d685c6fe181 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:35.182639 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 639/1260] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:46:35 2022] GET /identity/v3/role_assignments?user.id=819ad532defb4adaa2f4fd06b47630d2&scope.project.id=80e309a3b3784ba9943734a41949b222&role.id=95dcfa6c726a4d01a41d2642554fd338 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:46:37.294987 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65240274-5dbb-4270-a5ee-398427cad081 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:37.295679 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65240274-5dbb-4270-a5ee-398427cad081 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:37.295679 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65240274-5dbb-4270-a5ee-398427cad081 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:37.296968 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 622/1261] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:46:37.303193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423219f7-4586-4d1c-a4f2-cde31f7f1f1c None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:37.303620 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423219f7-4586-4d1c-a4f2-cde31f7f1f1c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:37.303725 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423219f7-4586-4d1c-a4f2-cde31f7f1f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:37.329143 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-423219f7-4586-4d1c-a4f2-cde31f7f1f1c None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:46:37.330336 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-423219f7-4586-4d1c-a4f2-cde31f7f1f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:37.413016 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 640/1262] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:46:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:46:37.437250 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65240274-5dbb-4270-a5ee-398427cad081 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:37.452246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:37.563020 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65240274-5dbb-4270-a5ee-398427cad081 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:37.607302 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f2400-9f17-41b4-a32f-83488097c940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:37.608130 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f2400-9f17-41b4-a32f-83488097c940 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:37.608414 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f2400-9f17-41b4-a32f-83488097c940 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:37.608691 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f2400-9f17-41b4-a32f-83488097c940 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:37.621082 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f2400-9f17-41b4-a32f-83488097c940 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:46:37.628801 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-b02f2400-9f17-41b4-a32f-83488097c940 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:46:37.628801 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:37.628801 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:46:37.628801 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:46:37.628801 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:46:37.628801 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:46:37.628801 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:46:37.628801 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:46:37.628801 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:46:37.628801 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:46:37.628801 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:46:37.628801 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:46:37.628801 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:46:37.628801 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:46:37.628801 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:46:37.628801 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:46:37.629931 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:46:37.629931 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:46:37.629931 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:46:37.629931 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:46:37.629931 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:46:37.629931 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:46:37.629931 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:46:37.629931 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:46:37.629931 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:46:37.629931 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:46:37.629931 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:46:37.629931 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:46:37.629931 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:46:37.629931 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:46:37.629931 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:46:37.629931 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:46:37.630819 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:46:37.630819 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:46:37.630819 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:46:37.630819 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:46:37.630819 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:46:37.630819 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:46:37.630819 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:46:37.630819 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:46:37.630819 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:46:37.630819 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:46:37.630819 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:46:37.630819 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:46:37.630819 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 623/1263] 10.222.0.85 () {56 vars in 1096 bytes} [Thu Jun 16 14:46:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:46:37.636991 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423219f7-4586-4d1c-a4f2-cde31f7f1f1c None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:37.657853 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:37.752529 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423219f7-4586-4d1c-a4f2-cde31f7f1f1c None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:37.792753 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa523b60-bec1-4f97-9302-e7248a9dc96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:37.793432 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa523b60-bec1-4f97-9302-e7248a9dc96e None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:37.793703 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa523b60-bec1-4f97-9302-e7248a9dc96e None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:37.793976 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa523b60-bec1-4f97-9302-e7248a9dc96e None admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:37.794730 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa523b60-bec1-4f97-9302-e7248a9dc96e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:37.795032 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa523b60-bec1-4f97-9302-e7248a9dc96e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:37.796489 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa523b60-bec1-4f97-9302-e7248a9dc96e None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:37.805036 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 641/1264] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:46:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:46:37.811098 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f2400-9f17-41b4-a32f-83488097c940 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:37.883697 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:37.922328 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f2400-9f17-41b4-a32f-83488097c940 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:37.958128 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf0639-34aa-42e2-91ac-ceb995f5dba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:37.958906 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf0639-34aa-42e2-91ac-ceb995f5dba3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:37.959182 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf0639-34aa-42e2-91ac-ceb995f5dba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:37.959461 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf0639-34aa-42e2-91ac-ceb995f5dba3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:37.971413 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf0639-34aa-42e2-91ac-ceb995f5dba3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:37.972884 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf0639-34aa-42e2-91ac-ceb995f5dba3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:37.990408 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-96cf0639-34aa-42e2-91ac-ceb995f5dba3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:46:37.990408 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:37.990408 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:46:37.990408 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:46:37.990408 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:46:37.990408 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:46:37.990408 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:46:37.990408 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:46:37.990408 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:46:37.990408 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:46:37.990408 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:46:37.990408 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:46:37.990408 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:46:37.990408 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:46:37.990408 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:46:37.991433 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:46:37.991433 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:46:37.991433 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:46:37.991433 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:46:37.991433 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:46:37.991433 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:46:37.991433 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:46:37.991433 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:46:37.991433 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:46:37.991433 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:46:37.991433 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:46:37.991433 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:46:37.991433 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:46:37.991433 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:46:37.991433 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:46:37.991433 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:46:37.991433 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:46:37.992794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:46:37.992794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:46:37.992794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:46:37.992794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:46:37.992794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 624/1265] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:46:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:46:38.001037 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa523b60-bec1-4f97-9302-e7248a9dc96e None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:38.094234 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:38.117462 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa523b60-bec1-4f97-9302-e7248a9dc96e None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:38.156101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ab632-1868-488f-aae4-a7a853785314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:38.156698 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ab632-1868-488f-aae4-a7a853785314 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:38.156986 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ab632-1868-488f-aae4-a7a853785314 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:38.157264 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ab632-1868-488f-aae4-a7a853785314 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:38.157987 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ab632-1868-488f-aae4-a7a853785314 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:38.158294 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ab632-1868-488f-aae4-a7a853785314 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:38.159740 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ab632-1868-488f-aae4-a7a853785314 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:38.172593 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 642/1266] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:46:38.179048 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf0639-34aa-42e2-91ac-ceb995f5dba3 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:38.284142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf0639-34aa-42e2-91ac-ceb995f5dba3 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:38.304513 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:38.321626 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9305f-e618-49b7-97c2-8da21641fa5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:38.322560 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9305f-e618-49b7-97c2-8da21641fa5f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:38.322841 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9305f-e618-49b7-97c2-8da21641fa5f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:38.323112 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9305f-e618-49b7-97c2-8da21641fa5f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:38.330918 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9305f-e618-49b7-97c2-8da21641fa5f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:38.332436 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9305f-e618-49b7-97c2-8da21641fa5f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:38.346913 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-bba9305f-e618-49b7-97c2-8da21641fa5f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 14:46:38.346913 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:38.346913 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:46:38.346913 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:46:38.346913 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:46:38.346913 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:46:38.346913 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:46:38.346913 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:46:38.346913 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:46:38.346913 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:46:38.346913 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:46:38.346913 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:46:38.346913 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:46:38.346913 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:46:38.346913 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:46:38.346913 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:46:38.348141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:46:38.348141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:46:38.348141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:46:38.348141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:46:38.348141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:46:38.348141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:46:38.348141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:46:38.348141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:46:38.348141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:46:38.348141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:46:38.348141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:46:38.348141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:46:38.348141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:46:38.348141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:46:38.348141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:46:38.348141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:46:38.348141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:46:38.348141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:46:38.349510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:46:38.349510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:46:38.349510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:46:38.349510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:46:38.349510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:46:38.349510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:46:38.349510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:46:38.349510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:46:38.349510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 14:46:38.349510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:46:38.349510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 625/1267] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:46:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:46:38.354774 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ab632-1868-488f-aae4-a7a853785314 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:38.461633 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ab632-1868-488f-aae4-a7a853785314 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:38.500185 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f561d4-4fb2-4459-9d01-00ebe63e1701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:38.500850 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f561d4-4fb2-4459-9d01-00ebe63e1701 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:38.501132 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f561d4-4fb2-4459-9d01-00ebe63e1701 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:38.501406 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f561d4-4fb2-4459-9d01-00ebe63e1701 None admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:38.502261 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f561d4-4fb2-4459-9d01-00ebe63e1701 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:38.502570 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f561d4-4fb2-4459-9d01-00ebe63e1701 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:38.504064 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f561d4-4fb2-4459-9d01-00ebe63e1701 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:38.513080 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:38.522878 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 643/1268] 10.222.0.85 () {56 vars in 1143 bytes} [Thu Jun 16 14:46:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:46:38.529337 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9305f-e618-49b7-97c2-8da21641fa5f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:38.662373 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9305f-e618-49b7-97c2-8da21641fa5f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:38.699379 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4dbdd6-1574-4cae-90ec-9dcea52a72c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:38.700202 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4dbdd6-1574-4cae-90ec-9dcea52a72c5 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:38.700484 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4dbdd6-1574-4cae-90ec-9dcea52a72c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:38.700760 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4dbdd6-1574-4cae-90ec-9dcea52a72c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:38.711945 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4dbdd6-1574-4cae-90ec-9dcea52a72c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:38.713326 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4dbdd6-1574-4cae-90ec-9dcea52a72c5 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:38.730046 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-cf4dbdd6-1574-4cae-90ec-9dcea52a72c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:46:38.730046 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:38.730046 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:46:38.730046 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:46:38.730046 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:46:38.730046 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:46:38.730046 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:46:38.730046 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:46:38.730046 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:46:38.730046 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:46:38.730046 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:46:38.730046 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:46:38.730046 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:46:38.730046 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:46:38.730046 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:46:38.731057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:46:38.731057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:46:38.731057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:46:38.731057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:46:38.731057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:46:38.731057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:46:38.731057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:46:38.731057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:46:38.731057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:46:38.731057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:46:38.731057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:46:38.731057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:46:38.731057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:46:38.731057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:46:38.731057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:46:38.731057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:46:38.731057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:46:38.732519 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:46:38.732519 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:46:38.732519 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:46:38.732519 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:46:38.732519 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 626/1269] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:46:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:46:38.739623 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f561d4-4fb2-4459-9d01-00ebe63e1701 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:38.843478 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f561d4-4fb2-4459-9d01-00ebe63e1701 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:38.877629 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba5aa3-60d9-49c1-b158-05dea55f1fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:38.878307 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba5aa3-60d9-49c1-b158-05dea55f1fbe None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:38.878591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba5aa3-60d9-49c1-b158-05dea55f1fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:38.878870 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba5aa3-60d9-49c1-b158-05dea55f1fbe None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:38.879596 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba5aa3-60d9-49c1-b158-05dea55f1fbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:38.879934 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba5aa3-60d9-49c1-b158-05dea55f1fbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:38.881318 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba5aa3-60d9-49c1-b158-05dea55f1fbe None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:38.892995 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 644/1270] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:46:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:46:38.898962 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4dbdd6-1574-4cae-90ec-9dcea52a72c5 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:38.932983 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:39.004201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4dbdd6-1574-4cae-90ec-9dcea52a72c5 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:39.038426 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0df640-f852-468f-80a1-65b1d2c798b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:39.039353 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0df640-f852-468f-80a1-65b1d2c798b7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:39.039624 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0df640-f852-468f-80a1-65b1d2c798b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:39.039917 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0df640-f852-468f-80a1-65b1d2c798b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:39.047397 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0df640-f852-468f-80a1-65b1d2c798b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:39.049258 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0df640-f852-468f-80a1-65b1d2c798b7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:39.067127 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-2e0df640-f852-468f-80a1-65b1d2c798b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:46:39.067127 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:39.067127 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:46:39.067127 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:46:39.067127 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:46:39.067127 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:46:39.067127 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:46:39.067127 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:46:39.067127 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:46:39.067127 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:46:39.067127 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:46:39.067127 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:46:39.067127 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:46:39.067127 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:46:39.067127 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:46:39.068192 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:46:39.068192 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:46:39.068192 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:46:39.068192 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:46:39.068192 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:46:39.068192 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:46:39.068192 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:46:39.068192 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:46:39.068192 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:46:39.068192 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:46:39.068192 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:46:39.068192 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:46:39.068192 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:46:39.068192 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:46:39.068192 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:46:39.068192 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:46:39.068192 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:46:39.069141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:46:39.069141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:46:39.069141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:46:39.069141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:46:39.069141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:46:39.069141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:46:39.069141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:46:39.069141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:46:39.069141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 627/1271] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:46:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:46:39.076929 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba5aa3-60d9-49c1-b158-05dea55f1fbe None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:39.140143 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:39.186946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba5aa3-60d9-49c1-b158-05dea55f1fbe None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:39.227829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46052c-54c3-41db-bfbe-189ffd6a3c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:39.228559 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46052c-54c3-41db-bfbe-189ffd6a3c23 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:39.228847 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46052c-54c3-41db-bfbe-189ffd6a3c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:39.229124 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46052c-54c3-41db-bfbe-189ffd6a3c23 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:39.229925 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46052c-54c3-41db-bfbe-189ffd6a3c23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:39.230237 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46052c-54c3-41db-bfbe-189ffd6a3c23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:39.231700 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46052c-54c3-41db-bfbe-189ffd6a3c23 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:39.245277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 645/1272] 10.222.0.85 () {56 vars in 1148 bytes} [Thu Jun 16 14:46:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:46:39.251998 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0df640-f852-468f-80a1-65b1d2c798b7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:39.373924 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:39.383009 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0df640-f852-468f-80a1-65b1d2c798b7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:39.419083 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21133be5-146f-4e19-af08-003950f480e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:39.419988 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21133be5-146f-4e19-af08-003950f480e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:39.420267 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21133be5-146f-4e19-af08-003950f480e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:39.420538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21133be5-146f-4e19-af08-003950f480e6 None admin] PATH_INFO: `/v3/projects/80e309a3b3784ba9943734a41949b222/users/819ad532defb4adaa2f4fd06b47630d2/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:39.422552 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21133be5-146f-4e19-af08-003950f480e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=80e309a3b3784ba9943734a41949b222, user_id=819ad532defb4adaa2f4fd06b47630d2, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:39.424029 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21133be5-146f-4e19-af08-003950f480e6 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:39.444938 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 628/1273] 10.222.0.85 () {58 vars in 1439 bytes} [Thu Jun 16 14:46:39 2022] PUT /identity/v3/projects/80e309a3b3784ba9943734a41949b222/users/819ad532defb4adaa2f4fd06b47630d2/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:46:41.565368 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5fca3-af28-40db-aa38-aeb6cdec03f1 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:41.565823 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5fca3-af28-40db-aa38-aeb6cdec03f1 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:41.565918 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5fca3-af28-40db-aa38-aeb6cdec03f1 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:41.567335 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 646/1274] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:46:41.576285 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fe457-2234-4cc2-90fc-37490098c484 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:41.577015 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fe457-2234-4cc2-90fc-37490098c484 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:41.577144 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fe457-2234-4cc2-90fc-37490098c484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:41.598143 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-aa2fe457-2234-4cc2-90fc-37490098c484 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:46:41.599356 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-aa2fe457-2234-4cc2-90fc-37490098c484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:41.674042 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 629/1275] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:46:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:46:41.698042 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5fca3-af28-40db-aa38-aeb6cdec03f1 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:41.828362 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5fca3-af28-40db-aa38-aeb6cdec03f1 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:41.854389 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:41.873535 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186320f-fec8-4a2b-a18d-70926c408b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:41.874358 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186320f-fec8-4a2b-a18d-70926c408b82 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:41.874635 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186320f-fec8-4a2b-a18d-70926c408b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:41.874899 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186320f-fec8-4a2b-a18d-70926c408b82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:41.886128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186320f-fec8-4a2b-a18d-70926c408b82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:46:41.893706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-c186320f-fec8-4a2b-a18d-70926c408b82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:46:41.893706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:41.893706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:46:41.893706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:46:41.893706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:46:41.893706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:46:41.893706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:46:41.893706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:46:41.893706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:46:41.893706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:46:41.893706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:46:41.893706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:46:41.893706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:46:41.893706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:46:41.893706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:46:41.893706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:46:41.894831 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:46:41.894831 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:46:41.894831 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:46:41.894831 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:46:41.894831 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:46:41.894831 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:46:41.894831 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:46:41.894831 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:46:41.894831 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:46:41.894831 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:46:41.894831 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:46:41.894831 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:46:41.894831 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:46:41.894831 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:46:41.894831 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:46:41.894831 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:46:41.895731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:46:41.895731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:46:41.895731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:46:41.895731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:46:41.895731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:46:41.895731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:46:41.895731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:46:41.895731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:46:41.895731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:46:41.895731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:46:41.895731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:46:41.895731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:46:41.895731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 647/1276] 10.222.0.85 () {56 vars in 1096 bytes} [Thu Jun 16 14:46:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:46:41.901450 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fe457-2234-4cc2-90fc-37490098c484 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:41.988344 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:42.007403 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fe457-2234-4cc2-90fc-37490098c484 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:42.042355 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917aceb-515a-40c7-8f49-31d40a640160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:42.043016 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917aceb-515a-40c7-8f49-31d40a640160 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:42.043296 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917aceb-515a-40c7-8f49-31d40a640160 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:42.043568 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917aceb-515a-40c7-8f49-31d40a640160 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:42.044339 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917aceb-515a-40c7-8f49-31d40a640160 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:42.044644 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917aceb-515a-40c7-8f49-31d40a640160 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:42.046016 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917aceb-515a-40c7-8f49-31d40a640160 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:42.054266 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 630/1277] 10.222.0.85 () {56 vars in 1099 bytes} [Thu Jun 16 14:46:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:46:42.061300 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186320f-fec8-4a2b-a18d-70926c408b82 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:42.186173 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186320f-fec8-4a2b-a18d-70926c408b82 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:42.225945 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13443ed-c98a-4d32-90db-3620dae34f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:42.226931 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13443ed-c98a-4d32-90db-3620dae34f0d None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:42.227254 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13443ed-c98a-4d32-90db-3620dae34f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:42.227521 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13443ed-c98a-4d32-90db-3620dae34f0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:42.238624 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13443ed-c98a-4d32-90db-3620dae34f0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:42.240121 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13443ed-c98a-4d32-90db-3620dae34f0d None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:42.257482 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-c13443ed-c98a-4d32-90db-3620dae34f0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:46:42.257482 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:42.257482 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:46:42.257482 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:46:42.257482 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:46:42.257482 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:46:42.257482 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:46:42.257482 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:46:42.257482 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:46:42.257482 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:46:42.257482 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:46:42.257482 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:46:42.257482 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:46:42.257482 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:46:42.257482 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:46:42.258673 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:46:42.258673 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:46:42.258673 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:46:42.258673 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:46:42.258673 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:46:42.258673 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:46:42.258673 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:46:42.258673 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:46:42.258673 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:46:42.258673 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:46:42.258673 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:46:42.258673 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:46:42.258673 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:46:42.258673 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:46:42.258673 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:46:42.258673 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:46:42.258673 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:46:42.263471 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:46:42.263471 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:46:42.263471 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:46:42.263471 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:46:42.263471 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 648/1278] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:46:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:46:42.267103 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917aceb-515a-40c7-8f49-31d40a640160 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:42.378525 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917aceb-515a-40c7-8f49-31d40a640160 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:42.413503 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c22c6-1f58-4628-8082-a15774865373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:42.414183 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c22c6-1f58-4628-8082-a15774865373 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:42.414654 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c22c6-1f58-4628-8082-a15774865373 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:42.414933 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c22c6-1f58-4628-8082-a15774865373 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:42.415650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c22c6-1f58-4628-8082-a15774865373 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:42.415981 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c22c6-1f58-4628-8082-a15774865373 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:42.417700 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c22c6-1f58-4628-8082-a15774865373 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:42.431119 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 631/1279] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:46:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:46:42.440380 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13443ed-c98a-4d32-90db-3620dae34f0d None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:42.482842 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:42.561174 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13443ed-c98a-4d32-90db-3620dae34f0d None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:42.598935 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095133f4-3d98-495b-9890-e0b197ecb95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:42.599737 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095133f4-3d98-495b-9890-e0b197ecb95c None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:42.600059 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095133f4-3d98-495b-9890-e0b197ecb95c None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:42.600334 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095133f4-3d98-495b-9890-e0b197ecb95c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:42.608188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095133f4-3d98-495b-9890-e0b197ecb95c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:42.609635 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095133f4-3d98-495b-9890-e0b197ecb95c None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:42.623903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-095133f4-3d98-495b-9890-e0b197ecb95c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 14:46:42.623903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:42.623903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:46:42.623903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:46:42.623903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:46:42.623903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:46:42.623903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:46:42.623903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:46:42.623903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:46:42.623903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:46:42.623903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:46:42.623903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:46:42.623903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:46:42.623903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:46:42.623903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:46:42.623903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:46:42.625125 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:46:42.625125 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:46:42.625125 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:46:42.625125 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:46:42.625125 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:46:42.625125 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:46:42.625125 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:46:42.625125 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:46:42.625125 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:46:42.625125 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:46:42.625125 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:46:42.625125 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:46:42.625125 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:46:42.625125 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:46:42.625125 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:46:42.625125 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:46:42.625125 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:46:42.625125 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:46:42.626264 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:46:42.626264 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:46:42.626264 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:46:42.626264 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:46:42.626264 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:46:42.626264 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:46:42.626264 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:46:42.626264 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:46:42.626264 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 14:46:42.626264 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:46:42.626264 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 649/1280] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:46:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:46:42.631254 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c22c6-1f58-4628-8082-a15774865373 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:42.635603 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:42.740241 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c22c6-1f58-4628-8082-a15774865373 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:42.784690 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43723fc-533c-46af-89de-56fc080d7911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:42.785705 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43723fc-533c-46af-89de-56fc080d7911 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:42.786085 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43723fc-533c-46af-89de-56fc080d7911 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:42.786471 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43723fc-533c-46af-89de-56fc080d7911 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:42.787760 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43723fc-533c-46af-89de-56fc080d7911 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:42.788207 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43723fc-533c-46af-89de-56fc080d7911 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:42.790109 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43723fc-533c-46af-89de-56fc080d7911 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:42.808754 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 632/1281] 10.222.0.85 () {56 vars in 1143 bytes} [Thu Jun 16 14:46:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:46:42.815357 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095133f4-3d98-495b-9890-e0b197ecb95c None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:42.929769 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:42.944362 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095133f4-3d98-495b-9890-e0b197ecb95c None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:42.980077 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194b2a6-c0df-4e7f-9ac8-ba8bc19b8795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:42.980715 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194b2a6-c0df-4e7f-9ac8-ba8bc19b8795 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:42.980992 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194b2a6-c0df-4e7f-9ac8-ba8bc19b8795 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:42.981266 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194b2a6-c0df-4e7f-9ac8-ba8bc19b8795 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:43.060626 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194b2a6-c0df-4e7f-9ac8-ba8bc19b8795 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:43.062106 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194b2a6-c0df-4e7f-9ac8-ba8bc19b8795 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:43.163305 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:43.175404 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 650/1282] 10.222.0.85 () {58 vars in 1282 bytes} [Thu Jun 16 14:46:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:46:43.183609 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43723fc-533c-46af-89de-56fc080d7911 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:43.255556 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:43.296956 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43723fc-533c-46af-89de-56fc080d7911 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:43.335375 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24376d53-33f8-4682-bab6-2008082cd5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:43.336221 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24376d53-33f8-4682-bab6-2008082cd5c6 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:43.336474 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24376d53-33f8-4682-bab6-2008082cd5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:43.336753 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24376d53-33f8-4682-bab6-2008082cd5c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:43.348381 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24376d53-33f8-4682-bab6-2008082cd5c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:43.349856 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24376d53-33f8-4682-bab6-2008082cd5c6 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:43.368156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-24376d53-33f8-4682-bab6-2008082cd5c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:46:43.368156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:43.368156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:46:43.368156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:46:43.368156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:46:43.368156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:46:43.368156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:46:43.368156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:46:43.368156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:46:43.368156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:46:43.368156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:46:43.368156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:46:43.368156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:46:43.368156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:46:43.368156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:46:43.369184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:46:43.369184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:46:43.369184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:46:43.369184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:46:43.369184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:46:43.369184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:46:43.369184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:46:43.369184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:46:43.369184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:46:43.369184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:46:43.369184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:46:43.369184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:46:43.369184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:46:43.369184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:46:43.369184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:46:43.369184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:46:43.369184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:46:43.370232 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:46:43.370232 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:46:43.370232 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:46:43.370232 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:46:43.370232 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 633/1283] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:46:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:46:43.376251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194b2a6-c0df-4e7f-9ac8-ba8bc19b8795 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:43.496199 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194b2a6-c0df-4e7f-9ac8-ba8bc19b8795 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:43.538022 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d27fd0-764d-4e0a-b8e5-9433c8681a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:43.538671 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d27fd0-764d-4e0a-b8e5-9433c8681a43 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:43.539097 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d27fd0-764d-4e0a-b8e5-9433c8681a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:43.539577 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d27fd0-764d-4e0a-b8e5-9433c8681a43 None admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:43.540409 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d27fd0-764d-4e0a-b8e5-9433c8681a43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:43.540707 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d27fd0-764d-4e0a-b8e5-9433c8681a43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:43.542433 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d27fd0-764d-4e0a-b8e5-9433c8681a43 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:43.553811 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 651/1284] 10.222.0.85 () {56 vars in 1109 bytes} [Thu Jun 16 14:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:46:43.559815 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24376d53-33f8-4682-bab6-2008082cd5c6 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:43.667947 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24376d53-33f8-4682-bab6-2008082cd5c6 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:43.682873 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:43.705025 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d54c1a-75e1-4763-8445-2cd8baf06e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:43.705820 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d54c1a-75e1-4763-8445-2cd8baf06e19 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:43.706098 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d54c1a-75e1-4763-8445-2cd8baf06e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:43.706376 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d54c1a-75e1-4763-8445-2cd8baf06e19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:43.713548 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d54c1a-75e1-4763-8445-2cd8baf06e19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:43.715001 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d54c1a-75e1-4763-8445-2cd8baf06e19 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:43.729372 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-32d54c1a-75e1-4763-8445-2cd8baf06e19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:46:43.729372 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:43.729372 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:46:43.729372 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:46:43.729372 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:46:43.729372 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:46:43.729372 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:46:43.729372 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:46:43.729372 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:46:43.729372 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:46:43.729372 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:46:43.729372 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:46:43.729372 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:46:43.729372 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:46:43.729372 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:46:43.730400 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:46:43.730400 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:46:43.730400 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:46:43.730400 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:46:43.730400 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:46:43.730400 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:46:43.730400 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:46:43.730400 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:46:43.730400 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 16 14:46:43.730400 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:46:43.730400 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:46:43.730400 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:46:43.730400 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:46:43.730400 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:46:43.730400 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:46:43.730400 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:46:43.730400 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:46:43.731571 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:46:43.731571 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:46:43.731571 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:46:43.731571 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:46:43.731571 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:46:43.731571 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:46:43.731571 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:46:43.731571 dv-cinder-837165-3-smb devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 16 14:46:43.731571 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 634/1285] 10.222.0.85 () {56 vars in 1111 bytes} [Thu Jun 16 14:46:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:46:43.736554 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d27fd0-764d-4e0a-b8e5-9433c8681a43 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:43.791838 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:43.859436 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d27fd0-764d-4e0a-b8e5-9433c8681a43 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:43.897235 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743752b6-4aa5-47e4-af6c-44174b25e874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:43.897881 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743752b6-4aa5-47e4-af6c-44174b25e874 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:43.898155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743752b6-4aa5-47e4-af6c-44174b25e874 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:43.898530 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743752b6-4aa5-47e4-af6c-44174b25e874 None admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:43.899411 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743752b6-4aa5-47e4-af6c-44174b25e874 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:43.899716 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743752b6-4aa5-47e4-af6c-44174b25e874 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:43.901178 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743752b6-4aa5-47e4-af6c-44174b25e874 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:43.913211 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 652/1286] 10.222.0.85 () {56 vars in 1148 bytes} [Thu Jun 16 14:46:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:46:43.923658 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d54c1a-75e1-4763-8445-2cd8baf06e19 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:44.031063 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d54c1a-75e1-4763-8445-2cd8baf06e19 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:44.068339 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f8206-4944-4ee2-a6ee-e9ffcf9e7841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:44.069238 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f8206-4944-4ee2-a6ee-e9ffcf9e7841 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:44.069525 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f8206-4944-4ee2-a6ee-e9ffcf9e7841 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:44.069934 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f8206-4944-4ee2-a6ee-e9ffcf9e7841 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:44.071017 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f8206-4944-4ee2-a6ee-e9ffcf9e7841 None admin] RBAC: Adding query filter params (role.id=95dcfa6c726a4d01a41d2642554fd338, scope.project.id=80e309a3b3784ba9943734a41949b222, user.id=819ad532defb4adaa2f4fd06b47630d2) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:44.071321 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f8206-4944-4ee2-a6ee-e9ffcf9e7841 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:44.072797 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f8206-4944-4ee2-a6ee-e9ffcf9e7841 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:44.079897 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 635/1287] 10.222.0.85 () {56 vars in 1374 bytes} [Thu Jun 16 14:46:43 2022] GET /identity/v3/role_assignments?user.id=819ad532defb4adaa2f4fd06b47630d2&scope.project.id=80e309a3b3784ba9943734a41949b222&role.id=95dcfa6c726a4d01a41d2642554fd338 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:46:46.248860 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87db484-0c54-4a3a-bdfa-ee7b878a7697 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:46.249766 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87db484-0c54-4a3a-bdfa-ee7b878a7697 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:46.249766 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87db484-0c54-4a3a-bdfa-ee7b878a7697 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:46.251952 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 653/1288] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:46:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:46:46.258292 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd3db4-1e69-4701-a008-17ba00455f39 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:46.258712 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd3db4-1e69-4701-a008-17ba00455f39 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:46.258819 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd3db4-1e69-4701-a008-17ba00455f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:46.278260 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-eccd3db4-1e69-4701-a008-17ba00455f39 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:46:46.279497 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-eccd3db4-1e69-4701-a008-17ba00455f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:46.312807 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:46.355967 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 636/1289] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:46:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:46:46.389682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87db484-0c54-4a3a-bdfa-ee7b878a7697 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:46.511804 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87db484-0c54-4a3a-bdfa-ee7b878a7697 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:46.528598 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:46.555748 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ccbb5-9fea-42f1-bf88-72f7a3433aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:46.556605 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ccbb5-9fea-42f1-bf88-72f7a3433aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:46.556886 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ccbb5-9fea-42f1-bf88-72f7a3433aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:46.557162 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ccbb5-9fea-42f1-bf88-72f7a3433aa9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:46.557810 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ccbb5-9fea-42f1-bf88-72f7a3433aa9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:46.559179 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ccbb5-9fea-42f1-bf88-72f7a3433aa9 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:46.571526 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-ee9ccbb5-9fea-42f1-bf88-72f7a3433aa9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 14:46:46.571526 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:46.571526 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:46:46.571526 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:46:46.571526 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:46:46.571526 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:46:46.571526 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:46:46.571526 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:46:46.571526 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 14:46:46.571526 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:46:46.571526 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:46:46.571526 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:46:46.571526 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:46.571526 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:46:46.571526 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:46:46.571526 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:46:46.571526 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:46:46.572872 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:46:46.572872 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:46:46.572872 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:46:46.572872 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:46:46.572872 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:46:46.572872 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:46:46.572872 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:46:46.572872 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:46:46.572872 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:46:46.572872 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:46:46.572872 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:46:46.572872 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:46:46.572872 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:46:46.572872 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:46:46.572872 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:46:46.572872 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:46:46.574019 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:46:46.574019 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:46:46.574019 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:46:46.574019 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:46:46.574019 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:46:46.574019 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:46:46.574019 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:46:46.574019 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:46:46.574019 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:46:46.574019 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:46:46.574019 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:46:46.574019 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:46:46.574019 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 14:46:46.574019 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:46:46.576253 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 654/1290] 10.222.0.85 () {56 vars in 1117 bytes} [Thu Jun 16 14:46:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:46:46.578827 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd3db4-1e69-4701-a008-17ba00455f39 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:46.687478 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd3db4-1e69-4701-a008-17ba00455f39 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:46.722494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057e5ca-2fd1-4056-88be-9b009b0c01cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:46.723151 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057e5ca-2fd1-4056-88be-9b009b0c01cb None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:46.723429 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057e5ca-2fd1-4056-88be-9b009b0c01cb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:46.723701 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057e5ca-2fd1-4056-88be-9b009b0c01cb None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:46.724434 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a057e5ca-2fd1-4056-88be-9b009b0c01cb None admin] RBAC: Adding query filter params (name=placement) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:46.724740 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a057e5ca-2fd1-4056-88be-9b009b0c01cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:46.726121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a057e5ca-2fd1-4056-88be-9b009b0c01cb None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:46.731191 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 637/1291] 10.222.0.85 () {56 vars in 1116 bytes} [Thu Jun 16 14:46:46 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:46:46.737175 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ccbb5-9fea-42f1-bf88-72f7a3433aa9 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:46.856392 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ccbb5-9fea-42f1-bf88-72f7a3433aa9 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:46.895481 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada1671-998f-4de8-8d68-7fde0cfe1e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:46.896162 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada1671-998f-4de8-8d68-7fde0cfe1e56 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:46.896445 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada1671-998f-4de8-8d68-7fde0cfe1e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:46.896725 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada1671-998f-4de8-8d68-7fde0cfe1e56 None admin] PATH_INFO: `/v3/services` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:46.897425 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada1671-998f-4de8-8d68-7fde0cfe1e56 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:46.897735 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada1671-998f-4de8-8d68-7fde0cfe1e56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:46.899218 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada1671-998f-4de8-8d68-7fde0cfe1e56 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:46.903915 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 655/1292] 10.222.0.85 () {56 vars in 1116 bytes} [Thu Jun 16 14:46:46 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:46:49.008607 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966c7a4-a240-48fa-9c9e-31e706691e80 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:49.009500 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966c7a4-a240-48fa-9c9e-31e706691e80 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:49.009500 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966c7a4-a240-48fa-9c9e-31e706691e80 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:49.011724 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 638/1293] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:46:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:46:49.020554 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941fce1-108d-4cc5-8c89-9ee75ce4f9e4 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:49.021243 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941fce1-108d-4cc5-8c89-9ee75ce4f9e4 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:49.021415 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941fce1-108d-4cc5-8c89-9ee75ce4f9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:49.042035 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-6941fce1-108d-4cc5-8c89-9ee75ce4f9e4 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:46:49.043245 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6941fce1-108d-4cc5-8c89-9ee75ce4f9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:49.079290 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:49.127435 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 656/1294] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:46:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:46:49.152894 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966c7a4-a240-48fa-9c9e-31e706691e80 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:49.189779 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:49.265886 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966c7a4-a240-48fa-9c9e-31e706691e80 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:49.301495 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ba7dc-c294-4725-845f-f0c0f5188508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:49.302142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ba7dc-c294-4725-845f-f0c0f5188508 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:49.302422 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ba7dc-c294-4725-845f-f0c0f5188508 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:49.302695 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ba7dc-c294-4725-845f-f0c0f5188508 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:49.303414 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ba7dc-c294-4725-845f-f0c0f5188508 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:49.304846 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ba7dc-c294-4725-845f-f0c0f5188508 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:49.323777 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 639/1295] 10.222.0.85 () {60 vars in 1141 bytes} [Thu Jun 16 14:46:49 2022] POST /identity/v3/services => generated 246 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:46:51.451669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2b9e9-6e03-4489-9654-e40ef15b9589 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:51.452656 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2b9e9-6e03-4489-9654-e40ef15b9589 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:51.452656 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2b9e9-6e03-4489-9654-e40ef15b9589 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:51.454743 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 657/1296] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:46:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:46:51.461107 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376660e-ec07-4e7d-b43b-887f3edaac01 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:51.461610 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376660e-ec07-4e7d-b43b-887f3edaac01 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:51.461895 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376660e-ec07-4e7d-b43b-887f3edaac01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:51.481292 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e376660e-ec07-4e7d-b43b-887f3edaac01 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:46:51.482477 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e376660e-ec07-4e7d-b43b-887f3edaac01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:51.572711 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 640/1297] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:46:51 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:46:51.596228 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2b9e9-6e03-4489-9654-e40ef15b9589 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:51.716962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2b9e9-6e03-4489-9654-e40ef15b9589 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:51.754819 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec2e52-b23f-4114-a1fb-fe2ec64caa1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:51.755643 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec2e52-b23f-4114-a1fb-fe2ec64caa1a None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:51.755966 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec2e52-b23f-4114-a1fb-fe2ec64caa1a None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:51.756248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec2e52-b23f-4114-a1fb-fe2ec64caa1a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:51.756887 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec2e52-b23f-4114-a1fb-fe2ec64caa1a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:51.758557 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec2e52-b23f-4114-a1fb-fe2ec64caa1a None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:51.770681 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-ceec2e52-b23f-4114-a1fb-fe2ec64caa1a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 14:46:51.770681 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:51.770681 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:46:51.770681 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:46:51.770681 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:46:51.770681 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:46:51.770681 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:46:51.770681 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:46:51.770681 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 14:46:51.770681 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:46:51.770681 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:46:51.770681 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:46:51.770681 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:51.770681 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:46:51.770681 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:46:51.770681 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:46:51.770681 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:46:51.771840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:46:51.771840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:46:51.771840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:46:51.771840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:46:51.771840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:46:51.771840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:46:51.771840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:46:51.771840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:46:51.771840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:46:51.771840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:46:51.771840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:46:51.771840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:46:51.771840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:46:51.771840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:46:51.771840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:46:51.771840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:46:51.772750 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:46:51.772750 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:46:51.772750 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:46:51.772750 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:46:51.772750 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:46:51.772750 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:46:51.772750 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:46:51.772750 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:46:51.772750 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:46:51.772750 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:46:51.772750 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:46:51.772750 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:46:51.772750 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 14:46:51.772750 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:46:51.772750 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 658/1298] 10.222.0.85 () {56 vars in 1117 bytes} [Thu Jun 16 14:46:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:46:51.779671 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376660e-ec07-4e7d-b43b-887f3edaac01 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:51.799598 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:51.884603 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376660e-ec07-4e7d-b43b-887f3edaac01 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:51.933840 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c8b80-29cd-4698-a604-0d0d89c5b9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:51.934507 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c8b80-29cd-4698-a604-0d0d89c5b9a8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:51.934784 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c8b80-29cd-4698-a604-0d0d89c5b9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:51.935059 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c8b80-29cd-4698-a604-0d0d89c5b9a8 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:51.935769 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c8b80-29cd-4698-a604-0d0d89c5b9a8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:51.936107 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c8b80-29cd-4698-a604-0d0d89c5b9a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:51.937476 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c8b80-29cd-4698-a604-0d0d89c5b9a8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:51.942782 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 641/1299] 10.222.0.85 () {56 vars in 1116 bytes} [Thu Jun 16 14:46:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:46:51.950022 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec2e52-b23f-4114-a1fb-fe2ec64caa1a None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:51.987917 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:52.058039 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec2e52-b23f-4114-a1fb-fe2ec64caa1a None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:52.097844 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae43c90-f9dc-4bb2-a9cc-e7c11c5c7acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:52.098582 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae43c90-f9dc-4bb2-a9cc-e7c11c5c7acf None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:52.098910 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae43c90-f9dc-4bb2-a9cc-e7c11c5c7acf None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:52.099241 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae43c90-f9dc-4bb2-a9cc-e7c11c5c7acf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:52.100256 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae43c90-f9dc-4bb2-a9cc-e7c11c5c7acf None admin] RBAC: Adding query filter params (interface=public, service_id=afb7cf4aaa40477e9aa2c9f2a9e5939e, region_id=RegionOne) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:52.100651 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae43c90-f9dc-4bb2-a9cc-e7c11c5c7acf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:52.102339 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae43c90-f9dc-4bb2-a9cc-e7c11c5c7acf None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:52.108351 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 659/1300] 10.222.0.85 () {56 vars in 1251 bytes} [Thu Jun 16 14:46:51 2022] GET /identity/v3/endpoints?service_id=afb7cf4aaa40477e9aa2c9f2a9e5939e&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:46:52.115631 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c8b80-29cd-4698-a604-0d0d89c5b9a8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:52.202941 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:52.224302 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c8b80-29cd-4698-a604-0d0d89c5b9a8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:52.259969 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e8d8b-9f2f-4731-b05b-0cbd79b20b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:52.260575 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e8d8b-9f2f-4731-b05b-0cbd79b20b23 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:52.260854 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e8d8b-9f2f-4731-b05b-0cbd79b20b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:52.261127 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e8d8b-9f2f-4731-b05b-0cbd79b20b23 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:52.261809 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2e8d8b-9f2f-4731-b05b-0cbd79b20b23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:52.263192 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2e8d8b-9f2f-4731-b05b-0cbd79b20b23 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:52.270158 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 642/1301] 10.222.0.85 () {56 vars in 1087 bytes} [Thu Jun 16 14:46:52 2022] GET /identity/v3/services => generated 2191 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:46:54.405204 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd04bf9-8971-44cf-b8cd-abd327bc0072 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:54.406141 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd04bf9-8971-44cf-b8cd-abd327bc0072 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:54.406141 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd04bf9-8971-44cf-b8cd-abd327bc0072 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:54.408487 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 660/1302] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:46:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:46:54.417140 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076a23f-4862-49ff-9c88-d6d1a7902a5a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:54.417578 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076a23f-4862-49ff-9c88-d6d1a7902a5a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:54.417690 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076a23f-4862-49ff-9c88-d6d1a7902a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:54.436616 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a076a23f-4862-49ff-9c88-d6d1a7902a5a None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:46:54.437819 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a076a23f-4862-49ff-9c88-d6d1a7902a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:46:54.512511 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 643/1303] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:46:54 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:46:54.535912 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd04bf9-8971-44cf-b8cd-abd327bc0072 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:54.641715 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:54.649717 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd04bf9-8971-44cf-b8cd-abd327bc0072 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:54.686588 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744297d4-3501-4bcf-bf6d-49936d5f3d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:54.687308 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744297d4-3501-4bcf-bf6d-49936d5f3d59 None admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:54.687591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744297d4-3501-4bcf-bf6d-49936d5f3d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:54.687901 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744297d4-3501-4bcf-bf6d-49936d5f3d59 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:54.688545 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744297d4-3501-4bcf-bf6d-49936d5f3d59 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:54.689925 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744297d4-3501-4bcf-bf6d-49936d5f3d59 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:54.702027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application [None req-744297d4-3501-4bcf-bf6d-49936d5f3d59 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 14:46:54.702027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:54.702027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:46:54.702027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:46:54.702027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:46:54.702027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:46:54.702027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:46:54.702027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:46:54.702027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 14:46:54.702027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:46:54.702027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:46:54.702027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:46:54.702027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:46:54.702027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:46:54.702027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:46:54.702027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:46:54.702027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:46:54.703203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:46:54.703203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:46:54.703203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:46:54.703203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:46:54.703203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:46:54.703203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:46:54.703203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:46:54.703203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:46:54.703203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:46:54.703203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:46:54.703203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:46:54.703203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:46:54.703203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:46:54.703203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:46:54.703203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:46:54.703203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:46:54.704258 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:46:54.704258 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application with Lock( Jun 16 14:46:54.704258 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:46:54.704258 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:46:54.704258 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:46:54.704258 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:46:54.704258 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:46:54.704258 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:46:54.704258 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:46:54.704258 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:46:54.704258 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:46:54.704258 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:46:54.704258 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 14:46:54.704258 dv-cinder-837165-3-smb devstack@keystone.service[80176]: ERROR keystone.server.flask.application Jun 16 14:46:54.704258 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 661/1304] 10.222.0.85 () {56 vars in 1117 bytes} [Thu Jun 16 14:46:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:46:54.712269 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076a23f-4862-49ff-9c88-d6d1a7902a5a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:54.795949 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:54.822768 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076a23f-4862-49ff-9c88-d6d1a7902a5a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:54.858689 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1668f-4236-495d-8cd2-7c9b7b8fb9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:54.859352 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1668f-4236-495d-8cd2-7c9b7b8fb9be None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:54.859632 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1668f-4236-495d-8cd2-7c9b7b8fb9be None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:54.859916 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1668f-4236-495d-8cd2-7c9b7b8fb9be None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:54.860632 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1668f-4236-495d-8cd2-7c9b7b8fb9be None admin] RBAC: Adding query filter params (name=placement) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:46:54.860937 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1668f-4236-495d-8cd2-7c9b7b8fb9be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:54.862319 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1668f-4236-495d-8cd2-7c9b7b8fb9be None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:54.867759 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 644/1305] 10.222.0.85 () {56 vars in 1116 bytes} [Thu Jun 16 14:46:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:46:54.873878 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744297d4-3501-4bcf-bf6d-49936d5f3d59 None admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:46:55.012376 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744297d4-3501-4bcf-bf6d-49936d5f3d59 None admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:46:55.047957 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb2051-255e-4876-ab0f-3d015a72d645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:46:55.048611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb2051-255e-4876-ab0f-3d015a72d645 None admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:46:55.048886 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb2051-255e-4876-ab0f-3d015a72d645 None admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:46:55.049164 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb2051-255e-4876-ab0f-3d015a72d645 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:46:55.049906 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb2051-255e-4876-ab0f-3d015a72d645 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:46:55.051282 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb2051-255e-4876-ab0f-3d015a72d645 None admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:46:55.073642 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 662/1306] 10.222.0.85 () {60 vars in 1144 bytes} [Thu Jun 16 14:46:54 2022] POST /identity/v3/endpoints => generated 331 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:47:04.864566 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=30 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:05.068672 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:59.123683 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530b11e-6849-4939-854a-692f691687b7 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:59.124301 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530b11e-6849-4939-854a-692f691687b7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:59.124301 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530b11e-6849-4939-854a-692f691687b7 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:59.129515 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 645/1307] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:47:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:59.131093 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ec6af-8d9e-4650-b74f-c23c0c9343d7 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:59.131571 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ec6af-8d9e-4650-b74f-c23c0c9343d7 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:59.131662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ec6af-8d9e-4650-b74f-c23c0c9343d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:59.211566 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-053ec6af-8d9e-4650-b74f-c23c0c9343d7 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:59.212788 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-053ec6af-8d9e-4650-b74f-c23c0c9343d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:59.319188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 663/1308] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:47:59.402640 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcabb2-7e42-4b31-af5a-ec0d1649f30a None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:59.402978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcabb2-7e42-4b31-af5a-ec0d1649f30a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:59.403274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcabb2-7e42-4b31-af5a-ec0d1649f30a None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:59.405316 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 646/1309] 10.222.0.85 () {54 vars in 964 bytes} [Thu Jun 16 14:47:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:59.412085 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eedb06-b037-4107-a588-6bfec356eff3 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:59.413452 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eedb06-b037-4107-a588-6bfec356eff3 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:59.414320 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eedb06-b037-4107-a588-6bfec356eff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:59.586421 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-64eedb06-b037-4107-a588-6bfec356eff3 None None] MFA Rules not processed for user `3d3d59fabcf94718bbc005519cec6f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:59.592499 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-64eedb06-b037-4107-a588-6bfec356eff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:59.622256 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:59.685532 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 664/1310] 10.222.0.85 () {58 vars in 1061 bytes} [Thu Jun 16 14:47:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:47:59.694766 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcabb2-7e42-4b31-af5a-ec0d1649f30a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:59.696657 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d0bcabb2-7e42-4b31-af5a-ec0d1649f30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:59.820345 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcabb2-7e42-4b31-af5a-ec0d1649f30a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:59.899469 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5f730-00f4-4fc1-89b5-bcf81a685e11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:59.900161 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5f730-00f4-4fc1-89b5-bcf81a685e11 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:59.900446 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5f730-00f4-4fc1-89b5-bcf81a685e11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:59.900750 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5f730-00f4-4fc1-89b5-bcf81a685e11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:59.902417 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-acd5f730-00f4-4fc1-89b5-bcf81a685e11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:59.959741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:00.018927 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd5f730-00f4-4fc1-89b5-bcf81a685e11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:48:00.020411 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd5f730-00f4-4fc1-89b5-bcf81a685e11 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:48:00.040430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 647/1311] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:47:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:48:02.486699 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cba9d-c1f3-4d14-a724-fee1cdbf26d1 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:02.487265 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cba9d-c1f3-4d14-a724-fee1cdbf26d1 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:02.487265 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cba9d-c1f3-4d14-a724-fee1cdbf26d1 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:02.488874 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 665/1312] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:02.494199 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b3d78-4ab1-435a-940a-37092ebda5c8 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:02.494733 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b3d78-4ab1-435a-940a-37092ebda5c8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:02.494733 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b3d78-4ab1-435a-940a-37092ebda5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:02.595319 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f53b3d78-4ab1-435a-940a-37092ebda5c8 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:02.596705 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f53b3d78-4ab1-435a-940a-37092ebda5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:02.717547 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 648/1313] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:48:02.756277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3cba9d-c1f3-4d14-a724-fee1cdbf26d1 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:48:02.757826 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-aa3cba9d-c1f3-4d14-a724-fee1cdbf26d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:02.869225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3cba9d-c1f3-4d14-a724-fee1cdbf26d1 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:48:02.946881 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:02.949878 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f28b85-b4b7-4089-9cd1-87acc1f899c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:48:02.950630 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f28b85-b4b7-4089-9cd1-87acc1f899c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:02.950873 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f28b85-b4b7-4089-9cd1-87acc1f899c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:02.951163 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f28b85-b4b7-4089-9cd1-87acc1f899c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:02.953409 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-31f28b85-b4b7-4089-9cd1-87acc1f899c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:03.074761 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f28b85-b4b7-4089-9cd1-87acc1f899c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:48:03.076311 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f28b85-b4b7-4089-9cd1-87acc1f899c8 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:48:03.095110 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 666/1314] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:48:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:48:05.532151 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d043599-4641-4c54-8365-ca7b50a9c1f9 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:05.533061 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d043599-4641-4c54-8365-ca7b50a9c1f9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:05.533061 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d043599-4641-4c54-8365-ca7b50a9c1f9 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:05.535097 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 649/1315] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:48:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:05.542274 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbc4b9-6a4e-4b02-915e-5260971faece None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:05.542726 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbc4b9-6a4e-4b02-915e-5260971faece None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:05.542817 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbc4b9-6a4e-4b02-915e-5260971faece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:05.619337 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-68fbc4b9-6a4e-4b02-915e-5260971faece None None] MFA Rules not processed for user `1b2adb9bc22345fcbdd8189b5378b491`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:05.620599 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-68fbc4b9-6a4e-4b02-915e-5260971faece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:05.673875 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:05.722742 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 667/1316] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:48:05 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:48:05.762208 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d043599-4641-4c54-8365-ca7b50a9c1f9 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:48:05.763780 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3d043599-4641-4c54-8365-ca7b50a9c1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:05.774678 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:05.878733 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d043599-4641-4c54-8365-ca7b50a9c1f9 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:48:05.963812 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28e4a0-1481-45eb-9de3-c4fb0e1fc00b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:48:05.964495 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28e4a0-1481-45eb-9de3-c4fb0e1fc00b service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:05.964800 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28e4a0-1481-45eb-9de3-c4fb0e1fc00b service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:05.965058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28e4a0-1481-45eb-9de3-c4fb0e1fc00b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:05.966723 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2f28e4a0-1481-45eb-9de3-c4fb0e1fc00b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:06.039383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:06.098035 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28e4a0-1481-45eb-9de3-c4fb0e1fc00b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:48:06.099563 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28e4a0-1481-45eb-9de3-c4fb0e1fc00b service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:48:06.119204 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 650/1317] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:48:05 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:48:08.836562 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6477b31-5dcc-4f66-994a-970d3e85c467 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:08.838237 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6477b31-5dcc-4f66-994a-970d3e85c467 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:08.838237 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6477b31-5dcc-4f66-994a-970d3e85c467 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:08.839804 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 668/1318] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:48:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:08.847786 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f744584-9f78-4126-96d6-fde8c7d904b1 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:08.848263 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f744584-9f78-4126-96d6-fde8c7d904b1 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:08.848355 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f744584-9f78-4126-96d6-fde8c7d904b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:08.917512 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-2f744584-9f78-4126-96d6-fde8c7d904b1 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:08.918717 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2f744584-9f78-4126-96d6-fde8c7d904b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:09.031903 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 651/1319] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:48:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:48:09.076086 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6477b31-5dcc-4f66-994a-970d3e85c467 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:48:09.078963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c6477b31-5dcc-4f66-994a-970d3e85c467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:09.195319 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6477b31-5dcc-4f66-994a-970d3e85c467 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:48:09.274859 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760eb9fe-a712-40ca-a2a4-b179a8c753a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:48:09.275503 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760eb9fe-a712-40ca-a2a4-b179a8c753a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:09.275780 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760eb9fe-a712-40ca-a2a4-b179a8c753a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:09.276109 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760eb9fe-a712-40ca-a2a4-b179a8c753a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:09.277761 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-760eb9fe-a712-40ca-a2a4-b179a8c753a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:09.285608 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:09.411105 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760eb9fe-a712-40ca-a2a4-b179a8c753a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:48:09.413839 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760eb9fe-a712-40ca-a2a4-b179a8c753a3 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:48:09.433934 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 669/1320] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:48:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:48:12.293815 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe460553-79dd-4e7c-bbbf-91ac4736572f None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:12.294407 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe460553-79dd-4e7c-bbbf-91ac4736572f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:12.294407 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe460553-79dd-4e7c-bbbf-91ac4736572f None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:12.295793 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 652/1321] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:12.301491 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a975515-48d0-45c9-86aa-24f0c1cdadf8 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:12.301922 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a975515-48d0-45c9-86aa-24f0c1cdadf8 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:12.302150 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a975515-48d0-45c9-86aa-24f0c1cdadf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:12.376505 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-7a975515-48d0-45c9-86aa-24f0c1cdadf8 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:12.377797 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7a975515-48d0-45c9-86aa-24f0c1cdadf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:12.445221 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:12.489732 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 670/1322] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:48:12.526682 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe460553-79dd-4e7c-bbbf-91ac4736572f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:48:12.528348 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fe460553-79dd-4e7c-bbbf-91ac4736572f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:12.551066 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:12.641324 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe460553-79dd-4e7c-bbbf-91ac4736572f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:48:12.717704 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1c1b3-de8a-4b80-a8b4-f101c9278b3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:48:12.718364 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1c1b3-de8a-4b80-a8b4-f101c9278b3d service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:12.718650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1c1b3-de8a-4b80-a8b4-f101c9278b3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:12.718926 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1c1b3-de8a-4b80-a8b4-f101c9278b3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:12.720645 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2cd1c1b3-de8a-4b80-a8b4-f101c9278b3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:12.797540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:12.839265 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1c1b3-de8a-4b80-a8b4-f101c9278b3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:48:12.840671 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1c1b3-de8a-4b80-a8b4-f101c9278b3d service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:48:12.861291 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 653/1323] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:48:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:48:15.013695 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cd6a9-dd02-4d5e-849a-77256a335120 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:15.014156 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cd6a9-dd02-4d5e-849a-77256a335120 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:15.014247 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cd6a9-dd02-4d5e-849a-77256a335120 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:15.017535 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 671/1324] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:48:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:15.021237 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a0679-f648-4033-9494-31fdbae8c201 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:15.021670 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a0679-f648-4033-9494-31fdbae8c201 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:15.021748 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a0679-f648-4033-9494-31fdbae8c201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:15.097971 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-eb4a0679-f648-4033-9494-31fdbae8c201 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:15.099200 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-eb4a0679-f648-4033-9494-31fdbae8c201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:15.202275 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 654/1325] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:48:15.240286 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19cd6a9-dd02-4d5e-849a-77256a335120 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:48:15.241841 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a19cd6a9-dd02-4d5e-849a-77256a335120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:15.361340 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19cd6a9-dd02-4d5e-849a-77256a335120 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:48:15.443321 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df395439-7b38-4f94-a006-6775b4a01cd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:48:15.444007 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df395439-7b38-4f94-a006-6775b4a01cd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:15.444274 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df395439-7b38-4f94-a006-6775b4a01cd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:15.444573 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df395439-7b38-4f94-a006-6775b4a01cd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:15.446347 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-df395439-7b38-4f94-a006-6775b4a01cd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:15.464362 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:15.569579 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df395439-7b38-4f94-a006-6775b4a01cd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:48:15.571039 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df395439-7b38-4f94-a006-6775b4a01cd9 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:48:15.589807 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 672/1326] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:48:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:48:17.766565 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f67a2-8e90-437a-ac96-fb5bc677e2a4 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:17.767151 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f67a2-8e90-437a-ac96-fb5bc677e2a4 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:17.767151 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f67a2-8e90-437a-ac96-fb5bc677e2a4 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:17.768718 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 655/1327] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:17.773701 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e75c1-9b0c-44af-8f0e-bcfbc819b046 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:17.774179 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e75c1-9b0c-44af-8f0e-bcfbc819b046 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:17.774329 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e75c1-9b0c-44af-8f0e-bcfbc819b046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:17.849818 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-272e75c1-9b0c-44af-8f0e-bcfbc819b046 None None] MFA Rules not processed for user `1b2adb9bc22345fcbdd8189b5378b491`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:17.851032 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-272e75c1-9b0c-44af-8f0e-bcfbc819b046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:17.921766 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:17.955182 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 673/1328] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:48:17 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:48:18.007053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d4118-8e7e-4aa0-bfda-1e7021e680c9 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:18.007448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d4118-8e7e-4aa0-bfda-1e7021e680c9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:18.007784 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d4118-8e7e-4aa0-bfda-1e7021e680c9 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:18.009937 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 656/1329] 10.222.0.85 () {54 vars in 964 bytes} [Thu Jun 16 14:48:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:18.016117 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290f918-d3c4-4995-aebf-5862b9578b22 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:18.016410 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290f918-d3c4-4995-aebf-5862b9578b22 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:18.016692 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290f918-d3c4-4995-aebf-5862b9578b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:18.116872 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-4290f918-d3c4-4995-aebf-5862b9578b22 None None] MFA Rules not processed for user `3d3d59fabcf94718bbc005519cec6f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:18.118761 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4290f918-d3c4-4995-aebf-5862b9578b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:18.202770 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 674/1330] 10.222.0.85 () {58 vars in 1061 bytes} [Thu Jun 16 14:48:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:48:18.212370 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d4118-8e7e-4aa0-bfda-1e7021e680c9 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:48:18.213892 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-224d4118-8e7e-4aa0-bfda-1e7021e680c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:18.248484 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:18.326081 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d4118-8e7e-4aa0-bfda-1e7021e680c9 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:48:18.410432 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63094209-a0c5-475e-8cbc-af210ca9e6e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:48:18.411163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63094209-a0c5-475e-8cbc-af210ca9e6e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:18.411454 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63094209-a0c5-475e-8cbc-af210ca9e6e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:18.411776 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63094209-a0c5-475e-8cbc-af210ca9e6e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:18.413840 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-63094209-a0c5-475e-8cbc-af210ca9e6e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:18.496238 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:18.541086 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63094209-a0c5-475e-8cbc-af210ca9e6e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:48:18.542548 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63094209-a0c5-475e-8cbc-af210ca9e6e0 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:48:18.562849 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 657/1331] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:48:18 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:48:21.368744 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1aa65-ef1b-4572-9785-46e0293478e2 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:21.369307 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1aa65-ef1b-4572-9785-46e0293478e2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:21.369307 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1aa65-ef1b-4572-9785-46e0293478e2 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:21.370638 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 675/1332] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:21.378216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b86ce2-b4db-4f67-bed3-41fe38607c0f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:21.378888 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b86ce2-b4db-4f67-bed3-41fe38607c0f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:21.379061 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b86ce2-b4db-4f67-bed3-41fe38607c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:21.450786 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b8b86ce2-b4db-4f67-bed3-41fe38607c0f None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:21.452180 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b8b86ce2-b4db-4f67-bed3-41fe38607c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:21.563495 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 658/1333] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:48:21.600409 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1aa65-ef1b-4572-9785-46e0293478e2 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:48:21.601967 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4fc1aa65-ef1b-4572-9785-46e0293478e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:21.676874 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:21.713621 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1aa65-ef1b-4572-9785-46e0293478e2 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:48:21.793046 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015b5d9-0483-47d0-8a0f-3b9e73d31ae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:48:21.793686 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015b5d9-0483-47d0-8a0f-3b9e73d31ae6 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:21.793962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015b5d9-0483-47d0-8a0f-3b9e73d31ae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:21.794239 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015b5d9-0483-47d0-8a0f-3b9e73d31ae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:21.795910 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e015b5d9-0483-47d0-8a0f-3b9e73d31ae6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:21.938307 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e015b5d9-0483-47d0-8a0f-3b9e73d31ae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:48:21.939681 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e015b5d9-0483-47d0-8a0f-3b9e73d31ae6 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:48:21.950250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:21.959684 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 676/1334] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:48:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:48:24.136355 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd26e0-5685-420a-91e8-a3bc6298060a None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:24.137244 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd26e0-5685-420a-91e8-a3bc6298060a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:24.137244 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd26e0-5685-420a-91e8-a3bc6298060a None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:24.139527 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 659/1335] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:48:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:24.148201 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa7233-2f83-4305-bdda-9388df646a74 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:24.148632 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa7233-2f83-4305-bdda-9388df646a74 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:24.148795 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa7233-2f83-4305-bdda-9388df646a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:24.222912 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-ebfa7233-2f83-4305-bdda-9388df646a74 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:24.224130 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ebfa7233-2f83-4305-bdda-9388df646a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:24.326699 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 677/1336] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:48:24.371007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd26e0-5685-420a-91e8-a3bc6298060a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:48:24.373641 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-dabd26e0-5685-420a-91e8-a3bc6298060a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:24.427777 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:24.505244 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd26e0-5685-420a-91e8-a3bc6298060a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:48:24.593140 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163aaf6-3281-4af8-ab1f-f2243bb9d285 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:48:24.593801 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163aaf6-3281-4af8-ab1f-f2243bb9d285 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:24.594083 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163aaf6-3281-4af8-ab1f-f2243bb9d285 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:24.594354 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163aaf6-3281-4af8-ab1f-f2243bb9d285 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:24.596062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d163aaf6-3281-4af8-ab1f-f2243bb9d285 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:24.684304 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:24.710796 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163aaf6-3281-4af8-ab1f-f2243bb9d285 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:48:24.712441 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163aaf6-3281-4af8-ab1f-f2243bb9d285 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:48:24.730862 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 660/1337] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:48:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:48:27.210029 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6868b-8e74-4217-b11a-14e516efab1c None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:27.210869 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6868b-8e74-4217-b11a-14e516efab1c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:27.210869 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6868b-8e74-4217-b11a-14e516efab1c None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:27.213496 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 678/1338] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:48:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:27.219298 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec140919-4d77-49df-8d12-4abfb7a3028a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:27.219759 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec140919-4d77-49df-8d12-4abfb7a3028a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:27.219986 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec140919-4d77-49df-8d12-4abfb7a3028a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:27.308428 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ec140919-4d77-49df-8d12-4abfb7a3028a None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:27.309584 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ec140919-4d77-49df-8d12-4abfb7a3028a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:27.431550 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 661/1339] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:48:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:48:27.470359 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6868b-8e74-4217-b11a-14e516efab1c None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:48:27.471995 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e5e6868b-8e74-4217-b11a-14e516efab1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:27.560312 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:27.594122 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6868b-8e74-4217-b11a-14e516efab1c None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:48:27.676093 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd2021-302c-4356-b78a-db098d34e6d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:48:27.676752 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd2021-302c-4356-b78a-db098d34e6d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:27.677033 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd2021-302c-4356-b78a-db098d34e6d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:27.677307 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd2021-302c-4356-b78a-db098d34e6d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:27.678978 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d3cd2021-302c-4356-b78a-db098d34e6d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:27.794187 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd2021-302c-4356-b78a-db098d34e6d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:48:27.795669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd2021-302c-4356-b78a-db098d34e6d3 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:48:27.815100 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 679/1340] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:48:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:48:32.015543 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9507af1-b6c2-487e-8acb-e2a5bb832b60 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:32.016193 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9507af1-b6c2-487e-8acb-e2a5bb832b60 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:32.016193 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9507af1-b6c2-487e-8acb-e2a5bb832b60 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:32.017515 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 662/1341] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:32.022938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ce6b3-adf7-4b1b-be89-698e78a82cbd None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:32.023381 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ce6b3-adf7-4b1b-be89-698e78a82cbd None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:32.023503 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ce6b3-adf7-4b1b-be89-698e78a82cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:32.030081 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:32.101555 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-329ce6b3-adf7-4b1b-be89-698e78a82cbd None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:32.102982 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-329ce6b3-adf7-4b1b-be89-698e78a82cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:32.214113 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 680/1342] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:48:32.252662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9507af1-b6c2-487e-8acb-e2a5bb832b60 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:48:32.254919 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d9507af1-b6c2-487e-8acb-e2a5bb832b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:32.309603 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:32.358037 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9507af1-b6c2-487e-8acb-e2a5bb832b60 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:48:32.361849 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753f2be-b32e-4fd0-9f60-48aab55cbe6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:48:32.362503 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753f2be-b32e-4fd0-9f60-48aab55cbe6a service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:32.362788 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753f2be-b32e-4fd0-9f60-48aab55cbe6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:32.363062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753f2be-b32e-4fd0-9f60-48aab55cbe6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:32.372583 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753f2be-b32e-4fd0-9f60-48aab55cbe6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:48:32.374044 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753f2be-b32e-4fd0-9f60-48aab55cbe6a service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:48:32.383754 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 663/1343] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:48:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:48:35.229307 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca49b98-da25-44ef-b504-4b826e0ebc94 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:35.229883 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca49b98-da25-44ef-b504-4b826e0ebc94 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:35.229883 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca49b98-da25-44ef-b504-4b826e0ebc94 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:35.231219 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 681/1344] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:48:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:35.237165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37423e-9ef6-4a05-b58a-4ea7fcb6c11e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:35.237746 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37423e-9ef6-4a05-b58a-4ea7fcb6c11e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:35.237746 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37423e-9ef6-4a05-b58a-4ea7fcb6c11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:35.268176 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1d37423e-9ef6-4a05-b58a-4ea7fcb6c11e None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:35.269373 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1d37423e-9ef6-4a05-b58a-4ea7fcb6c11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:35.351931 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 664/1345] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:48:35 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:48:35.389112 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca49b98-da25-44ef-b504-4b826e0ebc94 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:48:35.401614 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca49b98-da25-44ef-b504-4b826e0ebc94 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:48:35.405405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299f097-736f-4dfa-8482-8ebf46b7d34c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:48:35.406039 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299f097-736f-4dfa-8482-8ebf46b7d34c service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:35.406319 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299f097-736f-4dfa-8482-8ebf46b7d34c service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:35.406590 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299f097-736f-4dfa-8482-8ebf46b7d34c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:35.417880 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299f097-736f-4dfa-8482-8ebf46b7d34c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:48:35.419958 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299f097-736f-4dfa-8482-8ebf46b7d34c service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:48:35.434932 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 682/1346] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:48:35 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:48:39.702670 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede32c16-2189-4408-9357-6cfc3a82066c None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:39.703264 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede32c16-2189-4408-9357-6cfc3a82066c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:39.703264 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede32c16-2189-4408-9357-6cfc3a82066c None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:39.704799 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 665/1347] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:48:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:39.709989 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf8398-e622-4d5a-9fe6-012a9a960a54 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:39.710450 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf8398-e622-4d5a-9fe6-012a9a960a54 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:39.710769 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf8398-e622-4d5a-9fe6-012a9a960a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:39.730026 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d8bf8398-e622-4d5a-9fe6-012a9a960a54 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:39.731252 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d8bf8398-e622-4d5a-9fe6-012a9a960a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:39.741118 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 683/1348] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:48:39.778274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede32c16-2189-4408-9357-6cfc3a82066c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:48:39.780209 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ede32c16-2189-4408-9357-6cfc3a82066c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:39.793794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede32c16-2189-4408-9357-6cfc3a82066c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:48:39.797367 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7759211-9b20-4378-bc37-328e450b3e73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:48:39.798016 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7759211-9b20-4378-bc37-328e450b3e73 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:39.798303 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7759211-9b20-4378-bc37-328e450b3e73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:39.798598 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7759211-9b20-4378-bc37-328e450b3e73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:39.808447 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7759211-9b20-4378-bc37-328e450b3e73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:48:39.810883 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7759211-9b20-4378-bc37-328e450b3e73 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:48:39.821574 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 666/1349] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:48:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:48:44.878464 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc39709-795c-400b-bd15-3118a92a8ba6 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:44.879502 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc39709-795c-400b-bd15-3118a92a8ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:44.880025 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc39709-795c-400b-bd15-3118a92a8ba6 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:44.881859 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 684/1350] 10.222.0.85 () {54 vars in 921 bytes} [Thu Jun 16 14:48:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:44.887235 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac38c6-806c-4a38-b644-a821ad3214e7 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:44.888123 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac38c6-806c-4a38-b644-a821ad3214e7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:44.888625 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac38c6-806c-4a38-b644-a821ad3214e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:44.959462 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-7dac38c6-806c-4a38-b644-a821ad3214e7 None None] MFA Rules not processed for user `819ad532defb4adaa2f4fd06b47630d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:44.960683 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7dac38c6-806c-4a38-b644-a821ad3214e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:44.989260 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:45.048290 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 667/1351] 10.222.0.85 () {58 vars in 1018 bytes} [Thu Jun 16 14:48:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:48:49.442757 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24a055-e03a-4c93-bd59-d6d024c87071 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:49.443322 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24a055-e03a-4c93-bd59-d6d024c87071 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:49.443322 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24a055-e03a-4c93-bd59-d6d024c87071 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:49.444775 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 685/1352] 10.222.0.85 () {54 vars in 921 bytes} [Thu Jun 16 14:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:49.449921 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068c589-d3da-40cd-bff0-1958caca298a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:49.450384 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068c589-d3da-40cd-bff0-1958caca298a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:49.450633 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068c589-d3da-40cd-bff0-1958caca298a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:49.473366 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-2068c589-d3da-40cd-bff0-1958caca298a None None] MFA Rules not processed for user `819ad532defb4adaa2f4fd06b47630d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:49.474891 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2068c589-d3da-40cd-bff0-1958caca298a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:49.484546 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 668/1353] 10.222.0.85 () {58 vars in 1018 bytes} [Thu Jun 16 14:48:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:48:49.724323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=72 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:50.795406 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c192473-2d6f-4dbe-9e8d-d8de1b13d1cf None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:50.796095 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c192473-2d6f-4dbe-9e8d-d8de1b13d1cf None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:50.796095 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c192473-2d6f-4dbe-9e8d-d8de1b13d1cf None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:50.798992 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 686/1354] 10.222.0.85 () {54 vars in 921 bytes} [Thu Jun 16 14:48:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:50.808829 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27475b2-2d1e-4743-90f6-7eb01f57307c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:50.809309 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27475b2-2d1e-4743-90f6-7eb01f57307c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:50.809559 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27475b2-2d1e-4743-90f6-7eb01f57307c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:50.829422 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c27475b2-2d1e-4743-90f6-7eb01f57307c None None] MFA Rules not processed for user `819ad532defb4adaa2f4fd06b47630d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:50.830599 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c27475b2-2d1e-4743-90f6-7eb01f57307c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:50.840406 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 669/1355] 10.222.0.85 () {58 vars in 1018 bytes} [Thu Jun 16 14:48:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:48:54.569757 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac810b38-3af9-4b34-ace1-7f7c1f702e3f None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:54.570203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac810b38-3af9-4b34-ace1-7f7c1f702e3f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:54.570305 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac810b38-3af9-4b34-ace1-7f7c1f702e3f None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:54.572430 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 687/1356] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:48:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:54.577736 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e444b69-ea6b-4859-8e1f-3b82c5d37c73 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:54.578155 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e444b69-ea6b-4859-8e1f-3b82c5d37c73 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:54.578308 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e444b69-ea6b-4859-8e1f-3b82c5d37c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:54.597338 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-8e444b69-ea6b-4859-8e1f-3b82c5d37c73 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:54.598546 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8e444b69-ea6b-4859-8e1f-3b82c5d37c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:54.607100 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 670/1357] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:48:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:48:54.663030 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260d17b-b8cb-4d9a-a9dc-7f4baf2f30ff None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:54.663865 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260d17b-b8cb-4d9a-a9dc-7f4baf2f30ff None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:54.664353 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260d17b-b8cb-4d9a-a9dc-7f4baf2f30ff None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:54.666833 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 688/1358] 10.222.0.85 () {54 vars in 961 bytes} [Thu Jun 16 14:48:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:54.676871 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a8488-03cb-456c-a377-d28dd0f8aba9 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:54.677420 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a8488-03cb-456c-a377-d28dd0f8aba9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:54.677894 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a8488-03cb-456c-a377-d28dd0f8aba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:54.733724 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-978a8488-03cb-456c-a377-d28dd0f8aba9 None None] MFA Rules not processed for user `c74e4d1bdaa64ed280cc5f4c8e79b842`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:54.734977 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-978a8488-03cb-456c-a377-d28dd0f8aba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:54.826388 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 671/1359] 10.222.0.85 () {58 vars in 1058 bytes} [Thu Jun 16 14:48:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:48:54.834976 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260d17b-b8cb-4d9a-a9dc-7f4baf2f30ff None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:48:54.850000 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260d17b-b8cb-4d9a-a9dc-7f4baf2f30ff None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:48:54.855711 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac4d14-8a78-4b92-98c1-2c92a2531ee0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:48:54.856484 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac4d14-8a78-4b92-98c1-2c92a2531ee0 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:54.856871 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac4d14-8a78-4b92-98c1-2c92a2531ee0 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:54.857244 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac4d14-8a78-4b92-98c1-2c92a2531ee0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:54.866388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac4d14-8a78-4b92-98c1-2c92a2531ee0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:48:54.868209 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac4d14-8a78-4b92-98c1-2c92a2531ee0 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:48:54.879108 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 689/1360] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:48:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:48:57.270873 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fbc9d6-85eb-446a-a3b4-bce97085dcb2 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:57.271550 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fbc9d6-85eb-446a-a3b4-bce97085dcb2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:57.271550 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fbc9d6-85eb-446a-a3b4-bce97085dcb2 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:57.273654 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 672/1361] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:48:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:57.280260 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab3a97-28d5-48b9-99bd-1707c80c4df3 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:57.280931 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab3a97-28d5-48b9-99bd-1707c80c4df3 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:57.280931 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab3a97-28d5-48b9-99bd-1707c80c4df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:57.302611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-54ab3a97-28d5-48b9-99bd-1707c80c4df3 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:57.303924 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-54ab3a97-28d5-48b9-99bd-1707c80c4df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:57.313233 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 690/1362] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:48:57.360700 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fbc9d6-85eb-446a-a3b4-bce97085dcb2 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:48:57.376025 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fbc9d6-85eb-446a-a3b4-bce97085dcb2 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:48:57.382250 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28135805-18b7-42bf-9445-7d45e6e43fb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:48:57.382959 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28135805-18b7-42bf-9445-7d45e6e43fb1 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:57.383324 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28135805-18b7-42bf-9445-7d45e6e43fb1 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:57.383937 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28135805-18b7-42bf-9445-7d45e6e43fb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:57.393245 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28135805-18b7-42bf-9445-7d45e6e43fb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:48:57.394832 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28135805-18b7-42bf-9445-7d45e6e43fb1 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:48:57.405105 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 673/1363] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:48:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:48:59.880446 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb0989-ae86-43fe-b579-eb5f103e5c10 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:59.881002 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb0989-ae86-43fe-b579-eb5f103e5c10 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:59.881002 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb0989-ae86-43fe-b579-eb5f103e5c10 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:59.882295 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 691/1364] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:59.887910 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2438e-55af-4578-b059-dd4255122205 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:59.888373 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2438e-55af-4578-b059-dd4255122205 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:59.888478 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2438e-55af-4578-b059-dd4255122205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:59.908182 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a8f2438e-55af-4578-b059-dd4255122205 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:59.909400 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a8f2438e-55af-4578-b059-dd4255122205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:48:59.919556 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 674/1365] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:48:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:48:59.965723 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7dbbe-87a1-4177-a6f0-a22a93f6dd91 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:59.966187 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7dbbe-87a1-4177-a6f0-a22a93f6dd91 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:59.966504 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7dbbe-87a1-4177-a6f0-a22a93f6dd91 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:59.971556 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 692/1366] 10.222.0.85 () {54 vars in 961 bytes} [Thu Jun 16 14:48:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:48:59.974592 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc6cc6-da97-4653-a5a5-ad786c5ce520 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:48:59.974977 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc6cc6-da97-4653-a5a5-ad786c5ce520 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:48:59.975381 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc6cc6-da97-4653-a5a5-ad786c5ce520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:48:59.995889 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-8abc6cc6-da97-4653-a5a5-ad786c5ce520 None None] MFA Rules not processed for user `c74e4d1bdaa64ed280cc5f4c8e79b842`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:48:59.997127 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8abc6cc6-da97-4653-a5a5-ad786c5ce520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:00.009484 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 675/1367] 10.222.0.85 () {58 vars in 1058 bytes} [Thu Jun 16 14:48:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:49:00.017467 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7dbbe-87a1-4177-a6f0-a22a93f6dd91 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:49:00.040743 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7dbbe-87a1-4177-a6f0-a22a93f6dd91 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:49:00.047208 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b749101-03f8-4f86-ab1e-a38505c7e885 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:49:00.047486 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b749101-03f8-4f86-ab1e-a38505c7e885 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:00.047770 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b749101-03f8-4f86-ab1e-a38505c7e885 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:00.048067 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b749101-03f8-4f86-ab1e-a38505c7e885 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:00.057438 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b749101-03f8-4f86-ab1e-a38505c7e885 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:49:00.059040 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b749101-03f8-4f86-ab1e-a38505c7e885 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:49:00.068924 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 693/1368] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:49:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:49:02.315060 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33e4f1-dce7-45b5-b4ce-0f5d566ead73 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:02.315709 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33e4f1-dce7-45b5-b4ce-0f5d566ead73 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:02.315709 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33e4f1-dce7-45b5-b4ce-0f5d566ead73 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:02.317312 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 676/1369] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:49:02.322709 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe943e-4cdb-44fa-a055-a6a244868fa2 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:02.323224 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe943e-4cdb-44fa-a055-a6a244868fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:02.323310 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe943e-4cdb-44fa-a055-a6a244868fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:02.344925 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-3ebe943e-4cdb-44fa-a055-a6a244868fa2 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:49:02.346155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3ebe943e-4cdb-44fa-a055-a6a244868fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:02.356188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 694/1370] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:49:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:49:02.401092 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c33e4f1-dce7-45b5-b4ce-0f5d566ead73 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:49:02.417140 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c33e4f1-dce7-45b5-b4ce-0f5d566ead73 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:49:02.422959 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b521d79-2616-4803-bdc7-3245645a6fe8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:49:02.423634 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b521d79-2616-4803-bdc7-3245645a6fe8 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:02.423961 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b521d79-2616-4803-bdc7-3245645a6fe8 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:02.424248 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b521d79-2616-4803-bdc7-3245645a6fe8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:02.433719 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b521d79-2616-4803-bdc7-3245645a6fe8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:49:02.435346 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b521d79-2616-4803-bdc7-3245645a6fe8 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:49:02.453045 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 677/1371] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:49:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:49:02.613867 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1814b-c05c-4438-9c15-59bc51c98029 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:02.614085 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1814b-c05c-4438-9c15-59bc51c98029 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:02.614280 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1814b-c05c-4438-9c15-59bc51c98029 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:02.615954 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 695/1372] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:49:02.622217 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb4f9d-5558-4919-a317-d283eef9916f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:02.622528 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb4f9d-5558-4919-a317-d283eef9916f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:02.623121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb4f9d-5558-4919-a317-d283eef9916f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:02.646784 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a9cb4f9d-5558-4919-a317-d283eef9916f None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:49:02.648158 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a9cb4f9d-5558-4919-a317-d283eef9916f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:02.657020 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 678/1373] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:49:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:49:02.927303 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09802cf9-fba0-4184-a434-b52212c2904e None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:02.927663 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09802cf9-fba0-4184-a434-b52212c2904e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:02.928030 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09802cf9-fba0-4184-a434-b52212c2904e None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:02.929640 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 696/1374] 10.222.0.85 () {54 vars in 963 bytes} [Thu Jun 16 14:49:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:49:02.934945 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15a341-7e1a-4627-8f92-b45c081ea4e6 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:02.935310 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15a341-7e1a-4627-8f92-b45c081ea4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:02.935664 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15a341-7e1a-4627-8f92-b45c081ea4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:02.943800 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:49:02.993383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-de15a341-7e1a-4627-8f92-b45c081ea4e6 None None] MFA Rules not processed for user `1d0ac98d9520470483c348644566d9ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:49:02.997135 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-de15a341-7e1a-4627-8f92-b45c081ea4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:03.078239 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 679/1375] 10.222.0.85 () {58 vars in 1060 bytes} [Thu Jun 16 14:49:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:49:03.086104 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09802cf9-fba0-4184-a434-b52212c2904e None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:49:03.099816 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09802cf9-fba0-4184-a434-b52212c2904e None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:49:03.104346 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289dd7e-d8d2-4f9c-8b1b-5e6f320d80f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:49:03.104997 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289dd7e-d8d2-4f9c-8b1b-5e6f320d80f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:03.105487 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289dd7e-d8d2-4f9c-8b1b-5e6f320d80f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:03.105964 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289dd7e-d8d2-4f9c-8b1b-5e6f320d80f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:03.118509 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6289dd7e-d8d2-4f9c-8b1b-5e6f320d80f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:49:03.120172 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6289dd7e-d8d2-4f9c-8b1b-5e6f320d80f8 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:49:03.132823 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 697/1376] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:49:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:49:04.670045 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102214a8-cc75-4ab3-a51b-7cc82d28e682 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:04.670622 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102214a8-cc75-4ab3-a51b-7cc82d28e682 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:04.670622 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102214a8-cc75-4ab3-a51b-7cc82d28e682 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:04.672096 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 680/1377] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:49:04.678240 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efc9b3-b44e-48e2-accc-7b6a10415e58 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:04.678794 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efc9b3-b44e-48e2-accc-7b6a10415e58 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:04.678794 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efc9b3-b44e-48e2-accc-7b6a10415e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:04.698335 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d3efc9b3-b44e-48e2-accc-7b6a10415e58 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:49:04.699616 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d3efc9b3-b44e-48e2-accc-7b6a10415e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:04.708686 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 698/1378] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:49:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:49:04.755830 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102214a8-cc75-4ab3-a51b-7cc82d28e682 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:49:04.771359 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102214a8-cc75-4ab3-a51b-7cc82d28e682 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:49:04.777756 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00e4ed-982f-4792-b20c-31760a3c1d2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:49:04.778429 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00e4ed-982f-4792-b20c-31760a3c1d2c service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:04.778709 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00e4ed-982f-4792-b20c-31760a3c1d2c service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:04.778982 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00e4ed-982f-4792-b20c-31760a3c1d2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:04.788242 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00e4ed-982f-4792-b20c-31760a3c1d2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:49:04.790363 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00e4ed-982f-4792-b20c-31760a3c1d2c service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:49:04.801294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 681/1379] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:49:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:49:06.991100 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf757e-ba23-454c-b83a-3d115db02866 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:06.991732 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf757e-ba23-454c-b83a-3d115db02866 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:06.991732 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf757e-ba23-454c-b83a-3d115db02866 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:06.993042 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 699/1380] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:49:06.998651 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed853cb-e3a4-44f1-84b3-e8fdc5ef4345 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:07.000318 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed853cb-e3a4-44f1-84b3-e8fdc5ef4345 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:07.000714 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed853cb-e3a4-44f1-84b3-e8fdc5ef4345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:07.020152 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-aed853cb-e3a4-44f1-84b3-e8fdc5ef4345 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:49:07.021512 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-aed853cb-e3a4-44f1-84b3-e8fdc5ef4345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:07.030399 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 682/1381] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:49:07.076328 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf757e-ba23-454c-b83a-3d115db02866 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:49:07.092990 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf757e-ba23-454c-b83a-3d115db02866 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:49:07.099381 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c8550-963e-47db-a8a3-740169121bdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:49:07.100188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c8550-963e-47db-a8a3-740169121bdf service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:07.100581 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c8550-963e-47db-a8a3-740169121bdf service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:07.100988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c8550-963e-47db-a8a3-740169121bdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:07.110354 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c8550-963e-47db-a8a3-740169121bdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:49:07.112144 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c8550-963e-47db-a8a3-740169121bdf service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:49:07.122894 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 700/1382] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:49:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:49:09.303239 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e8ad3-90fd-47d0-bb25-f5a46469c032 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:09.303766 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e8ad3-90fd-47d0-bb25-f5a46469c032 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:09.303766 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e8ad3-90fd-47d0-bb25-f5a46469c032 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:09.305921 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 683/1383] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:49:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:49:09.310958 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be8bb2-4969-493c-89a2-8a8fbdfb6c11 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:09.311435 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be8bb2-4969-493c-89a2-8a8fbdfb6c11 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:09.311528 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be8bb2-4969-493c-89a2-8a8fbdfb6c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:09.330023 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-13be8bb2-4969-493c-89a2-8a8fbdfb6c11 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:49:09.331202 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-13be8bb2-4969-493c-89a2-8a8fbdfb6c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:09.339432 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 701/1384] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:49:09.380974 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e8ad3-90fd-47d0-bb25-f5a46469c032 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:49:09.396161 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e8ad3-90fd-47d0-bb25-f5a46469c032 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:49:09.402111 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8722931-c952-4a4b-a99a-b260d2fc22e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:49:09.402744 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8722931-c952-4a4b-a99a-b260d2fc22e3 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:09.403027 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8722931-c952-4a4b-a99a-b260d2fc22e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:09.403285 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8722931-c952-4a4b-a99a-b260d2fc22e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:09.412192 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8722931-c952-4a4b-a99a-b260d2fc22e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:49:09.414138 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8722931-c952-4a4b-a99a-b260d2fc22e3 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:49:09.424722 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 684/1385] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:49:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:49:11.632353 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1de2d0-cf62-4612-abea-5f08efff4267 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:11.632957 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1de2d0-cf62-4612-abea-5f08efff4267 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:11.633104 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1de2d0-cf62-4612-abea-5f08efff4267 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:11.635134 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 702/1386] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:49:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:49:11.641011 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cb606-4d0e-4019-a5b5-135fc851a6e1 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:11.641539 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cb606-4d0e-4019-a5b5-135fc851a6e1 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:11.641653 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cb606-4d0e-4019-a5b5-135fc851a6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:11.661659 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-588cb606-4d0e-4019-a5b5-135fc851a6e1 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:49:11.663033 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-588cb606-4d0e-4019-a5b5-135fc851a6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:11.672906 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 685/1387] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:49:11.724545 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1de2d0-cf62-4612-abea-5f08efff4267 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:49:11.744800 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1de2d0-cf62-4612-abea-5f08efff4267 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:49:11.751455 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaacf97-ff3a-48c1-affa-d3a927842cef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:49:11.752326 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaacf97-ff3a-48c1-affa-d3a927842cef service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:11.752666 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaacf97-ff3a-48c1-affa-d3a927842cef service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:11.752963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaacf97-ff3a-48c1-affa-d3a927842cef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:11.762772 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaacf97-ff3a-48c1-affa-d3a927842cef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:49:11.764644 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaacf97-ff3a-48c1-affa-d3a927842cef service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:49:11.776300 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 703/1388] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:49:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:49:14.514030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e7ef4-03d8-4404-8ddc-d573b155ef85 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:14.514742 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e7ef4-03d8-4404-8ddc-d573b155ef85 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:14.514742 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e7ef4-03d8-4404-8ddc-d573b155ef85 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:14.516192 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 686/1389] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:49:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:49:14.522221 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f1e1f-bccd-4ce3-8bc2-d9bdab940f07 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:14.522707 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f1e1f-bccd-4ce3-8bc2-d9bdab940f07 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:14.522802 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f1e1f-bccd-4ce3-8bc2-d9bdab940f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:14.544891 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-c59f1e1f-bccd-4ce3-8bc2-d9bdab940f07 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:49:14.546241 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c59f1e1f-bccd-4ce3-8bc2-d9bdab940f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:14.556541 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 704/1390] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:49:14.603573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e7ef4-03d8-4404-8ddc-d573b155ef85 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:49:14.619627 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e7ef4-03d8-4404-8ddc-d573b155ef85 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:49:14.625615 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ad5c3-41dd-4720-93c9-9d3818900475 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:49:14.626333 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ad5c3-41dd-4720-93c9-9d3818900475 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:14.626632 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ad5c3-41dd-4720-93c9-9d3818900475 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:14.626924 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ad5c3-41dd-4720-93c9-9d3818900475 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:14.637143 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ad5c3-41dd-4720-93c9-9d3818900475 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:49:14.638901 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ad5c3-41dd-4720-93c9-9d3818900475 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:49:14.649470 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 687/1391] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:49:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:49:16.833060 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53430199-bc11-414a-81d7-555ae419be26 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:16.833623 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53430199-bc11-414a-81d7-555ae419be26 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:16.833623 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53430199-bc11-414a-81d7-555ae419be26 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:16.834875 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 705/1392] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:49:16.840876 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b3d88-097d-4e6d-9140-6da497ff0ca9 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:16.841323 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b3d88-097d-4e6d-9140-6da497ff0ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:16.841439 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b3d88-097d-4e6d-9140-6da497ff0ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:16.863442 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-549b3d88-097d-4e6d-9140-6da497ff0ca9 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:49:16.864693 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-549b3d88-097d-4e6d-9140-6da497ff0ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:16.873345 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 688/1393] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:49:16.917894 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53430199-bc11-414a-81d7-555ae419be26 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:49:16.933792 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53430199-bc11-414a-81d7-555ae419be26 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:49:16.940340 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d98a9-d7f8-4825-89c0-f0b5ea1288ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:49:16.941002 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d98a9-d7f8-4825-89c0-f0b5ea1288ae service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:16.941276 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d98a9-d7f8-4825-89c0-f0b5ea1288ae service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:16.941552 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d98a9-d7f8-4825-89c0-f0b5ea1288ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:16.950316 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d98a9-d7f8-4825-89c0-f0b5ea1288ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:49:16.951949 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d98a9-d7f8-4825-89c0-f0b5ea1288ae service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:49:16.961532 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 706/1394] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:49:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:49:18.494416 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e10c5-c194-4fb6-800d-fb8841d32ab9 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:18.495003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e10c5-c194-4fb6-800d-fb8841d32ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:18.495003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e10c5-c194-4fb6-800d-fb8841d32ab9 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:18.496446 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 689/1395] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:49:18.501947 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9b74a-c0b5-4671-b053-c0f82b98f81f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:18.502406 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9b74a-c0b5-4671-b053-c0f82b98f81f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:18.502486 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9b74a-c0b5-4671-b053-c0f82b98f81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:18.521941 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-60e9b74a-c0b5-4671-b053-c0f82b98f81f None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:49:18.523141 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-60e9b74a-c0b5-4671-b053-c0f82b98f81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:18.531797 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 707/1396] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:49:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:49:18.588024 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58618542-9b82-435c-8441-c404fb6afac3 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:18.588316 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58618542-9b82-435c-8441-c404fb6afac3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:18.588597 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58618542-9b82-435c-8441-c404fb6afac3 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:18.589993 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 690/1397] 10.222.0.85 () {54 vars in 962 bytes} [Thu Jun 16 14:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:49:18.595343 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763e928-3dfa-4a8d-8acd-1e5a0fdf7caa None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:18.595718 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763e928-3dfa-4a8d-8acd-1e5a0fdf7caa None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:18.596080 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763e928-3dfa-4a8d-8acd-1e5a0fdf7caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:18.647227 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d763e928-3dfa-4a8d-8acd-1e5a0fdf7caa None None] MFA Rules not processed for user `5819a7d47f644bc18e6d07a125826d76`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:49:18.648469 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d763e928-3dfa-4a8d-8acd-1e5a0fdf7caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:18.711213 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 708/1398] 10.222.0.85 () {58 vars in 1059 bytes} [Thu Jun 16 14:49:18 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:49:18.719162 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58618542-9b82-435c-8441-c404fb6afac3 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:49:18.730960 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58618542-9b82-435c-8441-c404fb6afac3 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:49:18.734773 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6550b54-c4ec-4a3b-a768-c52b7bd3f682 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819a7d47f644bc18e6d07a125826d76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:49:18.735423 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6550b54-c4ec-4a3b-a768-c52b7bd3f682 service glance] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:18.735707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6550b54-c4ec-4a3b-a768-c52b7bd3f682 service glance] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:18.736022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6550b54-c4ec-4a3b-a768-c52b7bd3f682 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:18.746399 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6550b54-c4ec-4a3b-a768-c52b7bd3f682 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:49:18.747783 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6550b54-c4ec-4a3b-a768-c52b7bd3f682 service glance] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:49:18.757956 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 691/1399] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:49:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:49:19.150419 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77329b-31dc-458e-8d9b-c7f43cc22bd1 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:19.150757 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77329b-31dc-458e-8d9b-c7f43cc22bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:19.151045 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77329b-31dc-458e-8d9b-c7f43cc22bd1 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:19.152514 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 709/1400] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:49:19.158125 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51313cc-13cc-4858-97fa-4baa16283264 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:19.158416 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51313cc-13cc-4858-97fa-4baa16283264 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:19.158695 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51313cc-13cc-4858-97fa-4baa16283264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:19.178707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e51313cc-13cc-4858-97fa-4baa16283264 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:49:19.179997 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e51313cc-13cc-4858-97fa-4baa16283264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:19.188354 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 692/1401] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:49:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:49:19.234610 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77329b-31dc-458e-8d9b-c7f43cc22bd1 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:49:19.250953 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77329b-31dc-458e-8d9b-c7f43cc22bd1 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:49:19.256971 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a5c7d-24f7-4da9-9ae5-ec577d7a1063 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:49:19.257655 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a5c7d-24f7-4da9-9ae5-ec577d7a1063 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:19.257935 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a5c7d-24f7-4da9-9ae5-ec577d7a1063 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:19.258183 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a5c7d-24f7-4da9-9ae5-ec577d7a1063 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:19.282677 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a5c7d-24f7-4da9-9ae5-ec577d7a1063 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:49:19.282677 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a5c7d-24f7-4da9-9ae5-ec577d7a1063 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:49:19.294722 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 710/1402] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:49:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:49:19.517765 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a3106-cadb-47c4-bc6d-99122a919f4b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:19.518331 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a3106-cadb-47c4-bc6d-99122a919f4b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:19.518331 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a3106-cadb-47c4-bc6d-99122a919f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:19.571073 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f85a3106-cadb-47c4-bc6d-99122a919f4b None None] MFA Rules not processed for user `db4d36e6837d4b2fa4b7ee5c7243b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:49:19.572429 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f85a3106-cadb-47c4-bc6d-99122a919f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:19.607055 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:49:19.642182 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 693/1403] 10.222.0.85 () {58 vars in 1009 bytes} [Thu Jun 16 14:49:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:49:19.683178 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162d9ba-1139-490f-ae6a-b4bdbf364634 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:19.683747 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162d9ba-1139-490f-ae6a-b4bdbf364634 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:19.683747 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162d9ba-1139-490f-ae6a-b4bdbf364634 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:19.685152 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 711/1404] 10.222.0.85 () {54 vars in 942 bytes} [Thu Jun 16 14:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:49:19.691581 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51568d2-6434-4b9e-a6d7-91882ffed101 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:19.691919 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51568d2-6434-4b9e-a6d7-91882ffed101 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:19.692203 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51568d2-6434-4b9e-a6d7-91882ffed101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:19.742259 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b51568d2-6434-4b9e-a6d7-91882ffed101 None None] MFA Rules not processed for user `bf9c39de29324b0ca6329c9a171367c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:49:19.744003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b51568d2-6434-4b9e-a6d7-91882ffed101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:19.818242 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 694/1405] 10.222.0.85 () {58 vars in 1039 bytes} [Thu Jun 16 14:49:19 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:49:19.828336 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162d9ba-1139-490f-ae6a-b4bdbf364634 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:49:19.837451 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:49:19.844970 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162d9ba-1139-490f-ae6a-b4bdbf364634 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:49:19.850211 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b507150-a917-405d-801b-7137392d4564 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf9c39de29324b0ca6329c9a171367c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:49:19.850855 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b507150-a917-405d-801b-7137392d4564 service swift] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:19.851139 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b507150-a917-405d-801b-7137392d4564 service swift] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:19.851413 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b507150-a917-405d-801b-7137392d4564 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:19.860092 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b507150-a917-405d-801b-7137392d4564 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:49:19.861694 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b507150-a917-405d-801b-7137392d4564 service swift] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:49:19.869941 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 712/1406] 10.222.0.85 () {60 vars in 1384 bytes} [Thu Jun 16 14:49:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 14:49:21.453025 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c28f58-0199-45b4-a8a5-546a11543cbd None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:21.454036 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c28f58-0199-45b4-a8a5-546a11543cbd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:21.454528 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c28f58-0199-45b4-a8a5-546a11543cbd None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:21.456200 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 695/1407] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:49:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:49:21.462165 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bec52-82a0-4141-b3ba-b6038ca063c3 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:21.463067 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bec52-82a0-4141-b3ba-b6038ca063c3 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:21.463544 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bec52-82a0-4141-b3ba-b6038ca063c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:21.496121 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-9e6bec52-82a0-4141-b3ba-b6038ca063c3 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:49:21.497682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9e6bec52-82a0-4141-b3ba-b6038ca063c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:21.507912 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 713/1408] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:49:21.551638 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c28f58-0199-45b4-a8a5-546a11543cbd None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:49:21.574534 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c28f58-0199-45b4-a8a5-546a11543cbd None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:49:21.581094 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b173d6-da82-4e73-a1b3-128a4caa2120 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:49:21.581851 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b173d6-da82-4e73-a1b3-128a4caa2120 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:21.582211 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b173d6-da82-4e73-a1b3-128a4caa2120 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:21.582551 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b173d6-da82-4e73-a1b3-128a4caa2120 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:21.593095 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b173d6-da82-4e73-a1b3-128a4caa2120 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:49:21.594827 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b173d6-da82-4e73-a1b3-128a4caa2120 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:49:21.605240 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 696/1409] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:49:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:49:31.489308 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=8 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:49:31.601063 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=62 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:49:42.377357 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e7d43-0527-43b7-a150-b6d12209c517 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:42.377933 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e7d43-0527-43b7-a150-b6d12209c517 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:42.377933 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e7d43-0527-43b7-a150-b6d12209c517 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:42.380123 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 714/1410] 10.222.0.85 () {54 vars in 918 bytes} [Thu Jun 16 14:49:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:49:42.387270 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664c150-cc03-4243-ac19-e27f9e027854 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:42.387769 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664c150-cc03-4243-ac19-e27f9e027854 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:42.387769 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664c150-cc03-4243-ac19-e27f9e027854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:42.407768 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3664c150-cc03-4243-ac19-e27f9e027854 None None] MFA Rules not processed for user `819ad532defb4adaa2f4fd06b47630d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:49:42.408993 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3664c150-cc03-4243-ac19-e27f9e027854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:42.419398 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 697/1411] 10.222.0.85 () {58 vars in 1015 bytes} [Thu Jun 16 14:49:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:49:42.434207 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268162b-8b80-44fe-8e9a-e6582c56e69f None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:42.434496 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268162b-8b80-44fe-8e9a-e6582c56e69f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:42.434768 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268162b-8b80-44fe-8e9a-e6582c56e69f None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:42.436221 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 715/1412] 10.222.0.85 () {54 vars in 918 bytes} [Thu Jun 16 14:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:49:42.441846 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079d96b-2e53-4b9b-a4fe-d72c3a67ce0d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:42.442207 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079d96b-2e53-4b9b-a4fe-d72c3a67ce0d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:42.442488 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079d96b-2e53-4b9b-a4fe-d72c3a67ce0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:42.463641 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d079d96b-2e53-4b9b-a4fe-d72c3a67ce0d None None] MFA Rules not processed for user `c74e4d1bdaa64ed280cc5f4c8e79b842`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:49:42.464868 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d079d96b-2e53-4b9b-a4fe-d72c3a67ce0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:42.476189 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 698/1413] 10.222.0.85 () {58 vars in 1015 bytes} [Thu Jun 16 14:49:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:49:45.085096 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe3b2a-7d6b-4807-a050-33d0d2f127b4 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:45.085857 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe3b2a-7d6b-4807-a050-33d0d2f127b4 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:45.086154 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe3b2a-7d6b-4807-a050-33d0d2f127b4 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:45.088376 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 716/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:49:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:49:45.094219 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b6ac9-1c4f-4313-85cb-ce88eb97884d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:45.094869 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b6ac9-1c4f-4313-85cb-ce88eb97884d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:45.094869 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b6ac9-1c4f-4313-85cb-ce88eb97884d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:45.118005 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a17b6ac9-1c4f-4313-85cb-ce88eb97884d None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:49:45.119776 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a17b6ac9-1c4f-4313-85cb-ce88eb97884d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:45.127834 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 699/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:49:45.177836 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe3b2a-7d6b-4807-a050-33d0d2f127b4 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:49:45.196953 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe3b2a-7d6b-4807-a050-33d0d2f127b4 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:49:45.207359 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ae4f5-5125-4e75-a14f-6a530ed5059a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:49:45.208066 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ae4f5-5125-4e75-a14f-6a530ed5059a service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:45.208413 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ae4f5-5125-4e75-a14f-6a530ed5059a service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:45.208771 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ae4f5-5125-4e75-a14f-6a530ed5059a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:45.220024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ae4f5-5125-4e75-a14f-6a530ed5059a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:49:45.221625 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ae4f5-5125-4e75-a14f-6a530ed5059a service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:49:45.231626 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 717/1416] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:49:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:49:46.217197 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c1d25-fcfe-434a-829e-002a963137ce None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:46.217690 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c1d25-fcfe-434a-829e-002a963137ce None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:46.217783 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c1d25-fcfe-434a-829e-002a963137ce None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:46.219906 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 700/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 14:49:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:49:46.228113 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12a42b-391e-4d52-a034-6506b79bee78 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:46.228757 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12a42b-391e-4d52-a034-6506b79bee78 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:46.229193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12a42b-391e-4d52-a034-6506b79bee78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:46.248571 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-ab12a42b-391e-4d52-a034-6506b79bee78 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:49:46.249825 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ab12a42b-391e-4d52-a034-6506b79bee78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:46.259406 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 718/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 14:49:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:49:46.416424 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c1d25-fcfe-434a-829e-002a963137ce None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:49:46.441214 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c1d25-fcfe-434a-829e-002a963137ce None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:49:46.449149 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f834f2-a11e-40c3-bd17-d7d54b69c6e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:49:46.449792 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f834f2-a11e-40c3-bd17-d7d54b69c6e0 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:46.450077 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f834f2-a11e-40c3-bd17-d7d54b69c6e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:46.450354 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f834f2-a11e-40c3-bd17-d7d54b69c6e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:46.459297 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f834f2-a11e-40c3-bd17-d7d54b69c6e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:49:46.460925 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f834f2-a11e-40c3-bd17-d7d54b69c6e0 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:49:46.471354 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 701/1419] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:49:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:49:47.395843 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d30d3d-9b2e-42cf-8e2a-fcee8b5bdb93 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:47.396749 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d30d3d-9b2e-42cf-8e2a-fcee8b5bdb93 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:47.396749 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d30d3d-9b2e-42cf-8e2a-fcee8b5bdb93 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:47.398768 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 719/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 14:49:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:49:47.405601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf42fd-e1a5-452b-a328-c5c020b51ad4 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:47.406028 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf42fd-e1a5-452b-a328-c5c020b51ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:47.406160 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf42fd-e1a5-452b-a328-c5c020b51ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:47.430249 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-9adf42fd-e1a5-452b-a328-c5c020b51ad4 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:49:47.431563 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9adf42fd-e1a5-452b-a328-c5c020b51ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:47.440256 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 702/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 14:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:49:47.598016 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d30d3d-9b2e-42cf-8e2a-fcee8b5bdb93 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:49:47.614820 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d30d3d-9b2e-42cf-8e2a-fcee8b5bdb93 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:49:47.620616 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa223c1-92bb-4d95-a44a-3f138793b840 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:49:47.621242 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa223c1-92bb-4d95-a44a-3f138793b840 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:47.621551 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa223c1-92bb-4d95-a44a-3f138793b840 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:47.621823 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa223c1-92bb-4d95-a44a-3f138793b840 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:47.630329 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa223c1-92bb-4d95-a44a-3f138793b840 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:49:47.631990 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa223c1-92bb-4d95-a44a-3f138793b840 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:49:47.641864 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 720/1422] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:49:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:49:48.550240 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4875d-4ace-4263-a25e-f4a4095190b4 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:48.550833 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4875d-4ace-4263-a25e-f4a4095190b4 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:48.550833 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4875d-4ace-4263-a25e-f4a4095190b4 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:48.552911 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 703/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 14:49:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:49:48.560357 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832446ff-7c1b-4255-9ea0-c8fad3d4cd66 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:48.560838 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832446ff-7c1b-4255-9ea0-c8fad3d4cd66 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:48.560958 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832446ff-7c1b-4255-9ea0-c8fad3d4cd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:48.583271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-832446ff-7c1b-4255-9ea0-c8fad3d4cd66 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:49:48.584503 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-832446ff-7c1b-4255-9ea0-c8fad3d4cd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:48.593424 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 721/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 14:49:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:49:48.743496 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4875d-4ace-4263-a25e-f4a4095190b4 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:49:48.760536 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4875d-4ace-4263-a25e-f4a4095190b4 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:49:48.768041 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46430e48-c556-4c44-a478-1e8930b61709 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:49:48.769015 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46430e48-c556-4c44-a478-1e8930b61709 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:48.769406 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46430e48-c556-4c44-a478-1e8930b61709 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:48.769784 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46430e48-c556-4c44-a478-1e8930b61709 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:48.781047 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46430e48-c556-4c44-a478-1e8930b61709 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:49:48.782648 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46430e48-c556-4c44-a478-1e8930b61709 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:49:48.792501 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 704/1425] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:49:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:49:49.714251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8ba61-37ee-4bcb-b27b-408201933978 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:49.715186 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8ba61-37ee-4bcb-b27b-408201933978 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:49.715186 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8ba61-37ee-4bcb-b27b-408201933978 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:49.717255 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 722/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 14:49:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:49:49.725495 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ead82-afd8-4cf5-b2c2-355cb202aefc None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:49.725945 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ead82-afd8-4cf5-b2c2-355cb202aefc None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:49.726053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ead82-afd8-4cf5-b2c2-355cb202aefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:49.752629 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-000ead82-afd8-4cf5-b2c2-355cb202aefc None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:49:49.753845 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-000ead82-afd8-4cf5-b2c2-355cb202aefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:49.763187 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 705/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 14:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:49:49.919449 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8ba61-37ee-4bcb-b27b-408201933978 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:49:49.938843 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8ba61-37ee-4bcb-b27b-408201933978 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:49:49.949371 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5207d9-c25b-4cc3-9a86-3f1ac756adbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:49:49.950011 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5207d9-c25b-4cc3-9a86-3f1ac756adbe service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:49.950285 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5207d9-c25b-4cc3-9a86-3f1ac756adbe service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:49.950575 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5207d9-c25b-4cc3-9a86-3f1ac756adbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:49.960187 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5207d9-c25b-4cc3-9a86-3f1ac756adbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:49:49.961770 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5207d9-c25b-4cc3-9a86-3f1ac756adbe service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:49:49.972486 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 723/1428] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:49:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:49:50.833218 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c6d29-8df9-4ca3-9f91-3976cc2f71cc None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:50.833820 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c6d29-8df9-4ca3-9f91-3976cc2f71cc None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:50.833820 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c6d29-8df9-4ca3-9f91-3976cc2f71cc None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:50.835734 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 706/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 14:49:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:49:50.844049 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369279c-f092-41bd-a692-d8fa40ee1db2 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:50.844534 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369279c-f092-41bd-a692-d8fa40ee1db2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:50.844766 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369279c-f092-41bd-a692-d8fa40ee1db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:50.866529 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d369279c-f092-41bd-a692-d8fa40ee1db2 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:49:50.867744 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d369279c-f092-41bd-a692-d8fa40ee1db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:50.876909 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 724/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 14:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:49:51.027936 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c6d29-8df9-4ca3-9f91-3976cc2f71cc None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:49:51.045801 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c6d29-8df9-4ca3-9f91-3976cc2f71cc None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:49:51.052595 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57934d-ed18-45f6-a280-913a48c4b956 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:49:51.053236 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57934d-ed18-45f6-a280-913a48c4b956 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:51.053519 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57934d-ed18-45f6-a280-913a48c4b956 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:51.053796 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57934d-ed18-45f6-a280-913a48c4b956 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:51.062527 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57934d-ed18-45f6-a280-913a48c4b956 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:49:51.064093 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57934d-ed18-45f6-a280-913a48c4b956 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:49:51.074846 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 707/1431] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:49:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:49:51.935999 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db615cba-4d23-421d-b58e-c25993233f5e None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:51.936542 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db615cba-4d23-421d-b58e-c25993233f5e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:51.936542 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db615cba-4d23-421d-b58e-c25993233f5e None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:51.937856 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 725/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 14:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:49:51.944051 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea702da-056c-4201-9649-1ba329d121ef None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:51.944836 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea702da-056c-4201-9649-1ba329d121ef None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:51.944993 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea702da-056c-4201-9649-1ba329d121ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:51.970953 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5ea702da-056c-4201-9649-1ba329d121ef None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:49:51.972320 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5ea702da-056c-4201-9649-1ba329d121ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:51.981432 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 708/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 14:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:49:52.136737 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db615cba-4d23-421d-b58e-c25993233f5e None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:49:52.161484 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db615cba-4d23-421d-b58e-c25993233f5e None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:49:52.169655 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1e151-d833-47a5-9475-8843da9fc791 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:49:52.170295 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1e151-d833-47a5-9475-8843da9fc791 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:52.170576 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1e151-d833-47a5-9475-8843da9fc791 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:52.170813 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1e151-d833-47a5-9475-8843da9fc791 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:52.179631 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1e151-d833-47a5-9475-8843da9fc791 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:49:52.181260 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1e151-d833-47a5-9475-8843da9fc791 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:49:52.190948 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 726/1434] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:49:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:49:53.040480 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cd2ef-413a-4425-b3ff-a209c1c74a7b None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:53.041074 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cd2ef-413a-4425-b3ff-a209c1c74a7b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:53.041074 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cd2ef-413a-4425-b3ff-a209c1c74a7b None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:53.042486 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 709/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 14:49:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:49:53.049686 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f97167-2097-432f-a157-da19cf2d69ec None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:53.050162 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f97167-2097-432f-a157-da19cf2d69ec None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:53.050260 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f97167-2097-432f-a157-da19cf2d69ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:53.075003 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-18f97167-2097-432f-a157-da19cf2d69ec None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:49:53.076271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-18f97167-2097-432f-a157-da19cf2d69ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:53.085209 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 727/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 14:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:49:53.253075 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cd2ef-413a-4425-b3ff-a209c1c74a7b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:49:53.269288 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cd2ef-413a-4425-b3ff-a209c1c74a7b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:49:53.275227 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66782b5e-ca41-4ddc-8d7d-9a8742d699b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:49:53.276071 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66782b5e-ca41-4ddc-8d7d-9a8742d699b2 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:53.276474 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66782b5e-ca41-4ddc-8d7d-9a8742d699b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:53.276858 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66782b5e-ca41-4ddc-8d7d-9a8742d699b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:53.285571 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66782b5e-ca41-4ddc-8d7d-9a8742d699b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:49:53.287173 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66782b5e-ca41-4ddc-8d7d-9a8742d699b2 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:49:53.297518 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 710/1437] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:49:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:49:54.145068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43ca6d-072a-47e1-bcbf-cf743fd36730 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:54.146144 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43ca6d-072a-47e1-bcbf-cf743fd36730 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:54.146144 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43ca6d-072a-47e1-bcbf-cf743fd36730 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:54.148113 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 728/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 14:49:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:49:54.155350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f14a0-fd83-4beb-a86f-f04955259024 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:54.156128 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f14a0-fd83-4beb-a86f-f04955259024 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:54.156366 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f14a0-fd83-4beb-a86f-f04955259024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:54.181393 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-0f6f14a0-fd83-4beb-a86f-f04955259024 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:49:54.182581 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0f6f14a0-fd83-4beb-a86f-f04955259024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:54.193837 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 711/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 14:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:49:54.345433 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43ca6d-072a-47e1-bcbf-cf743fd36730 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:49:54.366845 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43ca6d-072a-47e1-bcbf-cf743fd36730 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:49:54.376878 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff308864-9fcf-4491-9857-4096a0ac8484 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:49:54.377804 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff308864-9fcf-4491-9857-4096a0ac8484 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:54.378193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff308864-9fcf-4491-9857-4096a0ac8484 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:54.378515 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff308864-9fcf-4491-9857-4096a0ac8484 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:54.390391 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff308864-9fcf-4491-9857-4096a0ac8484 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:49:54.392853 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff308864-9fcf-4491-9857-4096a0ac8484 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:49:54.405936 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 729/1440] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:49:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:49:56.428869 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c566d-cb10-4740-8198-e5f00a7a2041 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:56.429791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c566d-cb10-4740-8198-e5f00a7a2041 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:56.429791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c566d-cb10-4740-8198-e5f00a7a2041 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:56.432043 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 712/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:49:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:49:56.438597 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5918b-85da-48b6-8fc7-67ec95d1c5c4 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:56.439283 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5918b-85da-48b6-8fc7-67ec95d1c5c4 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:56.439487 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5918b-85da-48b6-8fc7-67ec95d1c5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:56.461811 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-9bf5918b-85da-48b6-8fc7-67ec95d1c5c4 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:49:56.463032 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9bf5918b-85da-48b6-8fc7-67ec95d1c5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:56.472924 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 730/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:49:56.515409 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c566d-cb10-4740-8198-e5f00a7a2041 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:49:56.528221 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c566d-cb10-4740-8198-e5f00a7a2041 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:49:56.532899 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df12c4-826d-4599-aa2f-2e5d29dd1527 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:49:56.533548 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df12c4-826d-4599-aa2f-2e5d29dd1527 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:56.533828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df12c4-826d-4599-aa2f-2e5d29dd1527 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:56.534075 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df12c4-826d-4599-aa2f-2e5d29dd1527 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:56.544549 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df12c4-826d-4599-aa2f-2e5d29dd1527 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:49:56.546007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df12c4-826d-4599-aa2f-2e5d29dd1527 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:49:56.555771 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 713/1443] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:49:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:49:58.888272 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c44965-103b-4ebc-a096-1e00f339775a None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:58.888883 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c44965-103b-4ebc-a096-1e00f339775a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:58.888883 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c44965-103b-4ebc-a096-1e00f339775a None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:58.890846 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 731/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:49:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:49:58.898781 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ecfb6-181f-4650-83ed-16b8e2d36478 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:58.899277 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ecfb6-181f-4650-83ed-16b8e2d36478 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:58.899277 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ecfb6-181f-4650-83ed-16b8e2d36478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:58.919283 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c73ecfb6-181f-4650-83ed-16b8e2d36478 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:49:58.920513 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c73ecfb6-181f-4650-83ed-16b8e2d36478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:49:58.929350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 714/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:49:58.972163 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c44965-103b-4ebc-a096-1e00f339775a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:49:58.988868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c44965-103b-4ebc-a096-1e00f339775a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:49:58.994823 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21838e2f-5dfd-443f-a5ab-6bf230fecb00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:49:58.995687 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21838e2f-5dfd-443f-a5ab-6bf230fecb00 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:49:58.996065 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21838e2f-5dfd-443f-a5ab-6bf230fecb00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:49:58.996310 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21838e2f-5dfd-443f-a5ab-6bf230fecb00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:49:59.005542 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21838e2f-5dfd-443f-a5ab-6bf230fecb00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:49:59.006969 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21838e2f-5dfd-443f-a5ab-6bf230fecb00 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:49:59.017435 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 732/1446] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:49:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:50:01.468406 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e247e-4c15-4f33-9d64-fb2883ccf8c0 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:01.469044 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e247e-4c15-4f33-9d64-fb2883ccf8c0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:01.469044 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e247e-4c15-4f33-9d64-fb2883ccf8c0 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:01.470379 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 715/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:50:01.476902 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0628f8-7f00-418c-a256-24bb06a32081 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:01.477626 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0628f8-7f00-418c-a256-24bb06a32081 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:01.477833 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0628f8-7f00-418c-a256-24bb06a32081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:01.497327 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-7f0628f8-7f00-418c-a256-24bb06a32081 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:50:01.498548 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7f0628f8-7f00-418c-a256-24bb06a32081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:50:01.507930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 733/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:50:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:50:01.548197 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e247e-4c15-4f33-9d64-fb2883ccf8c0 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:50:01.563346 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e247e-4c15-4f33-9d64-fb2883ccf8c0 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:50:01.569944 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b28e8-f6d7-4c74-b300-105614544d4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:50:01.570915 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b28e8-f6d7-4c74-b300-105614544d4b service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:01.571311 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b28e8-f6d7-4c74-b300-105614544d4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:01.571759 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b28e8-f6d7-4c74-b300-105614544d4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:01.583143 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b28e8-f6d7-4c74-b300-105614544d4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:50:01.584653 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b28e8-f6d7-4c74-b300-105614544d4b service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:50:01.594602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 716/1449] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:50:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:50:03.864313 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331fedcc-6e30-44ee-b25a-e80e137ec7f5 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:03.864856 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331fedcc-6e30-44ee-b25a-e80e137ec7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:03.864856 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331fedcc-6e30-44ee-b25a-e80e137ec7f5 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:03.866079 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 734/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:50:03.872523 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0babb9b-a3a5-41cd-b303-63e117a2c1bd None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:03.873249 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0babb9b-a3a5-41cd-b303-63e117a2c1bd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:03.873457 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0babb9b-a3a5-41cd-b303-63e117a2c1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:03.898239 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e0babb9b-a3a5-41cd-b303-63e117a2c1bd None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:50:03.899443 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e0babb9b-a3a5-41cd-b303-63e117a2c1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:50:03.908319 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 717/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:50:03.950861 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331fedcc-6e30-44ee-b25a-e80e137ec7f5 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:50:03.962580 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331fedcc-6e30-44ee-b25a-e80e137ec7f5 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:50:03.967197 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608ac2e-a8e1-4e0c-8dfc-80e1c925abea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:50:03.967834 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608ac2e-a8e1-4e0c-8dfc-80e1c925abea service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:03.968154 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608ac2e-a8e1-4e0c-8dfc-80e1c925abea service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:03.968427 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608ac2e-a8e1-4e0c-8dfc-80e1c925abea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:03.978229 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608ac2e-a8e1-4e0c-8dfc-80e1c925abea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:50:03.979675 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608ac2e-a8e1-4e0c-8dfc-80e1c925abea service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:50:03.989895 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 735/1452] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:50:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:50:06.251732 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf09943-948d-4366-90c1-b43a15df97c9 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:06.252340 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf09943-948d-4366-90c1-b43a15df97c9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:06.252340 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf09943-948d-4366-90c1-b43a15df97c9 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:06.253731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 718/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:50:06.259091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa38cb7-b1c6-41d9-9d38-7d497142055b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:06.259588 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa38cb7-b1c6-41d9-9d38-7d497142055b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:06.259588 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa38cb7-b1c6-41d9-9d38-7d497142055b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:06.278930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-2fa38cb7-b1c6-41d9-9d38-7d497142055b None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:50:06.280166 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2fa38cb7-b1c6-41d9-9d38-7d497142055b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:50:06.290005 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 736/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:50:06.329920 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf09943-948d-4366-90c1-b43a15df97c9 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:50:06.350810 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf09943-948d-4366-90c1-b43a15df97c9 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:50:06.358215 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a7a4a-2add-44b1-831d-e2c74eaa0818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:50:06.359146 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a7a4a-2add-44b1-831d-e2c74eaa0818 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:06.359575 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a7a4a-2add-44b1-831d-e2c74eaa0818 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:06.359957 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a7a4a-2add-44b1-831d-e2c74eaa0818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:06.374124 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a7a4a-2add-44b1-831d-e2c74eaa0818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:50:06.375580 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a7a4a-2add-44b1-831d-e2c74eaa0818 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:50:06.385686 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 719/1455] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:50:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:50:08.594770 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d75a2-cc91-45f8-85ae-8a1b86d99873 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:08.595346 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d75a2-cc91-45f8-85ae-8a1b86d99873 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:08.595346 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d75a2-cc91-45f8-85ae-8a1b86d99873 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:08.597465 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 737/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:50:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:50:08.605935 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a8ee5-c38b-4f10-afdb-bdf45a69e90f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:08.606715 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a8ee5-c38b-4f10-afdb-bdf45a69e90f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:08.606901 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a8ee5-c38b-4f10-afdb-bdf45a69e90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:08.627540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-576a8ee5-c38b-4f10-afdb-bdf45a69e90f None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:50:08.628784 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-576a8ee5-c38b-4f10-afdb-bdf45a69e90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:50:08.637374 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 720/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:50:08.678490 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d75a2-cc91-45f8-85ae-8a1b86d99873 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:50:08.690828 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d75a2-cc91-45f8-85ae-8a1b86d99873 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:50:08.695223 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd3ee6-54bf-419c-9560-a944b57ba8a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:50:08.695898 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd3ee6-54bf-419c-9560-a944b57ba8a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:08.696181 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd3ee6-54bf-419c-9560-a944b57ba8a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:08.696460 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd3ee6-54bf-419c-9560-a944b57ba8a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:08.706879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd3ee6-54bf-419c-9560-a944b57ba8a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:50:08.708363 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd3ee6-54bf-419c-9560-a944b57ba8a8 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:50:08.718559 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 738/1458] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:50:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:50:10.886534 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd60a87-e0d1-4bb5-93a9-28ac5a6cec4d None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:10.887661 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd60a87-e0d1-4bb5-93a9-28ac5a6cec4d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:10.888112 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd60a87-e0d1-4bb5-93a9-28ac5a6cec4d None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:10.890320 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 721/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:50:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:50:10.899349 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c1d0a-4ac6-4427-a672-a2929210c1dc None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:10.899785 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c1d0a-4ac6-4427-a672-a2929210c1dc None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:10.899945 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c1d0a-4ac6-4427-a672-a2929210c1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:10.920783 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-311c1d0a-4ac6-4427-a672-a2929210c1dc None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:50:10.921989 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-311c1d0a-4ac6-4427-a672-a2929210c1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:50:10.931508 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 739/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:50:10.969475 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd60a87-e0d1-4bb5-93a9-28ac5a6cec4d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:50:10.982046 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd60a87-e0d1-4bb5-93a9-28ac5a6cec4d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:50:10.986992 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260c3f7-a300-4e75-8fe4-bea5126bd05d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:50:10.987935 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260c3f7-a300-4e75-8fe4-bea5126bd05d service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:10.988280 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260c3f7-a300-4e75-8fe4-bea5126bd05d service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:10.988596 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260c3f7-a300-4e75-8fe4-bea5126bd05d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:11.002268 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260c3f7-a300-4e75-8fe4-bea5126bd05d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:50:11.003706 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260c3f7-a300-4e75-8fe4-bea5126bd05d service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:50:11.014500 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 722/1461] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:50:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:50:13.203534 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31725f-8944-43f5-96f3-8936738e0f94 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:13.204139 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31725f-8944-43f5-96f3-8936738e0f94 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:13.204139 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31725f-8944-43f5-96f3-8936738e0f94 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:13.205566 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 740/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:50:13.211933 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa13f54-7a88-4af7-a49f-bba7e2987869 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:13.212356 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa13f54-7a88-4af7-a49f-bba7e2987869 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:13.212477 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa13f54-7a88-4af7-a49f-bba7e2987869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:13.219858 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=79 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:50:13.240485 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-cfa13f54-7a88-4af7-a49f-bba7e2987869 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:50:13.242388 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-cfa13f54-7a88-4af7-a49f-bba7e2987869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:50:13.252784 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 723/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:50:13.290433 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31725f-8944-43f5-96f3-8936738e0f94 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:50:13.297629 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=73 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:50:13.305021 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31725f-8944-43f5-96f3-8936738e0f94 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:50:13.309581 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b5cee-1a65-49f3-9cb4-c4c78428a46e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:50:13.310234 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b5cee-1a65-49f3-9cb4-c4c78428a46e service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:13.310515 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b5cee-1a65-49f3-9cb4-c4c78428a46e service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:13.310856 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b5cee-1a65-49f3-9cb4-c4c78428a46e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:13.320010 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b5cee-1a65-49f3-9cb4-c4c78428a46e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:50:13.321443 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b5cee-1a65-49f3-9cb4-c4c78428a46e service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:50:13.331067 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 741/1464] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:50:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:50:15.497850 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb22ca-a4cf-420f-8a27-bf748685115e None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:15.498799 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb22ca-a4cf-420f-8a27-bf748685115e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:15.498799 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb22ca-a4cf-420f-8a27-bf748685115e None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:15.501018 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 724/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:50:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:50:15.507507 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bf4a7-047e-4bc9-8b25-50f52b8bdce6 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:15.507976 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bf4a7-047e-4bc9-8b25-50f52b8bdce6 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:15.508095 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bf4a7-047e-4bc9-8b25-50f52b8bdce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:15.533837 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-912bf4a7-047e-4bc9-8b25-50f52b8bdce6 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:50:15.535176 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-912bf4a7-047e-4bc9-8b25-50f52b8bdce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:50:15.546122 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 742/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:50:15.583624 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb22ca-a4cf-420f-8a27-bf748685115e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:50:15.601727 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb22ca-a4cf-420f-8a27-bf748685115e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:50:15.608161 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ea639-49af-4a27-861b-c2e0b8eaa1b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:50:15.609098 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ea639-49af-4a27-861b-c2e0b8eaa1b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:15.609394 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ea639-49af-4a27-861b-c2e0b8eaa1b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:15.609653 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ea639-49af-4a27-861b-c2e0b8eaa1b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:15.623429 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ea639-49af-4a27-861b-c2e0b8eaa1b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:50:15.624890 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ea639-49af-4a27-861b-c2e0b8eaa1b5 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:50:15.634484 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 725/1467] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:50:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:50:17.790749 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea606d-edb1-497b-a8b6-e208be18bc77 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:17.791344 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea606d-edb1-497b-a8b6-e208be18bc77 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:17.791344 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea606d-edb1-497b-a8b6-e208be18bc77 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:17.792748 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 743/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:50:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:50:17.799612 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2e745-82e1-4683-8a42-16522c1ace89 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:17.800105 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2e745-82e1-4683-8a42-16522c1ace89 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:17.800198 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2e745-82e1-4683-8a42-16522c1ace89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:17.822617 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-62d2e745-82e1-4683-8a42-16522c1ace89 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:50:17.823771 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-62d2e745-82e1-4683-8a42-16522c1ace89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:50:17.833998 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 726/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:50:17.873856 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea606d-edb1-497b-a8b6-e208be18bc77 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:50:17.892368 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea606d-edb1-497b-a8b6-e208be18bc77 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:50:17.899006 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26cf14e-4665-4621-b4bb-ba14eda7ce7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:50:17.899834 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cf14e-4665-4621-b4bb-ba14eda7ce7b service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:17.900276 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cf14e-4665-4621-b4bb-ba14eda7ce7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:17.900706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cf14e-4665-4621-b4bb-ba14eda7ce7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:17.912227 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26cf14e-4665-4621-b4bb-ba14eda7ce7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:50:17.913675 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26cf14e-4665-4621-b4bb-ba14eda7ce7b service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:50:17.924638 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 744/1470] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:50:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:50:27.817219 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=11 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:50:27.919603 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=14 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:50:37.917391 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f4c96-2d27-4f31-b33a-ff66c4bc6704 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:37.917945 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f4c96-2d27-4f31-b33a-ff66c4bc6704 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:37.917945 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f4c96-2d27-4f31-b33a-ff66c4bc6704 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:37.919371 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 727/1471] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:50:37.925957 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6329e1-f897-42b8-a5f4-2b6ed16e8e04 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:37.926718 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6329e1-f897-42b8-a5f4-2b6ed16e8e04 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:37.926867 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6329e1-f897-42b8-a5f4-2b6ed16e8e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:37.949123 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-fa6329e1-f897-42b8-a5f4-2b6ed16e8e04 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:50:37.950531 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-fa6329e1-f897-42b8-a5f4-2b6ed16e8e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:50:37.959859 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 745/1472] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:50:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:50:38.009654 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54d75d-3c32-41d3-bed4-50ace8869b7f None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:38.009940 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54d75d-3c32-41d3-bed4-50ace8869b7f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:38.010223 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54d75d-3c32-41d3-bed4-50ace8869b7f None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:38.011586 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 728/1473] 10.222.0.85 () {54 vars in 962 bytes} [Thu Jun 16 14:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:50:38.016678 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900cb38-7908-478a-ab42-064fcd3ccef1 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:38.016945 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900cb38-7908-478a-ab42-064fcd3ccef1 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:38.017220 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900cb38-7908-478a-ab42-064fcd3ccef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:38.036101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-3900cb38-7908-478a-ab42-064fcd3ccef1 None None] MFA Rules not processed for user `5819a7d47f644bc18e6d07a125826d76`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:50:38.037300 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3900cb38-7908-478a-ab42-064fcd3ccef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:50:38.044932 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 746/1474] 10.222.0.85 () {58 vars in 1059 bytes} [Thu Jun 16 14:50:38 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:50:38.052614 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54d75d-3c32-41d3-bed4-50ace8869b7f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:50:38.065048 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54d75d-3c32-41d3-bed4-50ace8869b7f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:50:38.069202 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ecc1ae-88bc-45a6-a8cd-ba7415893d3f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819a7d47f644bc18e6d07a125826d76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:50:38.069830 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecc1ae-88bc-45a6-a8cd-ba7415893d3f service glance] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:38.070111 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecc1ae-88bc-45a6-a8cd-ba7415893d3f service glance] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:38.070388 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecc1ae-88bc-45a6-a8cd-ba7415893d3f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:38.084475 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ecc1ae-88bc-45a6-a8cd-ba7415893d3f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:50:38.086236 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ecc1ae-88bc-45a6-a8cd-ba7415893d3f service glance] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:50:38.098982 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 729/1475] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:50:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:50:40.502183 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe4f96-02fa-4b0a-8f33-574775400f47 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:40.502804 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe4f96-02fa-4b0a-8f33-574775400f47 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:40.502804 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe4f96-02fa-4b0a-8f33-574775400f47 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:40.504139 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 747/1476] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:50:40.510537 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8ae7b-5278-4a46-8adf-d81c7129b85d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:40.511309 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8ae7b-5278-4a46-8adf-d81c7129b85d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:40.511523 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8ae7b-5278-4a46-8adf-d81c7129b85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:40.531172 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3ff8ae7b-5278-4a46-8adf-d81c7129b85d None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:50:40.532505 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3ff8ae7b-5278-4a46-8adf-d81c7129b85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:50:40.541382 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 730/1477] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:50:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:50:40.565554 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe4f96-02fa-4b0a-8f33-574775400f47 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:50:40.579601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe4f96-02fa-4b0a-8f33-574775400f47 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:50:40.584581 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3875d34-2846-443d-9dd2-c8bf490e84ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:50:40.585241 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3875d34-2846-443d-9dd2-c8bf490e84ac admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:40.585524 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3875d34-2846-443d-9dd2-c8bf490e84ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:40.585801 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3875d34-2846-443d-9dd2-c8bf490e84ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:40.586542 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3875d34-2846-443d-9dd2-c8bf490e84ac admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:50:40.588375 dv-cinder-837165-3-smb devstack@keystone.service[80176]: WARNING py.warnings [None req-f3875d34-2846-443d-9dd2-c8bf490e84ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:50:40.588375 dv-cinder-837165-3-smb devstack@keystone.service[80176]: warnings.warn(msg) Jun 16 14:50:40.588375 dv-cinder-837165-3-smb devstack@keystone.service[80176]: Jun 16 14:50:40.589535 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3875d34-2846-443d-9dd2-c8bf490e84ac admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:50:40.609273 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 748/1478] 10.222.0.85 () {56 vars in 1108 bytes} [Thu Jun 16 14:50:40 2022] GET /identity/v3/projects => generated 2553 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:50:42.772233 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d701f1a-6307-4594-bfd0-e75abb1d7481 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:42.772923 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d701f1a-6307-4594-bfd0-e75abb1d7481 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:42.772923 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d701f1a-6307-4594-bfd0-e75abb1d7481 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:42.775104 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 731/1479] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:50:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:50:42.781655 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259513dd-976a-4fd6-bd40-594c75a4774d None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:42.782129 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259513dd-976a-4fd6-bd40-594c75a4774d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:42.782236 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259513dd-976a-4fd6-bd40-594c75a4774d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:42.807440 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-259513dd-976a-4fd6-bd40-594c75a4774d None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:50:42.808680 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-259513dd-976a-4fd6-bd40-594c75a4774d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:50:42.822871 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 749/1480] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:50:42.880617 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d701f1a-6307-4594-bfd0-e75abb1d7481 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:50:42.896842 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d701f1a-6307-4594-bfd0-e75abb1d7481 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:50:42.903298 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8812d-6e89-4e21-b76d-c1168ced9f2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:50:42.903981 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8812d-6e89-4e21-b76d-c1168ced9f2a service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:42.904269 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8812d-6e89-4e21-b76d-c1168ced9f2a service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:42.904574 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8812d-6e89-4e21-b76d-c1168ced9f2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:42.913314 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8812d-6e89-4e21-b76d-c1168ced9f2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:50:42.914903 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8812d-6e89-4e21-b76d-c1168ced9f2a service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:50:42.925093 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 732/1481] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:50:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:50:45.308503 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25af2c-9734-4f6b-8ee3-29a59faf8e8e None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:45.309080 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25af2c-9734-4f6b-8ee3-29a59faf8e8e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:45.309080 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25af2c-9734-4f6b-8ee3-29a59faf8e8e None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:45.311260 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 750/1482] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:50:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:50:45.319746 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b2cb0-0cde-486c-b16e-66b901f50b14 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:45.320228 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b2cb0-0cde-486c-b16e-66b901f50b14 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:45.320335 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b2cb0-0cde-486c-b16e-66b901f50b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:45.340980 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-395b2cb0-0cde-486c-b16e-66b901f50b14 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:50:45.342128 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-395b2cb0-0cde-486c-b16e-66b901f50b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:50:45.352343 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 733/1483] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:50:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:50:45.398710 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25af2c-9734-4f6b-8ee3-29a59faf8e8e None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:50:45.416341 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25af2c-9734-4f6b-8ee3-29a59faf8e8e None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:50:45.422717 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497ca06-b67b-4bdc-b9b8-7dab8a4597bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:50:45.423606 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497ca06-b67b-4bdc-b9b8-7dab8a4597bd service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:45.423904 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497ca06-b67b-4bdc-b9b8-7dab8a4597bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:45.424330 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497ca06-b67b-4bdc-b9b8-7dab8a4597bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:45.438010 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0497ca06-b67b-4bdc-b9b8-7dab8a4597bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:50:45.439458 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0497ca06-b67b-4bdc-b9b8-7dab8a4597bd service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:50:45.449124 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 751/1484] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:50:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:50:47.638489 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437bad7-7a0d-4975-811c-e7dd71d97350 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:47.639190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437bad7-7a0d-4975-811c-e7dd71d97350 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:47.639190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437bad7-7a0d-4975-811c-e7dd71d97350 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:47.640627 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 734/1485] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:50:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:50:47.647086 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba432e7-4612-4d21-b74f-14d62a9a65d1 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:47.647854 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba432e7-4612-4d21-b74f-14d62a9a65d1 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:47.648032 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba432e7-4612-4d21-b74f-14d62a9a65d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:47.669736 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-5ba432e7-4612-4d21-b74f-14d62a9a65d1 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:50:47.670948 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5ba432e7-4612-4d21-b74f-14d62a9a65d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:50:47.679439 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 752/1486] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:50:47.718605 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437bad7-7a0d-4975-811c-e7dd71d97350 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:50:47.737141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437bad7-7a0d-4975-811c-e7dd71d97350 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:50:47.744310 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522eda3d-9c0f-4bba-8406-0467f9f2964a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:50:47.745307 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522eda3d-9c0f-4bba-8406-0467f9f2964a service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:47.745751 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522eda3d-9c0f-4bba-8406-0467f9f2964a service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:47.746179 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522eda3d-9c0f-4bba-8406-0467f9f2964a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:47.756793 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522eda3d-9c0f-4bba-8406-0467f9f2964a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:50:47.758250 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522eda3d-9c0f-4bba-8406-0467f9f2964a service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:50:47.768392 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 735/1487] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:50:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:50:50.070204 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971591d-7221-4b22-9fa7-cfebb818a909 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:50.071113 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971591d-7221-4b22-9fa7-cfebb818a909 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:50.071113 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971591d-7221-4b22-9fa7-cfebb818a909 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:50.073463 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 753/1488] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:50:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:50:50.079243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea0a46-9017-4324-a0ef-e554e77a0f43 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:50.079697 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea0a46-9017-4324-a0ef-e554e77a0f43 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:50.079793 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea0a46-9017-4324-a0ef-e554e77a0f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:50.099975 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-64ea0a46-9017-4324-a0ef-e554e77a0f43 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:50:50.101370 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-64ea0a46-9017-4324-a0ef-e554e77a0f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:50:50.111048 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 736/1489] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:50:50.156649 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971591d-7221-4b22-9fa7-cfebb818a909 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:50:50.175965 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971591d-7221-4b22-9fa7-cfebb818a909 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:50:50.183367 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc2035-448f-4f0a-bb45-471c77c03611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:50:50.184415 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc2035-448f-4f0a-bb45-471c77c03611 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:50.184879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc2035-448f-4f0a-bb45-471c77c03611 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:50.185427 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc2035-448f-4f0a-bb45-471c77c03611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:50.200353 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc2035-448f-4f0a-bb45-471c77c03611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:50:50.202339 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc2035-448f-4f0a-bb45-471c77c03611 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:50:50.212058 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 754/1490] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:50:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:50:52.546497 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c01596-f4e7-498e-bd66-7042821e8ede None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:52.547090 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c01596-f4e7-498e-bd66-7042821e8ede None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:52.547090 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c01596-f4e7-498e-bd66-7042821e8ede None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:52.549371 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 737/1491] 10.222.0.85 () {54 vars in 926 bytes} [Thu Jun 16 14:50:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:50:52.554812 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621ed94-74d5-49e2-b010-fbff6833a566 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:52.555235 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621ed94-74d5-49e2-b010-fbff6833a566 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:52.555364 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621ed94-74d5-49e2-b010-fbff6833a566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:52.576684 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-6621ed94-74d5-49e2-b010-fbff6833a566 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:50:52.577897 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6621ed94-74d5-49e2-b010-fbff6833a566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:50:52.587917 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 755/1492] 10.222.0.85 () {58 vars in 1023 bytes} [Thu Jun 16 14:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:50:52.636390 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c01596-f4e7-498e-bd66-7042821e8ede None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:50:52.649070 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c01596-f4e7-498e-bd66-7042821e8ede None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:50:52.653635 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c584d06-1107-4427-86d1-5cad905f7f45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:50:52.654291 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c584d06-1107-4427-86d1-5cad905f7f45 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:50:52.654656 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c584d06-1107-4427-86d1-5cad905f7f45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:50:52.655128 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c584d06-1107-4427-86d1-5cad905f7f45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:50:52.664478 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c584d06-1107-4427-86d1-5cad905f7f45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:50:52.666236 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c584d06-1107-4427-86d1-5cad905f7f45 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:50:52.675677 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 738/1493] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:50:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:51:02.569667 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=33 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:51:02.671659 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=33 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:52:18.353986 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079289ff-72b1-4a53-b6da-d352646754e1 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:52:18.354728 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079289ff-72b1-4a53-b6da-d352646754e1 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:52:18.354728 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079289ff-72b1-4a53-b6da-d352646754e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:52:18.375293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-079289ff-72b1-4a53-b6da-d352646754e1 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:52:18.376571 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-079289ff-72b1-4a53-b6da-d352646754e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:52:18.385906 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 756/1494] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:52:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:52:18.396383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f396403-3013-4cff-9585-517fc661ef35 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:52:18.396959 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f396403-3013-4cff-9585-517fc661ef35 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:52:18.396959 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f396403-3013-4cff-9585-517fc661ef35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:52:18.419468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1f396403-3013-4cff-9585-517fc661ef35 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:52:18.420856 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1f396403-3013-4cff-9585-517fc661ef35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:52:18.430577 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 739/1495] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:52:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:52:18.435508 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079289ff-72b1-4a53-b6da-d352646754e1 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:52:18.445563 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079289ff-72b1-4a53-b6da-d352646754e1 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:52:18.450893 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10385a26-9e33-4a43-84e9-eda080aa659f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:52:18.451619 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10385a26-9e33-4a43-84e9-eda080aa659f admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:52:18.451898 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10385a26-9e33-4a43-84e9-eda080aa659f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:52:18.452231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10385a26-9e33-4a43-84e9-eda080aa659f admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:52:18.453000 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10385a26-9e33-4a43-84e9-eda080aa659f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:52:18.453343 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10385a26-9e33-4a43-84e9-eda080aa659f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:52:18.454427 dv-cinder-837165-3-smb devstack@keystone.service[80176]: WARNING py.warnings [None req-10385a26-9e33-4a43-84e9-eda080aa659f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:52:18.454427 dv-cinder-837165-3-smb devstack@keystone.service[80176]: warnings.warn(msg) Jun 16 14:52:18.454427 dv-cinder-837165-3-smb devstack@keystone.service[80176]: Jun 16 14:52:18.455375 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10385a26-9e33-4a43-84e9-eda080aa659f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:52:18.470260 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 757/1496] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:52:18.478694 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f396403-3013-4cff-9585-517fc661ef35 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:52:18.488434 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f396403-3013-4cff-9585-517fc661ef35 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:52:18.494364 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578eec49-5db5-4d51-81c4-4d04306baa99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:52:18.495046 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578eec49-5db5-4d51-81c4-4d04306baa99 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:52:18.495332 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578eec49-5db5-4d51-81c4-4d04306baa99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:52:18.495607 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578eec49-5db5-4d51-81c4-4d04306baa99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:52:18.496352 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578eec49-5db5-4d51-81c4-4d04306baa99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:52:18.498207 dv-cinder-837165-3-smb devstack@keystone.service[80175]: WARNING py.warnings [None req-578eec49-5db5-4d51-81c4-4d04306baa99 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:52:18.498207 dv-cinder-837165-3-smb devstack@keystone.service[80175]: warnings.warn(msg) Jun 16 14:52:18.498207 dv-cinder-837165-3-smb devstack@keystone.service[80175]: Jun 16 14:52:18.499422 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578eec49-5db5-4d51-81c4-4d04306baa99 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:52:18.539726 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 740/1497] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:52:18 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:52:18.544454 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10385a26-9e33-4a43-84e9-eda080aa659f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:52:18.554915 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10385a26-9e33-4a43-84e9-eda080aa659f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:52:18.615026 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a43679-8ae1-4173-9433-4daa9c1fd925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:52:18.615636 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a43679-8ae1-4173-9433-4daa9c1fd925 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:52:18.615944 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a43679-8ae1-4173-9433-4daa9c1fd925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:52:18.616248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a43679-8ae1-4173-9433-4daa9c1fd925 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:52:18.616967 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a43679-8ae1-4173-9433-4daa9c1fd925 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:52:18.617989 dv-cinder-837165-3-smb devstack@keystone.service[80176]: WARNING py.warnings [None req-e5a43679-8ae1-4173-9433-4daa9c1fd925 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:52:18.617989 dv-cinder-837165-3-smb devstack@keystone.service[80176]: warnings.warn(msg) Jun 16 14:52:18.617989 dv-cinder-837165-3-smb devstack@keystone.service[80176]: Jun 16 14:52:18.619192 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a43679-8ae1-4173-9433-4daa9c1fd925 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:52:18.642859 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 758/1498] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:52:18 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:52:18.648724 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578eec49-5db5-4d51-81c4-4d04306baa99 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:52:18.660653 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578eec49-5db5-4d51-81c4-4d04306baa99 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:52:18.666951 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad497f8-7cc5-42e0-8231-f0e9d7a8c279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:52:18.667633 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad497f8-7cc5-42e0-8231-f0e9d7a8c279 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:52:18.667948 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad497f8-7cc5-42e0-8231-f0e9d7a8c279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:52:18.668229 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad497f8-7cc5-42e0-8231-f0e9d7a8c279 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:52:18.668963 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad497f8-7cc5-42e0-8231-f0e9d7a8c279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:52:18.669976 dv-cinder-837165-3-smb devstack@keystone.service[80175]: WARNING py.warnings [None req-8ad497f8-7cc5-42e0-8231-f0e9d7a8c279 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:52:18.669976 dv-cinder-837165-3-smb devstack@keystone.service[80175]: warnings.warn(msg) Jun 16 14:52:18.669976 dv-cinder-837165-3-smb devstack@keystone.service[80175]: Jun 16 14:52:18.670969 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad497f8-7cc5-42e0-8231-f0e9d7a8c279 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:52:18.685538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 741/1499] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:52:18.690946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a43679-8ae1-4173-9433-4daa9c1fd925 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:52:18.701820 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a43679-8ae1-4173-9433-4daa9c1fd925 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:52:18.706899 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e72f8e-c6f1-4027-8819-0a1f46c987dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:52:18.707566 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e72f8e-c6f1-4027-8819-0a1f46c987dd admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:52:18.707902 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e72f8e-c6f1-4027-8819-0a1f46c987dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:52:18.708192 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e72f8e-c6f1-4027-8819-0a1f46c987dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:52:18.708941 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e72f8e-c6f1-4027-8819-0a1f46c987dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:52:18.710027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: WARNING py.warnings [None req-b6e72f8e-c6f1-4027-8819-0a1f46c987dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:52:18.710027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: warnings.warn(msg) Jun 16 14:52:18.710027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: Jun 16 14:52:18.710929 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e72f8e-c6f1-4027-8819-0a1f46c987dd admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:52:18.728452 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 759/1500] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:52:18.733455 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad497f8-7cc5-42e0-8231-f0e9d7a8c279 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:52:18.745562 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad497f8-7cc5-42e0-8231-f0e9d7a8c279 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:52:18.754719 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d1b501-24fa-496f-adf0-89c14548442d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:52:18.756136 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1b501-24fa-496f-adf0-89c14548442d admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:52:18.756572 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1b501-24fa-496f-adf0-89c14548442d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:52:18.757006 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1b501-24fa-496f-adf0-89c14548442d admin admin] PATH_INFO: `/v3/projects/1a7cf17e7cb748a8ae9d7bbe54db59a4/users/dffdd3076fcd489a8a42e65dce157d85/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:52:18.776719 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d1b501-24fa-496f-adf0-89c14548442d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a7cf17e7cb748a8ae9d7bbe54db59a4, user_id=dffdd3076fcd489a8a42e65dce157d85, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:52:18.778321 dv-cinder-837165-3-smb devstack@keystone.service[80175]: WARNING py.warnings [None req-46d1b501-24fa-496f-adf0-89c14548442d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:52:18.778321 dv-cinder-837165-3-smb devstack@keystone.service[80175]: warnings.warn(msg) Jun 16 14:52:18.778321 dv-cinder-837165-3-smb devstack@keystone.service[80175]: Jun 16 14:52:18.781642 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d1b501-24fa-496f-adf0-89c14548442d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:52:18.800763 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 742/1501] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:52:18 2022] PUT /identity/v3/projects/1a7cf17e7cb748a8ae9d7bbe54db59a4/users/dffdd3076fcd489a8a42e65dce157d85/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:52:18.813889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20f4c9-6398-4b8c-acbf-dd8b47d7132c None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:52:18.814255 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20f4c9-6398-4b8c-acbf-dd8b47d7132c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:52:18.814597 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20f4c9-6398-4b8c-acbf-dd8b47d7132c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:52:18.847575 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-7b20f4c9-6398-4b8c-acbf-dd8b47d7132c None None] MFA Rules not processed for user `dffdd3076fcd489a8a42e65dce157d85`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:52:18.848821 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7b20f4c9-6398-4b8c-acbf-dd8b47d7132c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:52:18.925222 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 760/1502] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:52:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:52:18.940015 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d10a1-6e90-46b6-89e1-7e1d2e8a0b8e None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:52:18.940307 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d10a1-6e90-46b6-89e1-7e1d2e8a0b8e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:52:18.940586 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d10a1-6e90-46b6-89e1-7e1d2e8a0b8e None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:52:18.942046 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 743/1503] 10.222.0.85 () {54 vars in 963 bytes} [Thu Jun 16 14:52:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:52:18.947403 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01476fad-4d23-4e57-bd39-e6a1f222c8b2 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:52:18.947710 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01476fad-4d23-4e57-bd39-e6a1f222c8b2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:52:18.948045 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01476fad-4d23-4e57-bd39-e6a1f222c8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:52:18.967227 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-01476fad-4d23-4e57-bd39-e6a1f222c8b2 None None] MFA Rules not processed for user `1d0ac98d9520470483c348644566d9ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:52:18.968492 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-01476fad-4d23-4e57-bd39-e6a1f222c8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:52:19.014318 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:52:19.025594 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 761/1504] 10.222.0.85 () {58 vars in 1060 bytes} [Thu Jun 16 14:52:18 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:52:19.038327 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d10a1-6e90-46b6-89e1-7e1d2e8a0b8e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:52:19.052755 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d10a1-6e90-46b6-89e1-7e1d2e8a0b8e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:52:19.056824 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141e13c-747f-4264-8276-908dae9ca3bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:52:19.057487 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141e13c-747f-4264-8276-908dae9ca3bc service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:52:19.057768 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141e13c-747f-4264-8276-908dae9ca3bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:52:19.058048 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141e13c-747f-4264-8276-908dae9ca3bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:52:19.066763 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d141e13c-747f-4264-8276-908dae9ca3bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:52:19.068295 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d141e13c-747f-4264-8276-908dae9ca3bc service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:52:19.077192 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 744/1505] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:52:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:52:19.132118 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705214fa-621f-491c-bdc3-4d848be0d73d None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:52:19.132551 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705214fa-621f-491c-bdc3-4d848be0d73d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:52:19.133033 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705214fa-621f-491c-bdc3-4d848be0d73d None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:52:19.135253 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 762/1506] 10.222.0.85 () {52 vars in 829 bytes} [Thu Jun 16 14:52:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:52:19.139451 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141e13c-747f-4264-8276-908dae9ca3bc service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:52:19.206001 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141e13c-747f-4264-8276-908dae9ca3bc service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:52:19.210735 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac1d65-80f6-490b-8000-01abfe86dfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:52:19.211623 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac1d65-80f6-490b-8000-01abfe86dfde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:52:19.211909 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac1d65-80f6-490b-8000-01abfe86dfde admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:52:19.212206 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac1d65-80f6-490b-8000-01abfe86dfde admin admin] PATH_INFO: `/v3/users/dffdd3076fcd489a8a42e65dce157d85` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:52:19.213383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac1d65-80f6-490b-8000-01abfe86dfde admin admin] RBAC: Authorizing `identity:delete_user(user_id=dffdd3076fcd489a8a42e65dce157d85)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:52:19.214401 dv-cinder-837165-3-smb devstack@keystone.service[80175]: WARNING py.warnings [None req-42ac1d65-80f6-490b-8000-01abfe86dfde admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:52:19.214401 dv-cinder-837165-3-smb devstack@keystone.service[80175]: warnings.warn(msg) Jun 16 14:52:19.214401 dv-cinder-837165-3-smb devstack@keystone.service[80175]: Jun 16 14:52:19.215628 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac1d65-80f6-490b-8000-01abfe86dfde admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:52:19.290189 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-42ac1d65-80f6-490b-8000-01abfe86dfde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dffdd3076fcd489a8a42e65dce157d85'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:52:19.303431 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-42ac1d65-80f6-490b-8000-01abfe86dfde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dffdd3076fcd489a8a42e65dce157d85'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:52:19.314943 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-42ac1d65-80f6-490b-8000-01abfe86dfde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dffdd3076fcd489a8a42e65dce157d85'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:52:19.332004 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:52:19.334972 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-42ac1d65-80f6-490b-8000-01abfe86dfde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dffdd3076fcd489a8a42e65dce157d85'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:52:19.336213 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-42ac1d65-80f6-490b-8000-01abfe86dfde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dffdd3076fcd489a8a42e65dce157d85'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:52:19.344704 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 745/1507] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:52:19 2022] DELETE /identity/v3/users/dffdd3076fcd489a8a42e65dce157d85 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:52:19.349500 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25cdb49-b5d3-4413-b98e-734ff74d5b7c None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:52:19.349817 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25cdb49-b5d3-4413-b98e-734ff74d5b7c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:52:19.350068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25cdb49-b5d3-4413-b98e-734ff74d5b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:52:19.368466 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-e25cdb49-b5d3-4413-b98e-734ff74d5b7c None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:52:19.369712 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e25cdb49-b5d3-4413-b98e-734ff74d5b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:52:19.440627 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 763/1508] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:52:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:52:19.450674 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac1d65-80f6-490b-8000-01abfe86dfde admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:52:19.452405 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-42ac1d65-80f6-490b-8000-01abfe86dfde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:52:19.519619 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac1d65-80f6-490b-8000-01abfe86dfde admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:52:19.526259 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9cb94d-3efb-443e-b7a6-8515eaf624d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:52:19.527284 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9cb94d-3efb-443e-b7a6-8515eaf624d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:52:19.527638 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9cb94d-3efb-443e-b7a6-8515eaf624d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:52:19.528089 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9cb94d-3efb-443e-b7a6-8515eaf624d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:52:19.544252 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9cb94d-3efb-443e-b7a6-8515eaf624d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:52:19.546036 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9cb94d-3efb-443e-b7a6-8515eaf624d1 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:52:19.556553 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 746/1509] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:52:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:52:19.936624 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25cdb49-b5d3-4413-b98e-734ff74d5b7c None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:52:19.938348 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e25cdb49-b5d3-4413-b98e-734ff74d5b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:52:19.951664 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25cdb49-b5d3-4413-b98e-734ff74d5b7c None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:52:19.958433 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4dca20-9bac-4bd1-89d8-4c03c2e4a38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:52:19.958596 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4dca20-9bac-4bd1-89d8-4c03c2e4a38e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:52:19.958956 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4dca20-9bac-4bd1-89d8-4c03c2e4a38e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:52:19.959375 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4dca20-9bac-4bd1-89d8-4c03c2e4a38e admin admin] PATH_INFO: `/v3/projects/1a7cf17e7cb748a8ae9d7bbe54db59a4` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:52:19.960995 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4dca20-9bac-4bd1-89d8-4c03c2e4a38e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a7cf17e7cb748a8ae9d7bbe54db59a4)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:52:19.962028 dv-cinder-837165-3-smb devstack@keystone.service[80176]: WARNING py.warnings [None req-0a4dca20-9bac-4bd1-89d8-4c03c2e4a38e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:52:19.962028 dv-cinder-837165-3-smb devstack@keystone.service[80176]: warnings.warn(msg) Jun 16 14:52:19.962028 dv-cinder-837165-3-smb devstack@keystone.service[80176]: Jun 16 14:52:19.963237 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4dca20-9bac-4bd1-89d8-4c03c2e4a38e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:52:20.030377 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0a4dca20-9bac-4bd1-89d8-4c03c2e4a38e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a7cf17e7cb748a8ae9d7bbe54db59a4', 'request_id': 'req-0a4dca20-9bac-4bd1-89d8-4c03c2e4a38e'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:52:20.036724 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0a4dca20-9bac-4bd1-89d8-4c03c2e4a38e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a7cf17e7cb748a8ae9d7bbe54db59a4', 'request_id': 'req-0a4dca20-9bac-4bd1-89d8-4c03c2e4a38e'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:52:20.052295 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0a4dca20-9bac-4bd1-89d8-4c03c2e4a38e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a7cf17e7cb748a8ae9d7bbe54db59a4', 'request_id': 'req-0a4dca20-9bac-4bd1-89d8-4c03c2e4a38e'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:52:20.068264 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0a4dca20-9bac-4bd1-89d8-4c03c2e4a38e admin admin] The token cache is being invalidate because project 1a7cf17e7cb748a8ae9d7bbe54db59a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:52:20.068572 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0a4dca20-9bac-4bd1-89d8-4c03c2e4a38e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:52:20.069332 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0a4dca20-9bac-4bd1-89d8-4c03c2e4a38e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:52:20.070941 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 764/1510] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:52:19 2022] DELETE /identity/v3/projects/1a7cf17e7cb748a8ae9d7bbe54db59a4 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:52:29.551360 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:52:30.064903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:54:12.288092 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fec8b6-7942-49c1-8dbf-6be03b6398f4 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:12.288724 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fec8b6-7942-49c1-8dbf-6be03b6398f4 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:12.288724 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fec8b6-7942-49c1-8dbf-6be03b6398f4 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:12.290375 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 747/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 14:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:54:12.296433 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cb4d2-7e3a-4e71-8f0e-2a565292b065 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:12.297194 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cb4d2-7e3a-4e71-8f0e-2a565292b065 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:12.297367 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cb4d2-7e3a-4e71-8f0e-2a565292b065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:12.318616 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-4c0cb4d2-7e3a-4e71-8f0e-2a565292b065 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:54:12.319854 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4c0cb4d2-7e3a-4e71-8f0e-2a565292b065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:12.391039 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 765/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 14:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:54:12.562063 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fec8b6-7942-49c1-8dbf-6be03b6398f4 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:54:12.564205 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-71fec8b6-7942-49c1-8dbf-6be03b6398f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:12.642152 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fec8b6-7942-49c1-8dbf-6be03b6398f4 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:54:12.648975 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ac2da-c36e-45b3-823d-4336a35a3a8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:54:12.649671 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ac2da-c36e-45b3-823d-4336a35a3a8e service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:12.649952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ac2da-c36e-45b3-823d-4336a35a3a8e service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:12.650224 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ac2da-c36e-45b3-823d-4336a35a3a8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:12.659291 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ac2da-c36e-45b3-823d-4336a35a3a8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:54:12.660944 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ac2da-c36e-45b3-823d-4336a35a3a8e service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:54:12.674854 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 748/1513] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:54:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:54:12.694188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb2970-8fa7-488d-942e-e96861896724 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:12.694588 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb2970-8fa7-488d-942e-e96861896724 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:12.694872 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb2970-8fa7-488d-942e-e96861896724 None None] PATH_INFO: `/v3` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:12.696224 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 766/1514] 10.222.0.91 () {54 vars in 925 bytes} [Thu Jun 16 14:54:12 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:54:12.702772 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ecd98f-101a-4f8f-b7da-6b576bba5218 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:12.703064 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ecd98f-101a-4f8f-b7da-6b576bba5218 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:12.703330 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ecd98f-101a-4f8f-b7da-6b576bba5218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:12.723508 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c4ecd98f-101a-4f8f-b7da-6b576bba5218 None None] MFA Rules not processed for user `819ad532defb4adaa2f4fd06b47630d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:54:12.724949 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c4ecd98f-101a-4f8f-b7da-6b576bba5218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:12.793423 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 749/1515] 10.222.0.91 () {58 vars in 1015 bytes} [Thu Jun 16 14:54:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:54:13.546522 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71278eec-a8b6-4495-9569-cc45e61d6b2f None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:13.547271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71278eec-a8b6-4495-9569-cc45e61d6b2f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:13.547271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71278eec-a8b6-4495-9569-cc45e61d6b2f None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:13.549481 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 767/1516] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 14:54:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:54:13.557132 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755be0a-8fa9-4bdc-a958-1f72f0b09e74 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:13.557597 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755be0a-8fa9-4bdc-a958-1f72f0b09e74 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:13.557773 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755be0a-8fa9-4bdc-a958-1f72f0b09e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:13.578581 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-9755be0a-8fa9-4bdc-a958-1f72f0b09e74 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:54:13.579796 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9755be0a-8fa9-4bdc-a958-1f72f0b09e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:13.589398 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 750/1517] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 14:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:54:13.743433 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71278eec-a8b6-4495-9569-cc45e61d6b2f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:54:13.768513 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71278eec-a8b6-4495-9569-cc45e61d6b2f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:54:13.774429 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2801b4e-777c-4e3c-9fad-ba89b9b7ac38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:54:13.775064 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2801b4e-777c-4e3c-9fad-ba89b9b7ac38 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:13.775346 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2801b4e-777c-4e3c-9fad-ba89b9b7ac38 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:13.775595 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2801b4e-777c-4e3c-9fad-ba89b9b7ac38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:13.784937 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2801b4e-777c-4e3c-9fad-ba89b9b7ac38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:54:13.786636 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2801b4e-777c-4e3c-9fad-ba89b9b7ac38 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:54:13.797544 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 768/1518] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:54:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:54:23.457124 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a14bfb-785c-49c1-98ac-9f2a6a2303d0 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:23.457688 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a14bfb-785c-49c1-98ac-9f2a6a2303d0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:23.457688 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a14bfb-785c-49c1-98ac-9f2a6a2303d0 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:23.459033 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 751/1519] 10.222.0.85 () {54 vars in 960 bytes} [Thu Jun 16 14:54:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:54:23.464363 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7395cc-8c54-414b-9318-4e26d7117f16 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:23.464833 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7395cc-8c54-414b-9318-4e26d7117f16 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:23.464949 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7395cc-8c54-414b-9318-4e26d7117f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:23.484841 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-9e7395cc-8c54-414b-9318-4e26d7117f16 None None] MFA Rules not processed for user `819ad532defb4adaa2f4fd06b47630d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:54:23.486046 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9e7395cc-8c54-414b-9318-4e26d7117f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:23.496351 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 769/1520] 10.222.0.85 () {58 vars in 1057 bytes} [Thu Jun 16 14:54:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:54:23.507916 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a14bfb-785c-49c1-98ac-9f2a6a2303d0 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:54:23.525197 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a14bfb-785c-49c1-98ac-9f2a6a2303d0 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:54:23.530896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c5fba-8fbd-4d36-932b-16308aea1aea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819ad532defb4adaa2f4fd06b47630d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:54:23.531537 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c5fba-8fbd-4d36-932b-16308aea1aea service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:23.531821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c5fba-8fbd-4d36-932b-16308aea1aea service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:23.532128 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c5fba-8fbd-4d36-932b-16308aea1aea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:23.541495 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c5fba-8fbd-4d36-932b-16308aea1aea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:54:23.543132 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c5fba-8fbd-4d36-932b-16308aea1aea service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:54:23.553180 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 752/1521] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:54:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:54:25.044930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c6e24-0d7a-464e-9fda-283baab72346 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:25.045536 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c6e24-0d7a-464e-9fda-283baab72346 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:25.045536 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c6e24-0d7a-464e-9fda-283baab72346 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:25.046855 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 770/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 14:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:54:25.052306 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930bcd7-0c98-4797-9e8c-2b1f0e4b0ee5 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:25.052754 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930bcd7-0c98-4797-9e8c-2b1f0e4b0ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:25.052867 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930bcd7-0c98-4797-9e8c-2b1f0e4b0ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:25.073093 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a930bcd7-0c98-4797-9e8c-2b1f0e4b0ee5 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:54:25.074296 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a930bcd7-0c98-4797-9e8c-2b1f0e4b0ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:25.083734 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 753/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 14:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:54:25.244918 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c6e24-0d7a-464e-9fda-283baab72346 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:54:25.269248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c6e24-0d7a-464e-9fda-283baab72346 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:54:25.276042 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7018ac-daf5-4d1a-94b8-53745c454990 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:54:25.276688 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7018ac-daf5-4d1a-94b8-53745c454990 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:25.276974 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7018ac-daf5-4d1a-94b8-53745c454990 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:25.277272 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7018ac-daf5-4d1a-94b8-53745c454990 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:25.286158 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7018ac-daf5-4d1a-94b8-53745c454990 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:54:25.287817 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7018ac-daf5-4d1a-94b8-53745c454990 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:54:25.297596 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 771/1524] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:54:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:54:26.207038 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe22bb0-98d3-452d-9b54-31a4c6bc5c72 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:26.207661 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe22bb0-98d3-452d-9b54-31a4c6bc5c72 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:26.207661 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe22bb0-98d3-452d-9b54-31a4c6bc5c72 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:26.209128 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 754/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 14:54:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:54:26.214352 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d653d95-d09a-425f-aebe-49ef1226c906 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:26.214854 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d653d95-d09a-425f-aebe-49ef1226c906 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:26.214854 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d653d95-d09a-425f-aebe-49ef1226c906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:26.234478 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-9d653d95-d09a-425f-aebe-49ef1226c906 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:54:26.235691 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9d653d95-d09a-425f-aebe-49ef1226c906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:26.244503 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 772/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 14:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:54:26.396212 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe22bb0-98d3-452d-9b54-31a4c6bc5c72 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:54:26.417042 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe22bb0-98d3-452d-9b54-31a4c6bc5c72 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:54:26.423971 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52044f93-b12e-4e76-92be-24fbeb63351e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:54:26.424683 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52044f93-b12e-4e76-92be-24fbeb63351e service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:26.424966 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52044f93-b12e-4e76-92be-24fbeb63351e service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:26.425242 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52044f93-b12e-4e76-92be-24fbeb63351e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:26.433967 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52044f93-b12e-4e76-92be-24fbeb63351e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:54:26.435599 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52044f93-b12e-4e76-92be-24fbeb63351e service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:54:26.445710 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 755/1527] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:54:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:54:30.690012 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab81e7c-dc7c-49f4-b847-6b7522af96b4 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:30.690655 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab81e7c-dc7c-49f4-b847-6b7522af96b4 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:30.690655 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab81e7c-dc7c-49f4-b847-6b7522af96b4 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:30.691980 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 773/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:54:30.697614 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cc8fb-8232-4385-93ea-ef0c0cfcbd7a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:30.698045 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cc8fb-8232-4385-93ea-ef0c0cfcbd7a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:30.698179 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cc8fb-8232-4385-93ea-ef0c0cfcbd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:30.718870 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e92cc8fb-8232-4385-93ea-ef0c0cfcbd7a None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:54:30.720146 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e92cc8fb-8232-4385-93ea-ef0c0cfcbd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:30.730069 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 756/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:54:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:54:30.766177 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab81e7c-dc7c-49f4-b847-6b7522af96b4 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:54:30.768663 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-eab81e7c-dc7c-49f4-b847-6b7522af96b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:30.828335 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab81e7c-dc7c-49f4-b847-6b7522af96b4 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:54:30.832525 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800f673-4a75-41a7-80f7-04c470ee599c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:54:30.833209 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800f673-4a75-41a7-80f7-04c470ee599c service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:30.833484 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800f673-4a75-41a7-80f7-04c470ee599c service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:30.833767 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800f673-4a75-41a7-80f7-04c470ee599c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:30.843594 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800f673-4a75-41a7-80f7-04c470ee599c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:54:30.845169 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800f673-4a75-41a7-80f7-04c470ee599c service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:54:30.855378 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 774/1530] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:54:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:54:32.977062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4dd6a4-9d86-458a-8ed9-edb6c50a0461 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:32.977622 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4dd6a4-9d86-458a-8ed9-edb6c50a0461 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:32.977622 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4dd6a4-9d86-458a-8ed9-edb6c50a0461 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:32.978921 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 757/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:54:32.984388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b974daf-fa17-4ece-b179-ca0f6c4d0512 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:32.984839 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b974daf-fa17-4ece-b179-ca0f6c4d0512 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:32.984948 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b974daf-fa17-4ece-b179-ca0f6c4d0512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:33.005107 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-3b974daf-fa17-4ece-b179-ca0f6c4d0512 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:54:33.006322 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3b974daf-fa17-4ece-b179-ca0f6c4d0512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:33.015643 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 775/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:54:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:54:33.052561 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4dd6a4-9d86-458a-8ed9-edb6c50a0461 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:54:33.066656 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4dd6a4-9d86-458a-8ed9-edb6c50a0461 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:54:33.070816 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6bd4f2-19f4-413a-80b3-057be5e09e77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:54:33.071467 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bd4f2-19f4-413a-80b3-057be5e09e77 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:33.071788 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bd4f2-19f4-413a-80b3-057be5e09e77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:33.072084 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bd4f2-19f4-413a-80b3-057be5e09e77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:33.081851 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6bd4f2-19f4-413a-80b3-057be5e09e77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:54:33.083286 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6bd4f2-19f4-413a-80b3-057be5e09e77 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:54:33.092792 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 758/1533] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:54:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:54:36.963385 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28201397-5845-4d2a-ac07-39557efef588 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:36.964323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28201397-5845-4d2a-ac07-39557efef588 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:36.964323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28201397-5845-4d2a-ac07-39557efef588 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:36.966273 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 776/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:54:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:54:36.971852 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6eb31-1b81-4690-8b54-bef19dc0225b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:36.972372 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6eb31-1b81-4690-8b54-bef19dc0225b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:36.972479 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6eb31-1b81-4690-8b54-bef19dc0225b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:36.991695 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4dc6eb31-1b81-4690-8b54-bef19dc0225b None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:54:36.994812 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4dc6eb31-1b81-4690-8b54-bef19dc0225b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:37.006264 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 759/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:54:37.285500 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28201397-5845-4d2a-ac07-39557efef588 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:54:37.287497 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-28201397-5845-4d2a-ac07-39557efef588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:37.351893 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28201397-5845-4d2a-ac07-39557efef588 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:54:37.356230 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a36f2-eef5-46e0-a36f-7f71f973d343 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:54:37.356881 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a36f2-eef5-46e0-a36f-7f71f973d343 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:37.357161 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a36f2-eef5-46e0-a36f-7f71f973d343 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:37.357455 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a36f2-eef5-46e0-a36f-7f71f973d343 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:37.368092 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a36f2-eef5-46e0-a36f-7f71f973d343 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:54:37.369531 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a36f2-eef5-46e0-a36f-7f71f973d343 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:54:37.374542 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:54:37.380363 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 777/1536] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:54:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:54:39.552036 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61368c-823a-4d0a-a7ce-506293fae885 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:39.552586 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61368c-823a-4d0a-a7ce-506293fae885 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:39.552586 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61368c-823a-4d0a-a7ce-506293fae885 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:39.553900 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 760/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:54:39.559369 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9ef01-6211-4e00-a8df-2ef9b26acdd3 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:39.559820 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9ef01-6211-4e00-a8df-2ef9b26acdd3 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:39.559944 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9ef01-6211-4e00-a8df-2ef9b26acdd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:39.582358 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-dbc9ef01-6211-4e00-a8df-2ef9b26acdd3 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:54:39.583563 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-dbc9ef01-6211-4e00-a8df-2ef9b26acdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:39.592523 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 778/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:54:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:54:39.861867 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61368c-823a-4d0a-a7ce-506293fae885 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:54:39.864945 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2c61368c-823a-4d0a-a7ce-506293fae885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:39.878598 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=94 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:54:39.887544 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61368c-823a-4d0a-a7ce-506293fae885 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:54:39.892624 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a6b8c-3eed-4ee4-8906-8afa57479f7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:54:39.893542 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a6b8c-3eed-4ee4-8906-8afa57479f7c service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:39.893868 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a6b8c-3eed-4ee4-8906-8afa57479f7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:39.894142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a6b8c-3eed-4ee4-8906-8afa57479f7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:39.908897 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a6b8c-3eed-4ee4-8906-8afa57479f7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:54:39.910363 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a6b8c-3eed-4ee4-8906-8afa57479f7c service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:54:39.920479 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 761/1539] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:54:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:54:49.576074 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:54:49.916201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=5 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:22.893227 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23ac70-bb6a-4d0d-b9ff-6ddfece7ed2c None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:22.894432 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23ac70-bb6a-4d0d-b9ff-6ddfece7ed2c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:22.894432 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23ac70-bb6a-4d0d-b9ff-6ddfece7ed2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:22.933942 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-af23ac70-bb6a-4d0d-b9ff-6ddfece7ed2c None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:22.935255 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-af23ac70-bb6a-4d0d-b9ff-6ddfece7ed2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:22.947442 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 779/1540] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:22.962473 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83cd1c-4d56-417f-8d8d-8592acb1d737 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:22.963095 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83cd1c-4d56-417f-8d8d-8592acb1d737 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:22.963095 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83cd1c-4d56-417f-8d8d-8592acb1d737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:22.983570 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91cedd-bc6f-43cb-9e5d-35fff11c4ecc None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:22.983957 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91cedd-bc6f-43cb-9e5d-35fff11c4ecc None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:22.984166 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91cedd-bc6f-43cb-9e5d-35fff11c4ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:22.992984 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1c83cd1c-4d56-417f-8d8d-8592acb1d737 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:22.994385 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1c83cd1c-4d56-417f-8d8d-8592acb1d737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:23.012924 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-ec91cedd-bc6f-43cb-9e5d-35fff11c4ecc None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:23.014150 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ec91cedd-bc6f-43cb-9e5d-35fff11c4ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:23.029672 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 780/1542] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:56:23.029906 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 762/1542] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:23.037693 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec91cedd-bc6f-43cb-9e5d-35fff11c4ecc None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:23.042444 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa8bea-8856-4df1-ace2-6173da29ea3c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:23.042847 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa8bea-8856-4df1-ace2-6173da29ea3c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:23.043021 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa8bea-8856-4df1-ace2-6173da29ea3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:23.059182 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec91cedd-bc6f-43cb-9e5d-35fff11c4ecc None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:23.082955 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae8157-93e6-473a-9065-2ffb282724f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:23.083678 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae8157-93e6-473a-9065-2ffb282724f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:23.084018 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae8157-93e6-473a-9065-2ffb282724f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:23.084295 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae8157-93e6-473a-9065-2ffb282724f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:23.085104 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae8157-93e6-473a-9065-2ffb282724f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:56:23.085232 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-57aa8bea-8856-4df1-ace2-6173da29ea3c None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:23.085449 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae8157-93e6-473a-9065-2ffb282724f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:23.086387 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-57aa8bea-8856-4df1-ace2-6173da29ea3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:23.087961 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae8157-93e6-473a-9065-2ffb282724f1 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:23.103412 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 781/1543] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:56:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:56:23.110441 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 763/1544] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:56:23.114529 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae8157-93e6-473a-9065-2ffb282724f1 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:23.115137 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa8bea-8856-4df1-ace2-6173da29ea3c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:23.125028 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa8bea-8856-4df1-ace2-6173da29ea3c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:23.128306 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae8157-93e6-473a-9065-2ffb282724f1 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:23.139485 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f86fe0-b4bb-4dd8-871a-7dd3dab1ca7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:23.140241 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f86fe0-b4bb-4dd8-871a-7dd3dab1ca7b admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:23.140644 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f86fe0-b4bb-4dd8-871a-7dd3dab1ca7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:23.140931 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f86fe0-b4bb-4dd8-871a-7dd3dab1ca7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:23.141685 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f86fe0-b4bb-4dd8-871a-7dd3dab1ca7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:23.142767 dv-cinder-837165-3-smb devstack@keystone.service[80176]: WARNING py.warnings [None req-c6f86fe0-b4bb-4dd8-871a-7dd3dab1ca7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:56:23.142767 dv-cinder-837165-3-smb devstack@keystone.service[80176]: warnings.warn(msg) Jun 16 14:56:23.142767 dv-cinder-837165-3-smb devstack@keystone.service[80176]: Jun 16 14:56:23.144333 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f86fe0-b4bb-4dd8-871a-7dd3dab1ca7b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:23.149143 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d5cd8-7d26-40dd-8e30-e1bbe776ec71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:23.150781 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d5cd8-7d26-40dd-8e30-e1bbe776ec71 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:23.151068 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d5cd8-7d26-40dd-8e30-e1bbe776ec71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:23.154604 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d5cd8-7d26-40dd-8e30-e1bbe776ec71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:23.156091 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d5cd8-7d26-40dd-8e30-e1bbe776ec71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:56:23.156416 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d5cd8-7d26-40dd-8e30-e1bbe776ec71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:23.157907 dv-cinder-837165-3-smb devstack@keystone.service[80175]: WARNING py.warnings [None req-351d5cd8-7d26-40dd-8e30-e1bbe776ec71 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:56:23.157907 dv-cinder-837165-3-smb devstack@keystone.service[80175]: warnings.warn(msg) Jun 16 14:56:23.157907 dv-cinder-837165-3-smb devstack@keystone.service[80175]: Jun 16 14:56:23.158954 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d5cd8-7d26-40dd-8e30-e1bbe776ec71 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:23.188995 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 764/1545] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:56:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:56:23.201243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d5cd8-7d26-40dd-8e30-e1bbe776ec71 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:23.202175 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 782/1546] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:23 2022] POST /identity/v3/projects => generated 391 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:23.217219 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d5cd8-7d26-40dd-8e30-e1bbe776ec71 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:23.219523 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f86fe0-b4bb-4dd8-871a-7dd3dab1ca7b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:23.327794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319eb4a-1f1b-412c-b758-aa60ebe050dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:23.327794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319eb4a-1f1b-412c-b758-aa60ebe050dd admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:23.327794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319eb4a-1f1b-412c-b758-aa60ebe050dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:23.327794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319eb4a-1f1b-412c-b758-aa60ebe050dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:23.328201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319eb4a-1f1b-412c-b758-aa60ebe050dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:23.328201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319eb4a-1f1b-412c-b758-aa60ebe050dd admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:23.403449 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 765/1547] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:23 2022] POST /identity/v3/projects => generated 373 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:23.404092 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f86fe0-b4bb-4dd8-871a-7dd3dab1ca7b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:23.407210 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319eb4a-1f1b-412c-b758-aa60ebe050dd admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:23.531985 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319eb4a-1f1b-412c-b758-aa60ebe050dd admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:23.550230 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b7a3a-333b-4ff7-bb80-3440f0b3dc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:23.550954 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b7a3a-333b-4ff7-bb80-3440f0b3dc28 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:23.551279 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b7a3a-333b-4ff7-bb80-3440f0b3dc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:23.551500 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b7a3a-333b-4ff7-bb80-3440f0b3dc28 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:23.552510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b7a3a-333b-4ff7-bb80-3440f0b3dc28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:23.554006 dv-cinder-837165-3-smb devstack@keystone.service[80175]: WARNING py.warnings [None req-df4b7a3a-333b-4ff7-bb80-3440f0b3dc28 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:56:23.554006 dv-cinder-837165-3-smb devstack@keystone.service[80175]: warnings.warn(msg) Jun 16 14:56:23.554006 dv-cinder-837165-3-smb devstack@keystone.service[80175]: Jun 16 14:56:23.555253 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b7a3a-333b-4ff7-bb80-3440f0b3dc28 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:23.568352 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893bf1ed-c5e6-46e4-9d71-eae9d283a169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:23.568352 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893bf1ed-c5e6-46e4-9d71-eae9d283a169 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:23.568352 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893bf1ed-c5e6-46e4-9d71-eae9d283a169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:23.568687 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893bf1ed-c5e6-46e4-9d71-eae9d283a169 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:23.569336 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893bf1ed-c5e6-46e4-9d71-eae9d283a169 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:23.572879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893bf1ed-c5e6-46e4-9d71-eae9d283a169 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:23.606497 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 766/1548] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:23 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:56:23.608243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45292c8d-af54-4347-bec3-d09e2ef6ab6e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:23.608520 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45292c8d-af54-4347-bec3-d09e2ef6ab6e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:23.608798 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45292c8d-af54-4347-bec3-d09e2ef6ab6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:23.628424 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 783/1549] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:23 2022] POST /identity/v3/users => generated 296 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:56:23.629406 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893bf1ed-c5e6-46e4-9d71-eae9d283a169 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:23.643999 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-45292c8d-af54-4347-bec3-d09e2ef6ab6e None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:23.645233 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-45292c8d-af54-4347-bec3-d09e2ef6ab6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:23.654882 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893bf1ed-c5e6-46e4-9d71-eae9d283a169 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:23.665957 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689602f2-1b68-4559-8a1d-dd66333fc2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:23.666215 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 767/1550] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:23.666716 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689602f2-1b68-4559-8a1d-dd66333fc2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:23.666992 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689602f2-1b68-4559-8a1d-dd66333fc2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:23.667303 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689602f2-1b68-4559-8a1d-dd66333fc2e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:23.667428 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45292c8d-af54-4347-bec3-d09e2ef6ab6e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:23.668636 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689602f2-1b68-4559-8a1d-dd66333fc2e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:23.670351 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689602f2-1b68-4559-8a1d-dd66333fc2e6 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:23.690004 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45292c8d-af54-4347-bec3-d09e2ef6ab6e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:23.692425 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 784/1551] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:23.694310 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeca75a-e79e-4de9-859f-e374d038f6f7 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:23.694698 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeca75a-e79e-4de9-859f-e374d038f6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:23.695157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeca75a-e79e-4de9-859f-e374d038f6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:23.698108 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5881c67-fe43-4af8-96c8-c9a725ec5f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:23.698789 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5881c67-fe43-4af8-96c8-c9a725ec5f51 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:23.699070 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5881c67-fe43-4af8-96c8-c9a725ec5f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:23.699344 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5881c67-fe43-4af8-96c8-c9a725ec5f51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:23.700110 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5881c67-fe43-4af8-96c8-c9a725ec5f51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:23.701737 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5881c67-fe43-4af8-96c8-c9a725ec5f51 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:23.722896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 768/1552] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:23.724236 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-beeca75a-e79e-4de9-859f-e374d038f6f7 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:23.725478 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-beeca75a-e79e-4de9-859f-e374d038f6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:23.729089 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2e6bf-cf07-48b8-98b2-2d4f7681775f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:23.729382 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2e6bf-cf07-48b8-98b2-2d4f7681775f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:23.729663 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2e6bf-cf07-48b8-98b2-2d4f7681775f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:23.738746 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 785/1553] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:23.739748 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeca75a-e79e-4de9-859f-e374d038f6f7 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:23.749391 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-24c2e6bf-cf07-48b8-98b2-2d4f7681775f None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:23.750691 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-24c2e6bf-cf07-48b8-98b2-2d4f7681775f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:23.751812 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeca75a-e79e-4de9-859f-e374d038f6f7 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:23.756804 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fca1da-956e-43d5-81c7-aba472060720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:23.757476 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fca1da-956e-43d5-81c7-aba472060720 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:23.757761 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fca1da-956e-43d5-81c7-aba472060720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:23.758036 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fca1da-956e-43d5-81c7-aba472060720 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:23.758736 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 769/1554] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:23.758945 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fca1da-956e-43d5-81c7-aba472060720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:23.760390 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bb5e7-f5d4-4892-836b-a9c111d9faab None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:23.760671 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bb5e7-f5d4-4892-836b-a9c111d9faab None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:23.760945 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bb5e7-f5d4-4892-836b-a9c111d9faab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:23.764631 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fca1da-956e-43d5-81c7-aba472060720 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:23.776590 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 786/1555] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:23.779367 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f0009-3452-477d-8c00-46f6f2dff851 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:23.779828 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f0009-3452-477d-8c00-46f6f2dff851 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:23.780708 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f0009-3452-477d-8c00-46f6f2dff851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:23.783859 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-fe2bb5e7-f5d4-4892-836b-a9c111d9faab None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:23.785105 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fe2bb5e7-f5d4-4892-836b-a9c111d9faab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:23.793230 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 770/1556] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:23.794113 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2bb5e7-f5d4-4892-836b-a9c111d9faab None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:23.804096 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2bb5e7-f5d4-4892-836b-a9c111d9faab None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:23.806463 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-054f0009-3452-477d-8c00-46f6f2dff851 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:23.807738 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-054f0009-3452-477d-8c00-46f6f2dff851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:23.810062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c620211-2722-4bcf-9387-fac15146f354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:23.811185 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c620211-2722-4bcf-9387-fac15146f354 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:23.811680 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c620211-2722-4bcf-9387-fac15146f354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:23.812186 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c620211-2722-4bcf-9387-fac15146f354 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:23.814017 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c620211-2722-4bcf-9387-fac15146f354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:23.816629 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 787/1557] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:23.816914 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c620211-2722-4bcf-9387-fac15146f354 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:23.818012 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c42377-8fab-48d4-a9cf-26332bb25b8c None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:23.818301 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c42377-8fab-48d4-a9cf-26332bb25b8c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:23.818575 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c42377-8fab-48d4-a9cf-26332bb25b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:23.832625 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 771/1558] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:23.832625 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c620211-2722-4bcf-9387-fac15146f354 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:23.846189 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-79c42377-8fab-48d4-a9cf-26332bb25b8c None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:23.846785 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c620211-2722-4bcf-9387-fac15146f354 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:23.847404 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-79c42377-8fab-48d4-a9cf-26332bb25b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:23.852081 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeefbd4-9038-4c04-95ae-859a51cac4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:23.852751 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeefbd4-9038-4c04-95ae-859a51cac4ac admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:23.853033 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeefbd4-9038-4c04-95ae-859a51cac4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:23.853307 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeefbd4-9038-4c04-95ae-859a51cac4ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:23.854033 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeefbd4-9038-4c04-95ae-859a51cac4ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:56:23.854340 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeefbd4-9038-4c04-95ae-859a51cac4ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:23.855742 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 788/1559] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:23.857016 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b77ffe-6aca-4f47-8f95-91a0f2f439f5 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:23.857499 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b77ffe-6aca-4f47-8f95-91a0f2f439f5 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:23.857634 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b77ffe-6aca-4f47-8f95-91a0f2f439f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:23.864701 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeefbd4-9038-4c04-95ae-859a51cac4ac admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:23.866563 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:23.870666 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:23.877860 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-e0b77ffe-6aca-4f47-8f95-91a0f2f439f5 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:23.879403 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e0b77ffe-6aca-4f47-8f95-91a0f2f439f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:23.881244 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 772/1560] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:56:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:56:23.882778 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e644c51-1b9f-48d3-baa8-1f775af3153c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:23.882997 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e644c51-1b9f-48d3-baa8-1f775af3153c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:23.883273 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e644c51-1b9f-48d3-baa8-1f775af3153c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:23.887617 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 789/1561] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:23.896832 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b77ffe-6aca-4f47-8f95-91a0f2f439f5 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:23.903073 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5e644c51-1b9f-48d3-baa8-1f775af3153c None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:23.904389 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5e644c51-1b9f-48d3-baa8-1f775af3153c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:23.907177 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b77ffe-6aca-4f47-8f95-91a0f2f439f5 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:23.911894 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96709b52-4104-4255-b2fa-a92dbbdfcbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:23.912808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96709b52-4104-4255-b2fa-a92dbbdfcbca admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:23.912978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 773/1562] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:23.913434 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96709b52-4104-4255-b2fa-a92dbbdfcbca admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:23.913735 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96709b52-4104-4255-b2fa-a92dbbdfcbca admin admin] PATH_INFO: `/v3/projects/77da8bacb8624e2784a8b76d8d0c681e/users/fcf4405d7282434c8e01821dd39d0987/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:23.914462 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a5b87-5e18-4e51-82dc-4a7f24c31859 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:23.914757 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a5b87-5e18-4e51-82dc-4a7f24c31859 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:23.915028 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a5b87-5e18-4e51-82dc-4a7f24c31859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:23.930000 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96709b52-4104-4255-b2fa-a92dbbdfcbca admin admin] RBAC: Authorizing `identity:create_grant(project_id=77da8bacb8624e2784a8b76d8d0c681e, user_id=fcf4405d7282434c8e01821dd39d0987, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:23.931215 dv-cinder-837165-3-smb devstack@keystone.service[80176]: WARNING py.warnings [None req-96709b52-4104-4255-b2fa-a92dbbdfcbca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:56:23.931215 dv-cinder-837165-3-smb devstack@keystone.service[80176]: warnings.warn(msg) Jun 16 14:56:23.931215 dv-cinder-837165-3-smb devstack@keystone.service[80176]: Jun 16 14:56:23.933654 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-422a5b87-5e18-4e51-82dc-4a7f24c31859 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:23.934043 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96709b52-4104-4255-b2fa-a92dbbdfcbca admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:23.934882 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-422a5b87-5e18-4e51-82dc-4a7f24c31859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:23.950153 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 774/1563] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:23.950153 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e58226-ba00-469e-8c14-4f9c4e61d3ee None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:23.950153 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e58226-ba00-469e-8c14-4f9c4e61d3ee None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:23.950153 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e58226-ba00-469e-8c14-4f9c4e61d3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:23.950946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 790/1564] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:23 2022] PUT /identity/v3/projects/77da8bacb8624e2784a8b76d8d0c681e/users/fcf4405d7282434c8e01821dd39d0987/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:23.951660 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96709b52-4104-4255-b2fa-a92dbbdfcbca admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:23.975352 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-80e58226-ba00-469e-8c14-4f9c4e61d3ee None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:23.977073 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-80e58226-ba00-469e-8c14-4f9c4e61d3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:24.023448 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96709b52-4104-4255-b2fa-a92dbbdfcbca admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:24.029786 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58d045-36ac-48b7-a6ee-b2108d73c9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:24.030664 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58d045-36ac-48b7-a6ee-b2108d73c9f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:24.030962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58d045-36ac-48b7-a6ee-b2108d73c9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:24.031243 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58d045-36ac-48b7-a6ee-b2108d73c9f8 admin admin] PATH_INFO: `/v3/projects/22dc3a026fe4422587250fa88aa14141/users/4e10f63b54224607996ab53536ad00d9/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:24.048500 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58d045-36ac-48b7-a6ee-b2108d73c9f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22dc3a026fe4422587250fa88aa14141, user_id=4e10f63b54224607996ab53536ad00d9, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:24.048934 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 775/1565] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:24.050276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbe8fa-2ebf-41ea-89e8-cf2e2c62ee42 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:24.050566 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbe8fa-2ebf-41ea-89e8-cf2e2c62ee42 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:24.050845 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbe8fa-2ebf-41ea-89e8-cf2e2c62ee42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:24.054831 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58d045-36ac-48b7-a6ee-b2108d73c9f8 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:24.069824 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-83dbe8fa-2ebf-41ea-89e8-cf2e2c62ee42 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:24.070091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 791/1566] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:23 2022] PUT /identity/v3/projects/22dc3a026fe4422587250fa88aa14141/users/4e10f63b54224607996ab53536ad00d9/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:24.070683 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58d045-36ac-48b7-a6ee-b2108d73c9f8 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:24.071094 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-83dbe8fa-2ebf-41ea-89e8-cf2e2c62ee42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:24.136535 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 776/1567] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:24.137860 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ceccf0-153a-46bc-9100-e86c5ed6e841 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:24.138147 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ceccf0-153a-46bc-9100-e86c5ed6e841 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:24.138340 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58d045-36ac-48b7-a6ee-b2108d73c9f8 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:24.138465 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ceccf0-153a-46bc-9100-e86c5ed6e841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:24.143598 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc06e25-d5ea-4207-bee0-866732785ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:24.144532 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc06e25-d5ea-4207-bee0-866732785ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:24.144816 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc06e25-d5ea-4207-bee0-866732785ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:24.145107 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc06e25-d5ea-4207-bee0-866732785ea6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:24.146113 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc06e25-d5ea-4207-bee0-866732785ea6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:24.148125 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc06e25-d5ea-4207-bee0-866732785ea6 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:24.158512 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f9ceccf0-153a-46bc-9100-e86c5ed6e841 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:24.159646 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f9ceccf0-153a-46bc-9100-e86c5ed6e841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:24.169897 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 777/1568] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:24.170747 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ceccf0-153a-46bc-9100-e86c5ed6e841 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:24.181171 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ceccf0-153a-46bc-9100-e86c5ed6e841 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:24.186172 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8824a-fbc5-4ec2-9c26-d193f161a0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:24.186367 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 792/1569] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:24 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:24.187164 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc06e25-d5ea-4207-bee0-866732785ea6 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:24.187601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8824a-fbc5-4ec2-9c26-d193f161a0ec admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:24.192201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8824a-fbc5-4ec2-9c26-d193f161a0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:24.192579 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8824a-fbc5-4ec2-9c26-d193f161a0ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:24.193490 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd8824a-fbc5-4ec2-9c26-d193f161a0ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:56:24.193808 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd8824a-fbc5-4ec2-9c26-d193f161a0ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:24.195456 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd8824a-fbc5-4ec2-9c26-d193f161a0ec admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:24.209606 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 778/1570] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:56:24.210934 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcf6ba-39d5-47a2-81b2-3585b9400b25 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:24.211215 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcf6ba-39d5-47a2-81b2-3585b9400b25 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:24.211503 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcf6ba-39d5-47a2-81b2-3585b9400b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:24.237722 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:24.251665 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-13bcf6ba-39d5-47a2-81b2-3585b9400b25 None None] MFA Rules not processed for user `fcf4405d7282434c8e01821dd39d0987`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:24.253172 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-13bcf6ba-39d5-47a2-81b2-3585b9400b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:24.257115 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc06e25-d5ea-4207-bee0-866732785ea6 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:24.262578 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896308b-0f91-4db2-b55a-17376feb3183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:24.263453 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896308b-0f91-4db2-b55a-17376feb3183 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:24.263732 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896308b-0f91-4db2-b55a-17376feb3183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:24.264047 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896308b-0f91-4db2-b55a-17376feb3183 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:24.264786 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896308b-0f91-4db2-b55a-17376feb3183 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:56:24.265097 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896308b-0f91-4db2-b55a-17376feb3183 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:24.267264 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896308b-0f91-4db2-b55a-17376feb3183 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:24.280940 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 793/1571] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:56:24.282170 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896308b-0f91-4db2-b55a-17376feb3183 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:24.293286 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896308b-0f91-4db2-b55a-17376feb3183 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:24.299333 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9368a-11e1-43bd-83d9-9179506a422d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:24.300062 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9368a-11e1-43bd-83d9-9179506a422d admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:24.300320 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9368a-11e1-43bd-83d9-9179506a422d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:24.300618 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9368a-11e1-43bd-83d9-9179506a422d admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:24.301342 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9368a-11e1-43bd-83d9-9179506a422d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:56:24.301648 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9368a-11e1-43bd-83d9-9179506a422d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:24.303258 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9368a-11e1-43bd-83d9-9179506a422d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:24.315830 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 794/1572] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:56:24.317690 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:24.318683 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcb3ce-002d-406c-92e0-bd6df5688ef1 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:24.319195 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcb3ce-002d-406c-92e0-bd6df5688ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:24.319317 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcb3ce-002d-406c-92e0-bd6df5688ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:24.338803 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-44bcb3ce-002d-406c-92e0-bd6df5688ef1 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:24.340080 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-44bcb3ce-002d-406c-92e0-bd6df5688ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:24.342801 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 779/1573] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:24.343711 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bcf6ba-39d5-47a2-81b2-3585b9400b25 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:24.349167 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 795/1574] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:24.350001 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bcb3ce-002d-406c-92e0-bd6df5688ef1 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:24.360745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bcb3ce-002d-406c-92e0-bd6df5688ef1 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:24.362347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bcf6ba-39d5-47a2-81b2-3585b9400b25 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:24.366589 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206cbb7-1629-4064-8ba5-0ab761c0077d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:24.367264 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206cbb7-1629-4064-8ba5-0ab761c0077d admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:24.367604 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206cbb7-1629-4064-8ba5-0ab761c0077d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:24.367821 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206cbb7-1629-4064-8ba5-0ab761c0077d admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:24.368117 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529dee8-7ff8-47d8-be5a-12b1f85e1827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:24.368594 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206cbb7-1629-4064-8ba5-0ab761c0077d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:56:24.368847 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529dee8-7ff8-47d8-be5a-12b1f85e1827 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:24.368985 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206cbb7-1629-4064-8ba5-0ab761c0077d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:24.369072 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529dee8-7ff8-47d8-be5a-12b1f85e1827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:24.369334 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529dee8-7ff8-47d8-be5a-12b1f85e1827 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:24.370050 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529dee8-7ff8-47d8-be5a-12b1f85e1827 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:56:24.370359 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529dee8-7ff8-47d8-be5a-12b1f85e1827 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:24.370628 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206cbb7-1629-4064-8ba5-0ab761c0077d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:24.372002 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529dee8-7ff8-47d8-be5a-12b1f85e1827 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:24.384574 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 780/1575] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:56:24.385254 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 796/1576] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:56:24.386333 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206cbb7-1629-4064-8ba5-0ab761c0077d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:24.388496 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529dee8-7ff8-47d8-be5a-12b1f85e1827 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:24.397729 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206cbb7-1629-4064-8ba5-0ab761c0077d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:24.403047 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbbfdf-4d5c-4d1b-ae29-729ce5673cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:24.403720 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529dee8-7ff8-47d8-be5a-12b1f85e1827 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:24.404030 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbbfdf-4d5c-4d1b-ae29-729ce5673cae admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:24.404202 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbbfdf-4d5c-4d1b-ae29-729ce5673cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:24.404350 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbbfdf-4d5c-4d1b-ae29-729ce5673cae admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:24.405025 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcbbfdf-4d5c-4d1b-ae29-729ce5673cae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:24.407052 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcbbfdf-4d5c-4d1b-ae29-729ce5673cae admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:24.409543 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd55272-1ca4-49b5-9a06-a9c7927cf208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:24.410165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd55272-1ca4-49b5-9a06-a9c7927cf208 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:24.410770 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd55272-1ca4-49b5-9a06-a9c7927cf208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:24.411081 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd55272-1ca4-49b5-9a06-a9c7927cf208 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:24.412274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd55272-1ca4-49b5-9a06-a9c7927cf208 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:24.414597 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd55272-1ca4-49b5-9a06-a9c7927cf208 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:24.440665 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 781/1577] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:24 2022] POST /identity/v3/users => generated 293 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:24.440665 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd55272-1ca4-49b5-9a06-a9c7927cf208 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:24.449833 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 797/1578] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:24 2022] POST /identity/v3/projects => generated 389 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:24.451011 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbbfdf-4d5c-4d1b-ae29-729ce5673cae admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:24.453460 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd55272-1ca4-49b5-9a06-a9c7927cf208 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:24.513922 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ba010-889c-4597-b6e3-408931b39149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:24.514598 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ba010-889c-4597-b6e3-408931b39149 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:24.514867 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ba010-889c-4597-b6e3-408931b39149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:24.515147 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ba010-889c-4597-b6e3-408931b39149 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:24.515838 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ba010-889c-4597-b6e3-408931b39149 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:24.516514 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbbfdf-4d5c-4d1b-ae29-729ce5673cae admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:24.517855 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ba010-889c-4597-b6e3-408931b39149 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:24.525557 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879767f8-8022-44e0-98ac-a5365bc31a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:24.526208 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879767f8-8022-44e0-98ac-a5365bc31a0b admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:24.526623 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879767f8-8022-44e0-98ac-a5365bc31a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:24.526900 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879767f8-8022-44e0-98ac-a5365bc31a0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:24.527627 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879767f8-8022-44e0-98ac-a5365bc31a0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:24.529592 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879767f8-8022-44e0-98ac-a5365bc31a0b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:24.555809 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 782/1579] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:24 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:24.558507 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 798/1580] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:24 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:24.560880 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ba010-889c-4597-b6e3-408931b39149 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:24.562058 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956a556-03fe-42c1-b006-45d667461f3c None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:24.562375 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956a556-03fe-42c1-b006-45d667461f3c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:24.562658 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956a556-03fe-42c1-b006-45d667461f3c None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:24.564363 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b72ba010-889c-4597-b6e3-408931b39149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:24.564487 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 799/1581] 10.222.0.85 () {54 vars in 961 bytes} [Thu Jun 16 14:56:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:56:24.565065 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956a556-03fe-42c1-b006-45d667461f3c None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:24.638527 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ba010-889c-4597-b6e3-408931b39149 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:24.641366 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956a556-03fe-42c1-b006-45d667461f3c None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:24.645961 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab56e0-a413-4514-b035-e99d274e4285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:24.646621 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab56e0-a413-4514-b035-e99d274e4285 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:24.646902 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab56e0-a413-4514-b035-e99d274e4285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:24.647176 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab56e0-a413-4514-b035-e99d274e4285 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:24.647882 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab56e0-a413-4514-b035-e99d274e4285 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:24.649826 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab56e0-a413-4514-b035-e99d274e4285 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:24.664645 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:24.681744 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 800/1582] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:24 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:24.682841 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab56e0-a413-4514-b035-e99d274e4285 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:24.692744 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fceec-c7b9-4b60-917d-bfed49b0f2f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:24.693416 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fceec-c7b9-4b60-917d-bfed49b0f2f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:24.693739 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fceec-c7b9-4b60-917d-bfed49b0f2f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:24.694160 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fceec-c7b9-4b60-917d-bfed49b0f2f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:24.706322 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2fceec-c7b9-4b60-917d-bfed49b0f2f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:24.709941 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2fceec-c7b9-4b60-917d-bfed49b0f2f1 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:24.722702 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 783/1583] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:24.723677 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fceec-c7b9-4b60-917d-bfed49b0f2f1 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:24.729854 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:24.734270 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fceec-c7b9-4b60-917d-bfed49b0f2f1 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:24.757874 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab56e0-a413-4514-b035-e99d274e4285 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:24.762978 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398774a8-9014-4e6b-a8e4-c24526afa304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:24.763982 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398774a8-9014-4e6b-a8e4-c24526afa304 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:24.764915 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398774a8-9014-4e6b-a8e4-c24526afa304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:24.765441 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398774a8-9014-4e6b-a8e4-c24526afa304 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:24.766966 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398774a8-9014-4e6b-a8e4-c24526afa304 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:24.769991 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398774a8-9014-4e6b-a8e4-c24526afa304 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:24.799854 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8e092-1808-49e8-a999-f740b7eb93a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:24.800653 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8e092-1808-49e8-a999-f740b7eb93a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:24.800879 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8e092-1808-49e8-a999-f740b7eb93a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:24.801155 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8e092-1808-49e8-a999-f740b7eb93a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:24.801923 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb8e092-1808-49e8-a999-f740b7eb93a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:24.803792 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb8e092-1808-49e8-a999-f740b7eb93a3 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:24.806790 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 801/1584] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:24 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:24.807774 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398774a8-9014-4e6b-a8e4-c24526afa304 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:24.816158 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 784/1585] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:24.817201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8e092-1808-49e8-a999-f740b7eb93a3 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:24.829085 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8e092-1808-49e8-a999-f740b7eb93a3 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:24.898545 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398774a8-9014-4e6b-a8e4-c24526afa304 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:24.912118 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6693b-c5bc-4899-8b6c-f544751d60a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:24.912118 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6693b-c5bc-4899-8b6c-f544751d60a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:24.912118 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6693b-c5bc-4899-8b6c-f544751d60a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:24.912118 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6693b-c5bc-4899-8b6c-f544751d60a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:24.913686 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6693b-c5bc-4899-8b6c-f544751d60a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:24.913686 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6693b-c5bc-4899-8b6c-f544751d60a8 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:24.917471 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73775ff3-455f-4a27-bb78-3740f49c6c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:24.918802 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73775ff3-455f-4a27-bb78-3740f49c6c6a admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:24.918993 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73775ff3-455f-4a27-bb78-3740f49c6c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:24.919236 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73775ff3-455f-4a27-bb78-3740f49c6c6a admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:24.922143 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73775ff3-455f-4a27-bb78-3740f49c6c6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:24.926350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73775ff3-455f-4a27-bb78-3740f49c6c6a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:24.946336 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 802/1586] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:24 2022] POST /identity/v3/users => generated 295 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:24.946336 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6693b-c5bc-4899-8b6c-f544751d60a8 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:24.952157 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 785/1587] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:24 2022] POST /identity/v3/users => generated 287 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:24.953874 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715af9b-97bc-41ff-ba30-cbff8c29a740 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:24.954370 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715af9b-97bc-41ff-ba30-cbff8c29a740 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:24.954732 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715af9b-97bc-41ff-ba30-cbff8c29a740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:24.964092 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6693b-c5bc-4899-8b6c-f544751d60a8 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:24.971933 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2e0bb-7971-4304-ae48-df88754d8342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:24.972976 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2e0bb-7971-4304-ae48-df88754d8342 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:24.973367 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2e0bb-7971-4304-ae48-df88754d8342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:24.973670 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2e0bb-7971-4304-ae48-df88754d8342 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:24.973887 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d715af9b-97bc-41ff-ba30-cbff8c29a740 None None] MFA Rules not processed for user `c74e4d1bdaa64ed280cc5f4c8e79b842`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:24.974513 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2e0bb-7971-4304-ae48-df88754d8342 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:24.975113 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d715af9b-97bc-41ff-ba30-cbff8c29a740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:24.976632 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2e0bb-7971-4304-ae48-df88754d8342 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:25.008719 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 803/1588] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:24 2022] POST /identity/v3/users => generated 293 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:25.010275 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2e0bb-7971-4304-ae48-df88754d8342 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:25.022647 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2e0bb-7971-4304-ae48-df88754d8342 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:25.029503 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61b9ae-589f-4dba-b564-0b6eb880af29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:25.030614 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61b9ae-589f-4dba-b564-0b6eb880af29 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:25.031106 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61b9ae-589f-4dba-b564-0b6eb880af29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:25.031574 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61b9ae-589f-4dba-b564-0b6eb880af29 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:25.032827 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61b9ae-589f-4dba-b564-0b6eb880af29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:25.036316 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61b9ae-589f-4dba-b564-0b6eb880af29 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:25.070250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 804/1589] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:25 2022] POST /identity/v3/users => generated 286 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:25.074438 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61b9ae-589f-4dba-b564-0b6eb880af29 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:25.079750 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 786/1590] 10.222.0.85 () {58 vars in 1058 bytes} [Thu Jun 16 14:56:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:25.087001 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61b9ae-589f-4dba-b564-0b6eb880af29 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:25.088783 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715af9b-97bc-41ff-ba30-cbff8c29a740 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:25.096638 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0fd34-b1b4-4891-ad7a-27bc05a62f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:25.096963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0fd34-b1b4-4891-ad7a-27bc05a62f06 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:25.097130 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0fd34-b1b4-4891-ad7a-27bc05a62f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:25.097292 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0fd34-b1b4-4891-ad7a-27bc05a62f06 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:25.097981 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0fd34-b1b4-4891-ad7a-27bc05a62f06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:25.099955 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0fd34-b1b4-4891-ad7a-27bc05a62f06 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:25.102703 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715af9b-97bc-41ff-ba30-cbff8c29a740 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:25.108099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33711b4-c491-4a7d-9a6a-0972683da4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:25.109118 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33711b4-c491-4a7d-9a6a-0972683da4fb admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:25.109608 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33711b4-c491-4a7d-9a6a-0972683da4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:25.110230 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33711b4-c491-4a7d-9a6a-0972683da4fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:25.111270 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33711b4-c491-4a7d-9a6a-0972683da4fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:25.113237 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33711b4-c491-4a7d-9a6a-0972683da4fb admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:25.126409 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 805/1591] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:25 2022] POST /identity/v3/users => generated 288 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:25.127667 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0fd34-b1b4-4891-ad7a-27bc05a62f06 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:25.142995 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0fd34-b1b4-4891-ad7a-27bc05a62f06 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:25.146146 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 787/1592] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:25.148661 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33711b4-c491-4a7d-9a6a-0972683da4fb admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:25.149186 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2bb4af-36e0-44d9-8801-afa24d5f01f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:25.150110 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2bb4af-36e0-44d9-8801-afa24d5f01f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:25.150813 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2bb4af-36e0-44d9-8801-afa24d5f01f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:25.151257 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2bb4af-36e0-44d9-8801-afa24d5f01f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:25.152188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2bb4af-36e0-44d9-8801-afa24d5f01f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:25.154072 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2bb4af-36e0-44d9-8801-afa24d5f01f5 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:25.167435 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 806/1593] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:25.168781 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2bb4af-36e0-44d9-8801-afa24d5f01f5 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:25.171301 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33711b4-c491-4a7d-9a6a-0972683da4fb admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:25.179004 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:INSERT=14,keystone:SELECT=86 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:25.185402 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2bb4af-36e0-44d9-8801-afa24d5f01f5 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:25.185665 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f4e98-80eb-4a9d-b563-452b8f570aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:25.198195 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f4e98-80eb-4a9d-b563-452b8f570aed admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:25.198820 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f4e98-80eb-4a9d-b563-452b8f570aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:25.199333 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f4e98-80eb-4a9d-b563-452b8f570aed admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:25.200214 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfca90-47de-4676-9762-4e6420a20c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:25.201291 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfca90-47de-4676-9762-4e6420a20c11 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:25.201426 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f4e98-80eb-4a9d-b563-452b8f570aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:25.202111 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfca90-47de-4676-9762-4e6420a20c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:25.202843 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfca90-47de-4676-9762-4e6420a20c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:25.204574 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bfca90-47de-4676-9762-4e6420a20c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:25.208766 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bfca90-47de-4676-9762-4e6420a20c11 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:25.210702 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f4e98-80eb-4a9d-b563-452b8f570aed admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:25.221474 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:25.229024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 807/1594] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:25.230378 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfca90-47de-4676-9762-4e6420a20c11 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:25.242244 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 788/1595] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:25.243101 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f4e98-80eb-4a9d-b563-452b8f570aed admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:25.250221 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfca90-47de-4676-9762-4e6420a20c11 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:25.256703 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175cc3d2-dd59-4a03-a7b4-88b7cb7158d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:25.257743 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cc3d2-dd59-4a03-a7b4-88b7cb7158d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:25.258173 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f4e98-80eb-4a9d-b563-452b8f570aed admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:25.258562 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cc3d2-dd59-4a03-a7b4-88b7cb7158d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:25.259146 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cc3d2-dd59-4a03-a7b4-88b7cb7158d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:25.260157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175cc3d2-dd59-4a03-a7b4-88b7cb7158d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:25.262166 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175cc3d2-dd59-4a03-a7b4-88b7cb7158d0 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:25.269635 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698677c-cef0-4824-946e-057df6b5589a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:25.270456 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698677c-cef0-4824-946e-057df6b5589a service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:25.270770 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698677c-cef0-4824-946e-057df6b5589a service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:25.271256 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698677c-cef0-4824-946e-057df6b5589a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:25.280821 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 808/1596] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:25.282314 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175cc3d2-dd59-4a03-a7b4-88b7cb7158d0 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:25.295313 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175cc3d2-dd59-4a03-a7b4-88b7cb7158d0 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:25.303231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f589a8d-1a51-4038-b7fc-dee43c07d703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:25.304183 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f589a8d-1a51-4038-b7fc-dee43c07d703 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:25.304540 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f589a8d-1a51-4038-b7fc-dee43c07d703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:25.304883 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f589a8d-1a51-4038-b7fc-dee43c07d703 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:25.305688 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f589a8d-1a51-4038-b7fc-dee43c07d703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:25.307402 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f589a8d-1a51-4038-b7fc-dee43c07d703 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:25.323523 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 809/1597] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:25.323523 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f589a8d-1a51-4038-b7fc-dee43c07d703 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:25.333906 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f589a8d-1a51-4038-b7fc-dee43c07d703 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:25.339714 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ed631-c3b4-45f5-9a8d-cd8c671ebe59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:25.341109 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ed631-c3b4-45f5-9a8d-cd8c671ebe59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:25.341335 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ed631-c3b4-45f5-9a8d-cd8c671ebe59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:25.341719 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ed631-c3b4-45f5-9a8d-cd8c671ebe59 admin admin] PATH_INFO: `/v3/projects/e007c11ad5c84024a07784b54bf841d0/users/9f948930d58e4b278d144b2c94b5b096/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:25.359703 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ed631-c3b4-45f5-9a8d-cd8c671ebe59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e007c11ad5c84024a07784b54bf841d0, user_id=9f948930d58e4b278d144b2c94b5b096, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:25.362882 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ed631-c3b4-45f5-9a8d-cd8c671ebe59 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:25.367550 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698677c-cef0-4824-946e-057df6b5589a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:25.369574 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698677c-cef0-4824-946e-057df6b5589a service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:25.389262 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 789/1599] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:25.389262 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698677c-cef0-4824-946e-057df6b5589a service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:25.389545 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 810/1599] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:25 2022] PUT /identity/v3/projects/e007c11ad5c84024a07784b54bf841d0/users/9f948930d58e4b278d144b2c94b5b096/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:25.389545 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ed631-c3b4-45f5-9a8d-cd8c671ebe59 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:25.399741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698677c-cef0-4824-946e-057df6b5589a service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:25.475960 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ed631-c3b4-45f5-9a8d-cd8c671ebe59 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:25.481706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e630d20-5397-4159-9d04-dfa0a7dad901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:25.482668 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e630d20-5397-4159-9d04-dfa0a7dad901 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:25.483137 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e630d20-5397-4159-9d04-dfa0a7dad901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:25.483416 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d855db1-93e3-413b-a5f7-cf972c9a9714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:25.483851 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e630d20-5397-4159-9d04-dfa0a7dad901 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:25.484214 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d855db1-93e3-413b-a5f7-cf972c9a9714 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:25.485150 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e630d20-5397-4159-9d04-dfa0a7dad901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:25.485445 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d855db1-93e3-413b-a5f7-cf972c9a9714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:25.485737 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d855db1-93e3-413b-a5f7-cf972c9a9714 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:25.486639 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d855db1-93e3-413b-a5f7-cf972c9a9714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:25.487706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e630d20-5397-4159-9d04-dfa0a7dad901 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:25.488615 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d855db1-93e3-413b-a5f7-cf972c9a9714 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:25.500666 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 811/1600] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:25.501447 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 790/1601] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:25.502229 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e630d20-5397-4159-9d04-dfa0a7dad901 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:25.502362 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d855db1-93e3-413b-a5f7-cf972c9a9714 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:25.513915 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e630d20-5397-4159-9d04-dfa0a7dad901 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:25.526157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d323fb-d16e-4a6f-8bab-929fccfc094b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:25.526906 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d323fb-d16e-4a6f-8bab-929fccfc094b admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:25.527198 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d323fb-d16e-4a6f-8bab-929fccfc094b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:25.527475 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d323fb-d16e-4a6f-8bab-929fccfc094b admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:25.530394 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d323fb-d16e-4a6f-8bab-929fccfc094b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:25.533947 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d855db1-93e3-413b-a5f7-cf972c9a9714 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:25.536459 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d323fb-d16e-4a6f-8bab-929fccfc094b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:25.545650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c2dd0-9182-4c44-b7b7-e5a2450fbd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:25.546722 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c2dd0-9182-4c44-b7b7-e5a2450fbd32 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:25.547268 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c2dd0-9182-4c44-b7b7-e5a2450fbd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:25.548120 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c2dd0-9182-4c44-b7b7-e5a2450fbd32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:25.548826 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c2dd0-9182-4c44-b7b7-e5a2450fbd32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:25.550911 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c2dd0-9182-4c44-b7b7-e5a2450fbd32 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:25.556096 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 812/1602] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:25.557174 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d323fb-d16e-4a6f-8bab-929fccfc094b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:25.570023 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d323fb-d16e-4a6f-8bab-929fccfc094b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:25.571563 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 791/1603] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:25.573549 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555724fa-c910-4ed0-ac05-93d738e72cc3 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:25.574210 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555724fa-c910-4ed0-ac05-93d738e72cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:25.574789 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555724fa-c910-4ed0-ac05-93d738e72cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:25.576534 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d2e74-a9dd-4f0b-941b-a8b9303b9579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:25.577788 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d2e74-a9dd-4f0b-941b-a8b9303b9579 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:25.578143 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d2e74-a9dd-4f0b-941b-a8b9303b9579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:25.578531 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d2e74-a9dd-4f0b-941b-a8b9303b9579 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:25.580422 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d2e74-a9dd-4f0b-941b-a8b9303b9579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:25.584179 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d2e74-a9dd-4f0b-941b-a8b9303b9579 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:25.611420 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 813/1604] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:25.611420 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d2e74-a9dd-4f0b-941b-a8b9303b9579 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:25.627226 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d2e74-a9dd-4f0b-941b-a8b9303b9579 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:25.633366 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf639ee-97e8-4090-84b8-244e66807ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:25.634544 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf639ee-97e8-4090-84b8-244e66807ac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:25.634827 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf639ee-97e8-4090-84b8-244e66807ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:25.635323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf639ee-97e8-4090-84b8-244e66807ac9 admin admin] PATH_INFO: `/v3/projects/fdb9cd0a4bc9437db70e9b81c4f1b0d3/users/74029b3845b4408bb58332e21e801ba0/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:25.645076 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-555724fa-c910-4ed0-ac05-93d738e72cc3 None None] MFA Rules not processed for user `9f948930d58e4b278d144b2c94b5b096`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:25.646372 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-555724fa-c910-4ed0-ac05-93d738e72cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:25.659737 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf639ee-97e8-4090-84b8-244e66807ac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdb9cd0a4bc9437db70e9b81c4f1b0d3, user_id=74029b3845b4408bb58332e21e801ba0, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:25.664528 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf639ee-97e8-4090-84b8-244e66807ac9 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:25.690382 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 814/1605] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:25 2022] PUT /identity/v3/projects/fdb9cd0a4bc9437db70e9b81c4f1b0d3/users/74029b3845b4408bb58332e21e801ba0/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:25.693122 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf639ee-97e8-4090-84b8-244e66807ac9 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:25.748288 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 792/1606] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:25.749232 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555724fa-c910-4ed0-ac05-93d738e72cc3 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:25.775968 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:25.778957 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555724fa-c910-4ed0-ac05-93d738e72cc3 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:25.783299 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf639ee-97e8-4090-84b8-244e66807ac9 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:25.796606 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e650b6-94a5-444b-9ba0-e8e4b9240a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:25.797613 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e650b6-94a5-444b-9ba0-e8e4b9240a82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:25.797880 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e650b6-94a5-444b-9ba0-e8e4b9240a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:25.798166 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e650b6-94a5-444b-9ba0-e8e4b9240a82 admin admin] PATH_INFO: `/v3/projects/8293e9a7092d4757ba9dc795e3644b35/users/80e736205b5f4f4588f74b33624a5c15/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:25.800330 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299ca02-6d95-4955-9f20-0f9260c78e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:25.801369 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299ca02-6d95-4955-9f20-0f9260c78e76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:25.801658 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299ca02-6d95-4955-9f20-0f9260c78e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:25.801988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299ca02-6d95-4955-9f20-0f9260c78e76 admin admin] PATH_INFO: `/v3/projects/9dff4d873f8e4f2fb3f632f1a9fd8526/users/431f66d8c09d4eb194600509e7300bc2/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:25.819639 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2299ca02-6d95-4955-9f20-0f9260c78e76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dff4d873f8e4f2fb3f632f1a9fd8526, user_id=431f66d8c09d4eb194600509e7300bc2, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:25.823641 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:25.823843 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2299ca02-6d95-4955-9f20-0f9260c78e76 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:25.834115 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e650b6-94a5-444b-9ba0-e8e4b9240a82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8293e9a7092d4757ba9dc795e3644b35, user_id=80e736205b5f4f4588f74b33624a5c15, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:25.838030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e650b6-94a5-444b-9ba0-e8e4b9240a82 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:25.842966 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 815/1607] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:25 2022] PUT /identity/v3/projects/9dff4d873f8e4f2fb3f632f1a9fd8526/users/431f66d8c09d4eb194600509e7300bc2/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:25.843575 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299ca02-6d95-4955-9f20-0f9260c78e76 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:25.862927 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 793/1608] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:25 2022] PUT /identity/v3/projects/8293e9a7092d4757ba9dc795e3644b35/users/80e736205b5f4f4588f74b33624a5c15/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:25.865462 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e650b6-94a5-444b-9ba0-e8e4b9240a82 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:25.918845 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299ca02-6d95-4955-9f20-0f9260c78e76 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:25.958861 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e650b6-94a5-444b-9ba0-e8e4b9240a82 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:25.965221 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535da96-10ff-4383-a299-0101f9cea95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:25.966483 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535da96-10ff-4383-a299-0101f9cea95f admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:25.966779 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535da96-10ff-4383-a299-0101f9cea95f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:25.967080 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535da96-10ff-4383-a299-0101f9cea95f admin admin] PATH_INFO: `/v3/projects/a1aa0e2bd297461caf3c534080faeebb/users/a6d816e7e7834068b977e7feae661c15/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:25.983575 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f535da96-10ff-4383-a299-0101f9cea95f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1aa0e2bd297461caf3c534080faeebb, user_id=a6d816e7e7834068b977e7feae661c15, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:25.987160 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f535da96-10ff-4383-a299-0101f9cea95f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:25.989319 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf26f69-34e7-4d03-a26c-c00fbe0eeee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:25.990348 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf26f69-34e7-4d03-a26c-c00fbe0eeee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:25.990728 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf26f69-34e7-4d03-a26c-c00fbe0eeee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:25.991080 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf26f69-34e7-4d03-a26c-c00fbe0eeee5 admin admin] PATH_INFO: `/v3/projects/a069b7e822d3418885face6224f1ad32/users/7c01522e3a5c4e779ea2bc16aeeb04cd/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:26.004689 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 794/1609] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:25 2022] PUT /identity/v3/projects/a1aa0e2bd297461caf3c534080faeebb/users/a6d816e7e7834068b977e7feae661c15/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:26.007275 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be8952-4928-46cd-bb90-2354576bccf0 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:26.007950 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be8952-4928-46cd-bb90-2354576bccf0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:26.008620 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be8952-4928-46cd-bb90-2354576bccf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:26.010554 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf26f69-34e7-4d03-a26c-c00fbe0eeee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a069b7e822d3418885face6224f1ad32, user_id=7c01522e3a5c4e779ea2bc16aeeb04cd, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:26.013710 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf26f69-34e7-4d03-a26c-c00fbe0eeee5 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:26.030430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-00be8952-4928-46cd-bb90-2354576bccf0 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:26.032085 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 816/1610] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:25 2022] PUT /identity/v3/projects/a069b7e822d3418885face6224f1ad32/users/7c01522e3a5c4e779ea2bc16aeeb04cd/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:26.032566 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-00be8952-4928-46cd-bb90-2354576bccf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:26.033991 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f26e9-47de-477c-884d-48c353c19758 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:26.034349 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f26e9-47de-477c-884d-48c353c19758 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:26.034836 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f26e9-47de-477c-884d-48c353c19758 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:26.036432 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 817/1611] 10.222.0.85 () {54 vars in 912 bytes} [Thu Jun 16 14:56:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:56:26.037560 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba91f1a-f956-41b8-a72f-62f7bc42f722 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:26.038658 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba91f1a-f956-41b8-a72f-62f7bc42f722 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:26.039002 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba91f1a-f956-41b8-a72f-62f7bc42f722 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:26.046665 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 818/1612] 10.222.0.85 () {54 vars in 961 bytes} [Thu Jun 16 14:56:26 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:56:26.048773 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110b25b-2af3-4b57-b7b4-b5933a96bc34 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:26.049059 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110b25b-2af3-4b57-b7b4-b5933a96bc34 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:26.049335 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110b25b-2af3-4b57-b7b4-b5933a96bc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:26.067817 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-a110b25b-2af3-4b57-b7b4-b5933a96bc34 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:26.069225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a110b25b-2af3-4b57-b7b4-b5933a96bc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:26.112307 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 795/1613] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:26.116890 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced1849-095f-4539-8caa-809bc0fd8857 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:26.117176 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced1849-095f-4539-8caa-809bc0fd8857 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:26.117504 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced1849-095f-4539-8caa-809bc0fd8857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:26.140878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-6ced1849-095f-4539-8caa-809bc0fd8857 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:26.142014 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6ced1849-095f-4539-8caa-809bc0fd8857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:26.143629 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 819/1614] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:26.145240 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f8286-e4b3-4eae-ac12-01735eabfd97 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:26.145531 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f8286-e4b3-4eae-ac12-01735eabfd97 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:26.145817 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f8286-e4b3-4eae-ac12-01735eabfd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:26.161764 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 796/1615] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:26.163660 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882774f-9e13-4676-ae17-59cea57ccd0e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:26.164235 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882774f-9e13-4676-ae17-59cea57ccd0e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:26.172381 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882774f-9e13-4676-ae17-59cea57ccd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:26.176134 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:26.191370 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-3e9f8286-e4b3-4eae-ac12-01735eabfd97 None None] MFA Rules not processed for user `a6d816e7e7834068b977e7feae661c15`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:26.193122 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3e9f8286-e4b3-4eae-ac12-01735eabfd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:26.201614 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-0882774f-9e13-4676-ae17-59cea57ccd0e None None] MFA Rules not processed for user `c74e4d1bdaa64ed280cc5f4c8e79b842`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:26.203991 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0882774f-9e13-4676-ae17-59cea57ccd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:26.280672 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:26.298696 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 797/1616] 10.222.0.85 () {58 vars in 1009 bytes} [Thu Jun 16 14:56:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:26.300202 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688c863-2e94-4622-ae99-fcd8ec09e7fd None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:26.300665 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688c863-2e94-4622-ae99-fcd8ec09e7fd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:26.300951 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688c863-2e94-4622-ae99-fcd8ec09e7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:26.308260 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 820/1617] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:26.308260 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e142a59-9c54-4a33-b44e-e1b3a427345b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:26.308260 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e142a59-9c54-4a33-b44e-e1b3a427345b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:26.308260 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e142a59-9c54-4a33-b44e-e1b3a427345b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:26.337854 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5688c863-2e94-4622-ae99-fcd8ec09e7fd None None] MFA Rules not processed for user `7c01522e3a5c4e779ea2bc16aeeb04cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:26.339938 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5688c863-2e94-4622-ae99-fcd8ec09e7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:26.357543 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-7e142a59-9c54-4a33-b44e-e1b3a427345b None None] MFA Rules not processed for user `c74e4d1bdaa64ed280cc5f4c8e79b842`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:26.359069 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7e142a59-9c54-4a33-b44e-e1b3a427345b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:26.369820 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 821/1618] 10.222.0.85 () {58 vars in 1058 bytes} [Thu Jun 16 14:56:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:26.370693 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e142a59-9c54-4a33-b44e-e1b3a427345b None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:26.428388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e142a59-9c54-4a33-b44e-e1b3a427345b None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:26.432426 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1a3cc-1b9d-420a-bda2-ee41f541c35b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:26.433202 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1a3cc-1b9d-420a-bda2-ee41f541c35b service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:26.433585 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1a3cc-1b9d-420a-bda2-ee41f541c35b service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:26.433980 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1a3cc-1b9d-420a-bda2-ee41f541c35b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:26.444509 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d1a3cc-1b9d-420a-bda2-ee41f541c35b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:26.446227 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d1a3cc-1b9d-420a-bda2-ee41f541c35b service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:26.454093 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 798/1619] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:26.454093 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688c863-2e94-4622-ae99-fcd8ec09e7fd None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:26.457977 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 822/1620] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:26.459482 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1a3cc-1b9d-420a-bda2-ee41f541c35b service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:26.470442 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1a3cc-1b9d-420a-bda2-ee41f541c35b service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:26.474737 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac1f12-4e6b-4faf-b469-6343972e7f53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:26.475494 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac1f12-4e6b-4faf-b469-6343972e7f53 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:26.475899 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac1f12-4e6b-4faf-b469-6343972e7f53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:26.476296 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac1f12-4e6b-4faf-b469-6343972e7f53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:26.481248 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688c863-2e94-4622-ae99-fcd8ec09e7fd None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:26.491555 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac1f12-4e6b-4faf-b469-6343972e7f53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:26.493676 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac1f12-4e6b-4faf-b469-6343972e7f53 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:26.499725 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c6456-f0c2-42c2-a130-e15ec423a61d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:26.502419 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c6456-f0c2-42c2-a130-e15ec423a61d service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:26.502704 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c6456-f0c2-42c2-a130-e15ec423a61d service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:26.502985 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c6456-f0c2-42c2-a130-e15ec423a61d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:26.508168 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 823/1621] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:26.509090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac1f12-4e6b-4faf-b469-6343972e7f53 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:26.533521 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c6456-f0c2-42c2-a130-e15ec423a61d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:26.536026 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c6456-f0c2-42c2-a130-e15ec423a61d service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:26.565436 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 799/1622] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:26.565436 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c6456-f0c2-42c2-a130-e15ec423a61d service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:26.591722 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac1f12-4e6b-4faf-b469-6343972e7f53 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:26.598832 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35362621-7492-4050-9963-b3911f7e5265 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:26.599735 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c6456-f0c2-42c2-a130-e15ec423a61d service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:26.599891 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35362621-7492-4050-9963-b3911f7e5265 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:26.600419 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35362621-7492-4050-9963-b3911f7e5265 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:26.601060 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35362621-7492-4050-9963-b3911f7e5265 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:26.609205 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7496b22-51ab-43d7-b8f0-4bc2f238edca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:26.610139 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7496b22-51ab-43d7-b8f0-4bc2f238edca service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:26.611224 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7496b22-51ab-43d7-b8f0-4bc2f238edca service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:26.611495 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7496b22-51ab-43d7-b8f0-4bc2f238edca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:26.614973 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35362621-7492-4050-9963-b3911f7e5265 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:26.616895 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35362621-7492-4050-9963-b3911f7e5265 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:26.638123 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 824/1623] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:26.639195 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35362621-7492-4050-9963-b3911f7e5265 service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:26.650894 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35362621-7492-4050-9963-b3911f7e5265 service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:26.656787 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323e586-0985-41e3-aceb-535d626611a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:26.657581 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323e586-0985-41e3-aceb-535d626611a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:26.657951 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323e586-0985-41e3-aceb-535d626611a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:26.659204 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323e586-0985-41e3-aceb-535d626611a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:26.660170 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323e586-0985-41e3-aceb-535d626611a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:26.662588 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323e586-0985-41e3-aceb-535d626611a4 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:26.710643 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 825/1624] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:26 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:26.715793 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323e586-0985-41e3-aceb-535d626611a4 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:26.728469 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:26.731011 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7496b22-51ab-43d7-b8f0-4bc2f238edca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:26.734157 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7496b22-51ab-43d7-b8f0-4bc2f238edca service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:26.748079 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 800/1625] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:26.816292 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323e586-0985-41e3-aceb-535d626611a4 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:26.823903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493d45f-1a63-48c1-9a86-81320b11d95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:26.825072 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493d45f-1a63-48c1-9a86-81320b11d95c admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:26.825460 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493d45f-1a63-48c1-9a86-81320b11d95c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:26.825807 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493d45f-1a63-48c1-9a86-81320b11d95c admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:26.826890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f493d45f-1a63-48c1-9a86-81320b11d95c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:26.830763 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f493d45f-1a63-48c1-9a86-81320b11d95c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:26.952243 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 826/1626] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:26 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:26.954083 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7496b22-51ab-43d7-b8f0-4bc2f238edca service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:26.954083 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7496b22-51ab-43d7-b8f0-4bc2f238edca service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:26.954083 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3cada-2a7d-496b-ac68-c8b042a4ced8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:26.954083 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3cada-2a7d-496b-ac68-c8b042a4ced8 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:26.955202 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3cada-2a7d-496b-ac68-c8b042a4ced8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:26.955202 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3cada-2a7d-496b-ac68-c8b042a4ced8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:26.955202 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3cada-2a7d-496b-ac68-c8b042a4ced8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:26.955202 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3cada-2a7d-496b-ac68-c8b042a4ced8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:26.971498 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 801/1627] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:26.975800 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493d45f-1a63-48c1-9a86-81320b11d95c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:26.991695 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493d45f-1a63-48c1-9a86-81320b11d95c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:27.002805 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e22c5-b077-4497-91bd-bb32b47249ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:27.003713 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e22c5-b077-4497-91bd-bb32b47249ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:27.004024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e22c5-b077-4497-91bd-bb32b47249ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:27.004302 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e22c5-b077-4497-91bd-bb32b47249ad admin admin] PATH_INFO: `/v3/projects/650e7b049bec4ee08a095a70e188ab01/users/aad9f494db864338915cd28d9afae99c/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:27.045143 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e22c5-b077-4497-91bd-bb32b47249ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=650e7b049bec4ee08a095a70e188ab01, user_id=aad9f494db864338915cd28d9afae99c, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:27.047997 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e22c5-b077-4497-91bd-bb32b47249ad admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:27.079343 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 827/1628] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:26 2022] PUT /identity/v3/projects/650e7b049bec4ee08a095a70e188ab01/users/aad9f494db864338915cd28d9afae99c/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:27.080354 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3cada-2a7d-496b-ac68-c8b042a4ced8 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:27.095669 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3cada-2a7d-496b-ac68-c8b042a4ced8 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:27.154415 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a70b4-eddb-48d4-8998-3d3493c7527b None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:27.155296 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a70b4-eddb-48d4-8998-3d3493c7527b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:27.155688 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a70b4-eddb-48d4-8998-3d3493c7527b None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:27.157895 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 828/1629] 10.222.0.85 () {54 vars in 912 bytes} [Thu Jun 16 14:56:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:56:27.164304 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43f1a1-beaa-477e-bd21-1b92d89fd640 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:27.164723 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43f1a1-beaa-477e-bd21-1b92d89fd640 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:27.165109 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43f1a1-beaa-477e-bd21-1b92d89fd640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:27.185458 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-be43f1a1-beaa-477e-bd21-1b92d89fd640 None None] MFA Rules not processed for user `c74e4d1bdaa64ed280cc5f4c8e79b842`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:27.187088 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-be43f1a1-beaa-477e-bd21-1b92d89fd640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:27.221301 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d1374-b835-4fe9-8c43-364a28afcee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:27.222070 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d1374-b835-4fe9-8c43-364a28afcee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:27.222433 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d1374-b835-4fe9-8c43-364a28afcee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:27.222756 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d1374-b835-4fe9-8c43-364a28afcee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:27.223530 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d1374-b835-4fe9-8c43-364a28afcee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:27.228476 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d1374-b835-4fe9-8c43-364a28afcee1 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:27.233377 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:27.252972 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 802/1630] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:56:27.253973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d1374-b835-4fe9-8c43-364a28afcee1 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:27.269141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d1374-b835-4fe9-8c43-364a28afcee1 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:27.284451 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf3af9-4719-4831-8fb1-06ca45465f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:27.285374 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf3af9-4719-4831-8fb1-06ca45465f17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:27.285655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf3af9-4719-4831-8fb1-06ca45465f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:27.286024 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf3af9-4719-4831-8fb1-06ca45465f17 admin admin] PATH_INFO: `/v3/projects/650e7b049bec4ee08a095a70e188ab01/users/aad9f494db864338915cd28d9afae99c/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:27.292802 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf3af9-4719-4831-8fb1-06ca45465f17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=650e7b049bec4ee08a095a70e188ab01, user_id=aad9f494db864338915cd28d9afae99c, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:27.295675 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf3af9-4719-4831-8fb1-06ca45465f17 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:27.311782 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 829/1631] 10.222.0.85 () {58 vars in 1009 bytes} [Thu Jun 16 14:56:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:56:27.325073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43f1a1-beaa-477e-bd21-1b92d89fd640 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:27.330705 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 803/1632] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:27 2022] PUT /identity/v3/projects/650e7b049bec4ee08a095a70e188ab01/users/aad9f494db864338915cd28d9afae99c/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:27.345246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec994d-1afa-4221-9a39-6a7f4f0a42d0 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:27.345535 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec994d-1afa-4221-9a39-6a7f4f0a42d0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:27.346527 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec994d-1afa-4221-9a39-6a7f4f0a42d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:27.393758 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-04ec994d-1afa-4221-9a39-6a7f4f0a42d0 None None] MFA Rules not processed for user `aad9f494db864338915cd28d9afae99c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:27.394989 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-04ec994d-1afa-4221-9a39-6a7f4f0a42d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:27.488623 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 804/1633] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:27 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:27.502723 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43f1a1-beaa-477e-bd21-1b92d89fd640 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:27.531563 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:27.615840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95861f-a30a-4d18-a2c5-6780443c49a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:27.616692 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95861f-a30a-4d18-a2c5-6780443c49a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:27.617081 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95861f-a30a-4d18-a2c5-6780443c49a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:27.617455 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95861f-a30a-4d18-a2c5-6780443c49a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:27.671228 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec994d-1afa-4221-9a39-6a7f4f0a42d0 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:27.685370 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec994d-1afa-4221-9a39-6a7f4f0a42d0 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:27.699753 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190dc91f-b306-4cfb-a6fc-df0d920739d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:27.700758 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190dc91f-b306-4cfb-a6fc-df0d920739d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:27.701222 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190dc91f-b306-4cfb-a6fc-df0d920739d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:27.701662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190dc91f-b306-4cfb-a6fc-df0d920739d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:27.726610 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190dc91f-b306-4cfb-a6fc-df0d920739d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:27.728258 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190dc91f-b306-4cfb-a6fc-df0d920739d4 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:27.769220 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 805/1634] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:56:27.789747 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95861f-a30a-4d18-a2c5-6780443c49a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:27.792790 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95861f-a30a-4d18-a2c5-6780443c49a3 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:27.819782 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 830/1635] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:27.997721 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190dc91f-b306-4cfb-a6fc-df0d920739d4 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:28.021153 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190dc91f-b306-4cfb-a6fc-df0d920739d4 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:28.038683 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc5b7e-72d6-4f9b-82f2-d9ceee6e3afb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:28.039176 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc5b7e-72d6-4f9b-82f2-d9ceee6e3afb service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:28.039461 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc5b7e-72d6-4f9b-82f2-d9ceee6e3afb service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:28.039734 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc5b7e-72d6-4f9b-82f2-d9ceee6e3afb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:28.171983 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc5b7e-72d6-4f9b-82f2-d9ceee6e3afb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:28.173767 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc5b7e-72d6-4f9b-82f2-d9ceee6e3afb service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:28.194743 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 806/1636] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:28.430870 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95861f-a30a-4d18-a2c5-6780443c49a3 service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:28.448188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95861f-a30a-4d18-a2c5-6780443c49a3 service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:28.459653 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b910c3-9702-4044-81e7-f6274bf3d45d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:28.460647 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b910c3-9702-4044-81e7-f6274bf3d45d service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:28.463471 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b910c3-9702-4044-81e7-f6274bf3d45d service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:28.464287 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b910c3-9702-4044-81e7-f6274bf3d45d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:28.667798 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b910c3-9702-4044-81e7-f6274bf3d45d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:28.670593 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b910c3-9702-4044-81e7-f6274bf3d45d service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:28.717303 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 831/1637] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:29.260777 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc5b7e-72d6-4f9b-82f2-d9ceee6e3afb service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:29.388311 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:29.398726 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc5b7e-72d6-4f9b-82f2-d9ceee6e3afb service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:29.442329 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580426d-08f4-4e97-b8cc-12e4be2f6b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:29.444933 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580426d-08f4-4e97-b8cc-12e4be2f6b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:29.447626 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580426d-08f4-4e97-b8cc-12e4be2f6b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:29.453859 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580426d-08f4-4e97-b8cc-12e4be2f6b0b admin admin] PATH_INFO: `/v3/users/a6d816e7e7834068b977e7feae661c15` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:29.465616 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6580426d-08f4-4e97-b8cc-12e4be2f6b0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6d816e7e7834068b977e7feae661c15)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:29.468045 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6580426d-08f4-4e97-b8cc-12e4be2f6b0b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:29.572992 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6580426d-08f4-4e97-b8cc-12e4be2f6b0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6d816e7e7834068b977e7feae661c15'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:29.590904 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6580426d-08f4-4e97-b8cc-12e4be2f6b0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6d816e7e7834068b977e7feae661c15'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:29.602844 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6580426d-08f4-4e97-b8cc-12e4be2f6b0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6d816e7e7834068b977e7feae661c15'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:29.622898 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6580426d-08f4-4e97-b8cc-12e4be2f6b0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6d816e7e7834068b977e7feae661c15'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:29.623665 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6580426d-08f4-4e97-b8cc-12e4be2f6b0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6d816e7e7834068b977e7feae661c15'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:29.634410 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 807/1638] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:56:29 2022] DELETE /identity/v3/users/a6d816e7e7834068b977e7feae661c15 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:29.636858 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3dc27d-e43c-4cb7-871d-43e2d4c6ce2d None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:29.637384 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3dc27d-e43c-4cb7-871d-43e2d4c6ce2d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:29.637484 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3dc27d-e43c-4cb7-871d-43e2d4c6ce2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:29.673614 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-2a3dc27d-e43c-4cb7-871d-43e2d4c6ce2d None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:29.679845 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2a3dc27d-e43c-4cb7-871d-43e2d4c6ce2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:29.863887 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:29.909643 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 832/1639] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:29.990968 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580426d-08f4-4e97-b8cc-12e4be2f6b0b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:29.992684 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6580426d-08f4-4e97-b8cc-12e4be2f6b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:30.141556 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580426d-08f4-4e97-b8cc-12e4be2f6b0b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:30.156637 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881ba8c-db28-45f5-9a22-c7ccf00f710f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:30.157330 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881ba8c-db28-45f5-9a22-c7ccf00f710f service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:30.157618 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881ba8c-db28-45f5-9a22-c7ccf00f710f service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:30.158008 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881ba8c-db28-45f5-9a22-c7ccf00f710f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:30.180222 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881ba8c-db28-45f5-9a22-c7ccf00f710f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:30.182328 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881ba8c-db28-45f5-9a22-c7ccf00f710f service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:30.210951 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 808/1640] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:31.073584 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3dc27d-e43c-4cb7-871d-43e2d4c6ce2d None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:31.073584 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2a3dc27d-e43c-4cb7-871d-43e2d4c6ce2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:31.102825 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3dc27d-e43c-4cb7-871d-43e2d4c6ce2d None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:31.118341 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de383f5-af88-43d3-b613-bb36263f7635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:31.120088 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de383f5-af88-43d3-b613-bb36263f7635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:31.120652 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de383f5-af88-43d3-b613-bb36263f7635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:31.121083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de383f5-af88-43d3-b613-bb36263f7635 admin admin] PATH_INFO: `/v3/users/fcf4405d7282434c8e01821dd39d0987` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:31.131787 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de383f5-af88-43d3-b613-bb36263f7635 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcf4405d7282434c8e01821dd39d0987)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:31.133081 dv-cinder-837165-3-smb devstack@keystone.service[80176]: WARNING py.warnings [None req-9de383f5-af88-43d3-b613-bb36263f7635 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:56:31.133081 dv-cinder-837165-3-smb devstack@keystone.service[80176]: warnings.warn(msg) Jun 16 14:56:31.133081 dv-cinder-837165-3-smb devstack@keystone.service[80176]: Jun 16 14:56:31.138018 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de383f5-af88-43d3-b613-bb36263f7635 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:31.332144 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9de383f5-af88-43d3-b613-bb36263f7635 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcf4405d7282434c8e01821dd39d0987'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:31.415549 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9de383f5-af88-43d3-b613-bb36263f7635 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcf4405d7282434c8e01821dd39d0987'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:31.417217 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9de383f5-af88-43d3-b613-bb36263f7635 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcf4405d7282434c8e01821dd39d0987'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:31.442699 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9de383f5-af88-43d3-b613-bb36263f7635 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcf4405d7282434c8e01821dd39d0987'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:31.484952 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9de383f5-af88-43d3-b613-bb36263f7635 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcf4405d7282434c8e01821dd39d0987'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:31.505822 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 833/1641] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:56:31 2022] DELETE /identity/v3/users/fcf4405d7282434c8e01821dd39d0987 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:31.510502 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c44881-924b-44d0-96ec-5ac9a913f0df None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:31.511017 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c44881-924b-44d0-96ec-5ac9a913f0df None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:31.511084 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c44881-924b-44d0-96ec-5ac9a913f0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:31.574459 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-41c44881-924b-44d0-96ec-5ac9a913f0df None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:31.578694 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-41c44881-924b-44d0-96ec-5ac9a913f0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:31.702087 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 809/1642] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:31.723796 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de383f5-af88-43d3-b613-bb36263f7635 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:31.726362 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9de383f5-af88-43d3-b613-bb36263f7635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:31.862270 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de383f5-af88-43d3-b613-bb36263f7635 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:31.873498 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe008fb-3f5a-4e2f-9a60-195f0154ef2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:31.874421 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe008fb-3f5a-4e2f-9a60-195f0154ef2b service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:31.874875 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe008fb-3f5a-4e2f-9a60-195f0154ef2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:31.876402 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe008fb-3f5a-4e2f-9a60-195f0154ef2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:31.900516 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe008fb-3f5a-4e2f-9a60-195f0154ef2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:31.904001 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe008fb-3f5a-4e2f-9a60-195f0154ef2b service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:31.923114 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 834/1643] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:31.994233 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c44881-924b-44d0-96ec-5ac9a913f0df None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:31.996116 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-41c44881-924b-44d0-96ec-5ac9a913f0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:32.012219 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c44881-924b-44d0-96ec-5ac9a913f0df None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:32.023567 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159f13a-0513-411e-a9e5-32fbecf31ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:32.024905 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159f13a-0513-411e-a9e5-32fbecf31ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:32.025293 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159f13a-0513-411e-a9e5-32fbecf31ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:32.025863 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159f13a-0513-411e-a9e5-32fbecf31ab7 admin admin] PATH_INFO: `/v3/projects/a1aa0e2bd297461caf3c534080faeebb` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:32.027310 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159f13a-0513-411e-a9e5-32fbecf31ab7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1aa0e2bd297461caf3c534080faeebb)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:32.028730 dv-cinder-837165-3-smb devstack@keystone.service[80175]: WARNING py.warnings [None req-b159f13a-0513-411e-a9e5-32fbecf31ab7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:56:32.028730 dv-cinder-837165-3-smb devstack@keystone.service[80175]: warnings.warn(msg) Jun 16 14:56:32.028730 dv-cinder-837165-3-smb devstack@keystone.service[80175]: Jun 16 14:56:32.030464 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159f13a-0513-411e-a9e5-32fbecf31ab7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:32.057970 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:32.173798 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b159f13a-0513-411e-a9e5-32fbecf31ab7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1aa0e2bd297461caf3c534080faeebb', 'request_id': 'req-b159f13a-0513-411e-a9e5-32fbecf31ab7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:32.201086 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b159f13a-0513-411e-a9e5-32fbecf31ab7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1aa0e2bd297461caf3c534080faeebb', 'request_id': 'req-b159f13a-0513-411e-a9e5-32fbecf31ab7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:32.216644 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b159f13a-0513-411e-a9e5-32fbecf31ab7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1aa0e2bd297461caf3c534080faeebb', 'request_id': 'req-b159f13a-0513-411e-a9e5-32fbecf31ab7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:32.237757 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b159f13a-0513-411e-a9e5-32fbecf31ab7 admin admin] The token cache is being invalidate because project a1aa0e2bd297461caf3c534080faeebb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:56:32.238285 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b159f13a-0513-411e-a9e5-32fbecf31ab7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:32.244456 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b159f13a-0513-411e-a9e5-32fbecf31ab7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:32.246846 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 810/1644] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:56:31 2022] DELETE /identity/v3/projects/a1aa0e2bd297461caf3c534080faeebb => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:32.253417 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd90d2-3a69-4586-8f6a-8519bbc90b25 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:32.253417 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd90d2-3a69-4586-8f6a-8519bbc90b25 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:32.253417 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd90d2-3a69-4586-8f6a-8519bbc90b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:32.317696 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-f2fd90d2-3a69-4586-8f6a-8519bbc90b25 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:32.325066 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f2fd90d2-3a69-4586-8f6a-8519bbc90b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:32.519851 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 835/1645] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:32.521743 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c748ebc-862f-4e0f-897b-d29c1d6cfc50 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:32.522227 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c748ebc-862f-4e0f-897b-d29c1d6cfc50 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:32.522311 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c748ebc-862f-4e0f-897b-d29c1d6cfc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:32.547302 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-8c748ebc-862f-4e0f-897b-d29c1d6cfc50 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:32.548911 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8c748ebc-862f-4e0f-897b-d29c1d6cfc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:32.582973 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd90d2-3a69-4586-8f6a-8519bbc90b25 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:32.596676 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 811/1646] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:32.601180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd90d2-3a69-4586-8f6a-8519bbc90b25 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:32.618928 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af232a31-a451-4e42-ac06-1c8c114891b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:32.620879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af232a31-a451-4e42-ac06-1c8c114891b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:32.621240 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af232a31-a451-4e42-ac06-1c8c114891b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:32.622693 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af232a31-a451-4e42-ac06-1c8c114891b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:32.623584 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af232a31-a451-4e42-ac06-1c8c114891b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:56:32.626180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af232a31-a451-4e42-ac06-1c8c114891b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:32.629680 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af232a31-a451-4e42-ac06-1c8c114891b1 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:32.652498 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:32.665139 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c748ebc-862f-4e0f-897b-d29c1d6cfc50 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:32.677641 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 836/1647] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:56:32.678421 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c748ebc-862f-4e0f-897b-d29c1d6cfc50 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:32.685869 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cd2c0-e7ce-4d66-b817-3d922efc03a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:32.686556 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cd2c0-e7ce-4d66-b817-3d922efc03a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:32.686838 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cd2c0-e7ce-4d66-b817-3d922efc03a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:32.687112 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cd2c0-e7ce-4d66-b817-3d922efc03a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:32.688555 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cd2c0-e7ce-4d66-b817-3d922efc03a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:32.690708 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cd2c0-e7ce-4d66-b817-3d922efc03a0 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:32.800757 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af232a31-a451-4e42-ac06-1c8c114891b1 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:32.820404 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 812/1648] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:32 2022] POST /identity/v3/projects => generated 387 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:32.821552 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af232a31-a451-4e42-ac06-1c8c114891b1 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:32.996868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d313cc-1e4d-4617-a04a-76a864d2e602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:32.998554 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d313cc-1e4d-4617-a04a-76a864d2e602 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:32.999045 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d313cc-1e4d-4617-a04a-76a864d2e602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:32.999641 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d313cc-1e4d-4617-a04a-76a864d2e602 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:33.001029 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d313cc-1e4d-4617-a04a-76a864d2e602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:33.003557 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d313cc-1e4d-4617-a04a-76a864d2e602 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:33.052399 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 837/1649] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:32 2022] POST /identity/v3/users => generated 294 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:33.057103 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cd2c0-e7ce-4d66-b817-3d922efc03a0 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:33.076652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cd2c0-e7ce-4d66-b817-3d922efc03a0 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:33.090748 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a84a2-aff8-47df-9369-e51056ed3e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:33.091850 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a84a2-aff8-47df-9369-e51056ed3e0e admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:33.091850 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a84a2-aff8-47df-9369-e51056ed3e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:33.092126 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a84a2-aff8-47df-9369-e51056ed3e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:33.092858 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a84a2-aff8-47df-9369-e51056ed3e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:33.094555 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a84a2-aff8-47df-9369-e51056ed3e0e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:33.138492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 813/1650] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:33.139295 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d313cc-1e4d-4617-a04a-76a864d2e602 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:33.155759 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d313cc-1e4d-4617-a04a-76a864d2e602 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:33.169953 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44273cfb-3a49-4800-918a-c046dfdfab72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:33.171426 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44273cfb-3a49-4800-918a-c046dfdfab72 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:33.171808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44273cfb-3a49-4800-918a-c046dfdfab72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:33.172285 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44273cfb-3a49-4800-918a-c046dfdfab72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:33.173137 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44273cfb-3a49-4800-918a-c046dfdfab72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:33.174918 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44273cfb-3a49-4800-918a-c046dfdfab72 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:33.212736 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 838/1651] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:33.217044 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a84a2-aff8-47df-9369-e51056ed3e0e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:33.231200 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a84a2-aff8-47df-9369-e51056ed3e0e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:33.248395 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a6250-52a3-4fa0-9ac6-cbba01a13967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:33.249680 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a6250-52a3-4fa0-9ac6-cbba01a13967 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:33.249855 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a6250-52a3-4fa0-9ac6-cbba01a13967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:33.250231 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a6250-52a3-4fa0-9ac6-cbba01a13967 admin admin] PATH_INFO: `/v3/projects/488a233918bc45a6a26635c6f28d6794/users/a7d9d121e77a47f7af311eb22ae23252/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:33.282853 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a6250-52a3-4fa0-9ac6-cbba01a13967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=488a233918bc45a6a26635c6f28d6794, user_id=a7d9d121e77a47f7af311eb22ae23252, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:33.285791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a6250-52a3-4fa0-9ac6-cbba01a13967 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:33.318488 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 814/1652] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:33 2022] PUT /identity/v3/projects/488a233918bc45a6a26635c6f28d6794/users/a7d9d121e77a47f7af311eb22ae23252/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:33.331084 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff4db3-1a60-4aad-89b6-4f6189b49e35 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:33.331540 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff4db3-1a60-4aad-89b6-4f6189b49e35 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:33.331833 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff4db3-1a60-4aad-89b6-4f6189b49e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:33.411684 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-faff4db3-1a60-4aad-89b6-4f6189b49e35 None None] MFA Rules not processed for user `a7d9d121e77a47f7af311eb22ae23252`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:33.413441 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-faff4db3-1a60-4aad-89b6-4f6189b49e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:33.644757 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 839/1653] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:56:33.648188 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a6250-52a3-4fa0-9ac6-cbba01a13967 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:33.863769 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a6250-52a3-4fa0-9ac6-cbba01a13967 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:33.883836 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395ad6d-a898-4105-b482-5ea8e48936b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:33.884734 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395ad6d-a898-4105-b482-5ea8e48936b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:33.885128 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395ad6d-a898-4105-b482-5ea8e48936b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:33.885514 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395ad6d-a898-4105-b482-5ea8e48936b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:33.886290 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395ad6d-a898-4105-b482-5ea8e48936b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:33.889406 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395ad6d-a898-4105-b482-5ea8e48936b8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:33.969758 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 815/1654] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:33 2022] POST /identity/v3/projects => generated 387 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:33.970686 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff4db3-1a60-4aad-89b6-4f6189b49e35 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:33.999055 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff4db3-1a60-4aad-89b6-4f6189b49e35 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:34.235565 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8de53-f785-44dd-be4b-39899eb5419a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:34.236541 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8de53-f785-44dd-be4b-39899eb5419a admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:34.236937 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8de53-f785-44dd-be4b-39899eb5419a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:34.237428 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8de53-f785-44dd-be4b-39899eb5419a admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:34.238089 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8de53-f785-44dd-be4b-39899eb5419a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:34.254138 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8de53-f785-44dd-be4b-39899eb5419a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:34.286342 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:34.315276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395ad6d-a898-4105-b482-5ea8e48936b8 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:34.319901 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 840/1655] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:33 2022] POST /identity/v3/users => generated 294 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:56:34.342418 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395ad6d-a898-4105-b482-5ea8e48936b8 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:34.358109 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612a52f-3e92-4063-a86b-dfc62d0cb1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:34.359387 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612a52f-3e92-4063-a86b-dfc62d0cb1bb admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:34.359865 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612a52f-3e92-4063-a86b-dfc62d0cb1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:34.360638 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612a52f-3e92-4063-a86b-dfc62d0cb1bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:34.361686 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612a52f-3e92-4063-a86b-dfc62d0cb1bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:34.369169 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612a52f-3e92-4063-a86b-dfc62d0cb1bb admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:34.408226 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 816/1656] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:34.409465 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8de53-f785-44dd-be4b-39899eb5419a admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:34.420907 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8de53-f785-44dd-be4b-39899eb5419a admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:34.429124 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612a52f-3e92-4063-a86b-dfc62d0cb1bb admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:34.434843 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a612a52f-3e92-4063-a86b-dfc62d0cb1bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:34.451498 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a5d44-dbd1-48d0-ae09-c79e26b65023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:34.452232 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a5d44-dbd1-48d0-ae09-c79e26b65023 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:34.452513 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a5d44-dbd1-48d0-ae09-c79e26b65023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:34.452788 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a5d44-dbd1-48d0-ae09-c79e26b65023 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:34.453683 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a5d44-dbd1-48d0-ae09-c79e26b65023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:34.467920 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a5d44-dbd1-48d0-ae09-c79e26b65023 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:34.493104 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612a52f-3e92-4063-a86b-dfc62d0cb1bb admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:34.513320 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 841/1657] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:56:34.519076 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a5d44-dbd1-48d0-ae09-c79e26b65023 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:34.520333 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554efa1-ee94-4c62-a78d-e8722467a140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:34.523268 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554efa1-ee94-4c62-a78d-e8722467a140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:34.524229 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554efa1-ee94-4c62-a78d-e8722467a140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:34.525632 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554efa1-ee94-4c62-a78d-e8722467a140 admin admin] PATH_INFO: `/v3/projects/77da8bacb8624e2784a8b76d8d0c681e` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:34.528822 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9554efa1-ee94-4c62-a78d-e8722467a140 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77da8bacb8624e2784a8b76d8d0c681e)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:34.539558 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9554efa1-ee94-4c62-a78d-e8722467a140 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:34.561392 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a5d44-dbd1-48d0-ae09-c79e26b65023 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:34.566122 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:34.579628 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa69415-eec8-4aef-bcb9-89cddd546216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:34.582431 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa69415-eec8-4aef-bcb9-89cddd546216 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:34.582732 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa69415-eec8-4aef-bcb9-89cddd546216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:34.583012 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa69415-eec8-4aef-bcb9-89cddd546216 admin admin] PATH_INFO: `/v3/projects/0e9c892c1d414e1990f059378ccafaaa/users/2c9ecec07fe34609987ac12c4cfc43db/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:34.694417 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa69415-eec8-4aef-bcb9-89cddd546216 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e9c892c1d414e1990f059378ccafaaa, user_id=2c9ecec07fe34609987ac12c4cfc43db, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:34.697167 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9554efa1-ee94-4c62-a78d-e8722467a140 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77da8bacb8624e2784a8b76d8d0c681e', 'request_id': 'req-9554efa1-ee94-4c62-a78d-e8722467a140'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:34.702546 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa69415-eec8-4aef-bcb9-89cddd546216 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:34.739136 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9554efa1-ee94-4c62-a78d-e8722467a140 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77da8bacb8624e2784a8b76d8d0c681e', 'request_id': 'req-9554efa1-ee94-4c62-a78d-e8722467a140'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:34.744301 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 842/1658] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:34 2022] PUT /identity/v3/projects/0e9c892c1d414e1990f059378ccafaaa/users/2c9ecec07fe34609987ac12c4cfc43db/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:34.757316 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14415f1b-6259-4a02-ac4c-0ff3b6a4191d None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:34.757594 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14415f1b-6259-4a02-ac4c-0ff3b6a4191d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:34.757872 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14415f1b-6259-4a02-ac4c-0ff3b6a4191d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:34.761281 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9554efa1-ee94-4c62-a78d-e8722467a140 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77da8bacb8624e2784a8b76d8d0c681e', 'request_id': 'req-9554efa1-ee94-4c62-a78d-e8722467a140'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:34.785370 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9554efa1-ee94-4c62-a78d-e8722467a140 admin admin] The token cache is being invalidate because project 77da8bacb8624e2784a8b76d8d0c681e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:56:34.785659 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9554efa1-ee94-4c62-a78d-e8722467a140 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:34.790859 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9554efa1-ee94-4c62-a78d-e8722467a140 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:34.795716 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 817/1659] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:56:34 2022] DELETE /identity/v3/projects/77da8bacb8624e2784a8b76d8d0c681e => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:34.800776 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1be05-e7c1-4e45-bd83-9c736a11a350 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:34.801064 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1be05-e7c1-4e45-bd83-9c736a11a350 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:34.801344 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1be05-e7c1-4e45-bd83-9c736a11a350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:34.857384 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3cd1be05-e7c1-4e45-bd83-9c736a11a350 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:34.862992 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-14415f1b-6259-4a02-ac4c-0ff3b6a4191d None None] MFA Rules not processed for user `2c9ecec07fe34609987ac12c4cfc43db`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:34.864395 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-14415f1b-6259-4a02-ac4c-0ff3b6a4191d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:34.866691 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3cd1be05-e7c1-4e45-bd83-9c736a11a350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:35.096826 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 843/1660] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:35.102269 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14415f1b-6259-4a02-ac4c-0ff3b6a4191d None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:35.105153 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-14415f1b-6259-4a02-ac4c-0ff3b6a4191d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:35.154810 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 818/1661] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:56:35.155966 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1177e-6048-4dd8-9d00-df1657eeea7a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:35.159929 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1177e-6048-4dd8-9d00-df1657eeea7a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:35.160105 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1177e-6048-4dd8-9d00-df1657eeea7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:35.218753 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14415f1b-6259-4a02-ac4c-0ff3b6a4191d None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:35.229254 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-adc1177e-6048-4dd8-9d00-df1657eeea7a None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:35.237734 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6fad44-f27e-484b-9f84-0f0ee137659b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:35.238446 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fad44-f27e-484b-9f84-0f0ee137659b admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:35.238728 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fad44-f27e-484b-9f84-0f0ee137659b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:35.239004 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fad44-f27e-484b-9f84-0f0ee137659b admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:35.239188 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-adc1177e-6048-4dd8-9d00-df1657eeea7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:35.239714 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6fad44-f27e-484b-9f84-0f0ee137659b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:35.250634 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6fad44-f27e-484b-9f84-0f0ee137659b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:35.271367 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 819/1662] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:56:35.272417 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1177e-6048-4dd8-9d00-df1657eeea7a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:35.304915 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1177e-6048-4dd8-9d00-df1657eeea7a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:35.318094 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b56c4-096e-48a0-99ed-d7b9adc9553b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:35.322079 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b56c4-096e-48a0-99ed-d7b9adc9553b admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:35.324235 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b56c4-096e-48a0-99ed-d7b9adc9553b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:35.324665 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b56c4-096e-48a0-99ed-d7b9adc9553b admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:35.325046 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 844/1663] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:35 2022] POST /identity/v3/projects => generated 387 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:35.326045 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6fad44-f27e-484b-9f84-0f0ee137659b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:35.327029 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b56c4-096e-48a0-99ed-d7b9adc9553b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:56:35.328929 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b56c4-096e-48a0-99ed-d7b9adc9553b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:35.334487 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b56c4-096e-48a0-99ed-d7b9adc9553b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:35.374521 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 820/1664] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:56:35.378370 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b56c4-096e-48a0-99ed-d7b9adc9553b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:35.407585 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b56c4-096e-48a0-99ed-d7b9adc9553b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:35.463285 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:35.549054 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6fad44-f27e-484b-9f84-0f0ee137659b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:35.572479 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f515bcd-ffde-44e6-abcf-886474609fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:35.573974 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f515bcd-ffde-44e6-abcf-886474609fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:35.574263 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f515bcd-ffde-44e6-abcf-886474609fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:35.574539 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f515bcd-ffde-44e6-abcf-886474609fe1 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:35.575238 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f515bcd-ffde-44e6-abcf-886474609fe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:35.581806 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f515bcd-ffde-44e6-abcf-886474609fe1 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:35.637970 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae68d0b-f95e-452a-9c9e-b62445edd081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:35.638882 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae68d0b-f95e-452a-9c9e-b62445edd081 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:35.639168 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae68d0b-f95e-452a-9c9e-b62445edd081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:35.641494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae68d0b-f95e-452a-9c9e-b62445edd081 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:35.646241 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae68d0b-f95e-452a-9c9e-b62445edd081 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:35.648940 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae68d0b-f95e-452a-9c9e-b62445edd081 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:35.655846 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 845/1665] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:35 2022] POST /identity/v3/users => generated 300 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:35.661815 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f515bcd-ffde-44e6-abcf-886474609fe1 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:35.667061 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4f515bcd-ffde-44e6-abcf-886474609fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:35.694773 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f515bcd-ffde-44e6-abcf-886474609fe1 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:35.700523 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:35.705816 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230c95b-27e2-4948-82c8-fc62813bd172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:35.707014 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230c95b-27e2-4948-82c8-fc62813bd172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:35.707501 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230c95b-27e2-4948-82c8-fc62813bd172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:35.709773 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230c95b-27e2-4948-82c8-fc62813bd172 admin admin] PATH_INFO: `/v3/users/9f948930d58e4b278d144b2c94b5b096` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:35.712372 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230c95b-27e2-4948-82c8-fc62813bd172 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f948930d58e4b278d144b2c94b5b096)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:35.714468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 821/1666] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:35 2022] POST /identity/v3/projects => generated 387 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:35.716394 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae68d0b-f95e-452a-9c9e-b62445edd081 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:35.721783 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230c95b-27e2-4948-82c8-fc62813bd172 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:35.853768 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9230c95b-27e2-4948-82c8-fc62813bd172 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f948930d58e4b278d144b2c94b5b096'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:35.880287 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9230c95b-27e2-4948-82c8-fc62813bd172 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f948930d58e4b278d144b2c94b5b096'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:35.881792 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9230c95b-27e2-4948-82c8-fc62813bd172 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f948930d58e4b278d144b2c94b5b096'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:35.894364 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9230c95b-27e2-4948-82c8-fc62813bd172 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f948930d58e4b278d144b2c94b5b096'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:35.917064 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9230c95b-27e2-4948-82c8-fc62813bd172 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f948930d58e4b278d144b2c94b5b096'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:35.931047 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae68d0b-f95e-452a-9c9e-b62445edd081 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:35.931556 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 846/1667] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:56:35 2022] DELETE /identity/v3/users/9f948930d58e4b278d144b2c94b5b096 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:35.933101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230c95b-27e2-4948-82c8-fc62813bd172 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:35.937221 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9230c95b-27e2-4948-82c8-fc62813bd172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:36.049910 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11689c8-bc7f-4e3d-a9f2-9ce45d89511e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:36.050612 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11689c8-bc7f-4e3d-a9f2-9ce45d89511e admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:36.050896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11689c8-bc7f-4e3d-a9f2-9ce45d89511e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:36.051171 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11689c8-bc7f-4e3d-a9f2-9ce45d89511e admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:36.052134 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11689c8-bc7f-4e3d-a9f2-9ce45d89511e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:36.057003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11689c8-bc7f-4e3d-a9f2-9ce45d89511e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:36.074184 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230c95b-27e2-4948-82c8-fc62813bd172 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:36.082647 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 822/1668] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:36.084510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e26e8-838a-42cf-9c51-fe8dfb1299d1 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:36.084800 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e26e8-838a-42cf-9c51-fe8dfb1299d1 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:36.085076 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e26e8-838a-42cf-9c51-fe8dfb1299d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:36.090657 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caab610-54da-4332-992e-4f65cd2ba9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:36.091399 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caab610-54da-4332-992e-4f65cd2ba9c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:36.091641 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caab610-54da-4332-992e-4f65cd2ba9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:36.091953 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caab610-54da-4332-992e-4f65cd2ba9c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:36.092663 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caab610-54da-4332-992e-4f65cd2ba9c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:36.094718 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caab610-54da-4332-992e-4f65cd2ba9c5 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:36.140690 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 847/1669] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:35 2022] POST /identity/v3/users => generated 294 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:36.142525 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b6ae3-1ac2-4966-a794-2fc639e9ff38 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:36.142953 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b6ae3-1ac2-4966-a794-2fc639e9ff38 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:36.143394 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b6ae3-1ac2-4966-a794-2fc639e9ff38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:36.150287 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ab8e26e8-838a-42cf-9c51-fe8dfb1299d1 None None] MFA Rules not processed for user `4e10f63b54224607996ab53536ad00d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:36.151523 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ab8e26e8-838a-42cf-9c51-fe8dfb1299d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:36.181355 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-600b6ae3-1ac2-4966-a794-2fc639e9ff38 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:36.182779 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-600b6ae3-1ac2-4966-a794-2fc639e9ff38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:36.196728 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 848/1670] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:36.197567 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b6ae3-1ac2-4966-a794-2fc639e9ff38 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:36.201590 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-600b6ae3-1ac2-4966-a794-2fc639e9ff38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:36.223344 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b6ae3-1ac2-4966-a794-2fc639e9ff38 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:36.232153 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31cdc4-8559-4d09-ac42-568308924a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:36.234030 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31cdc4-8559-4d09-ac42-568308924a04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:36.235074 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31cdc4-8559-4d09-ac42-568308924a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:36.235074 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31cdc4-8559-4d09-ac42-568308924a04 admin admin] PATH_INFO: `/v3/projects/b9080ee22a534abf8ef8c01c7e899cd1/users/06527f5efb7e4b19b8a84c1b99df2bdd/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:36.289998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31cdc4-8559-4d09-ac42-568308924a04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9080ee22a534abf8ef8c01c7e899cd1, user_id=06527f5efb7e4b19b8a84c1b99df2bdd, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:36.292542 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 823/1671] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:36.295737 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31cdc4-8559-4d09-ac42-568308924a04 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:36.296108 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e26e8-838a-42cf-9c51-fe8dfb1299d1 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:36.313250 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e26e8-838a-42cf-9c51-fe8dfb1299d1 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:36.326774 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=82,keystone:INSERT=8,keystone:DELETE=10 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:36.346517 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 849/1672] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:36 2022] PUT /identity/v3/projects/b9080ee22a534abf8ef8c01c7e899cd1/users/06527f5efb7e4b19b8a84c1b99df2bdd/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:36.347808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31cdc4-8559-4d09-ac42-568308924a04 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:36.352862 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-df31cdc4-8559-4d09-ac42-568308924a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:36.390481 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:36.449360 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd832d1-b833-47fa-a5d7-aff523b5e19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:36.450289 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd832d1-b833-47fa-a5d7-aff523b5e19c admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:36.451020 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd832d1-b833-47fa-a5d7-aff523b5e19c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:36.451846 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd832d1-b833-47fa-a5d7-aff523b5e19c admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:36.452810 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd832d1-b833-47fa-a5d7-aff523b5e19c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:36.455271 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd832d1-b833-47fa-a5d7-aff523b5e19c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:36.470943 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 824/1673] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:36.472462 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509fc81-0671-42af-af9f-43b2289ba4ea None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:36.472901 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509fc81-0671-42af-af9f-43b2289ba4ea None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:36.473506 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509fc81-0671-42af-af9f-43b2289ba4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:36.490140 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31cdc4-8559-4d09-ac42-568308924a04 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:36.497787 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c509fc81-0671-42af-af9f-43b2289ba4ea None None] MFA Rules not processed for user `4e10f63b54224607996ab53536ad00d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:36.499033 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c509fc81-0671-42af-af9f-43b2289ba4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:36.501380 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a791a-b158-4550-a398-bb26047e4ebe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:36.502090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a791a-b158-4550-a398-bb26047e4ebe service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:36.502376 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a791a-b158-4550-a398-bb26047e4ebe service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:36.502676 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a791a-b158-4550-a398-bb26047e4ebe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:36.526431 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a791a-b158-4550-a398-bb26047e4ebe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:36.528007 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a791a-b158-4550-a398-bb26047e4ebe service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:36.549795 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 850/1674] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:36.550739 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a791a-b158-4550-a398-bb26047e4ebe service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:36.568737 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a791a-b158-4550-a398-bb26047e4ebe service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:36.584656 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cad91d-3c6c-45e0-a682-fe0139d45085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:36.585347 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cad91d-3c6c-45e0-a682-fe0139d45085 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:36.585634 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cad91d-3c6c-45e0-a682-fe0139d45085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:36.585914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cad91d-3c6c-45e0-a682-fe0139d45085 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:36.586648 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cad91d-3c6c-45e0-a682-fe0139d45085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:36.588338 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cad91d-3c6c-45e0-a682-fe0139d45085 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:36.620314 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 851/1675] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:36.621171 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 825/1676] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:36.621325 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cad91d-3c6c-45e0-a682-fe0139d45085 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:36.622106 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509fc81-0671-42af-af9f-43b2289ba4ea None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:36.652059 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509fc81-0671-42af-af9f-43b2289ba4ea None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:36.655710 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cad91d-3c6c-45e0-a682-fe0139d45085 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:36.663985 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64750258-5213-4fff-a9b6-b5484564771b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:36.664588 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024bde2-d58a-48f3-b67b-ab590cafa21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:36.664689 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64750258-5213-4fff-a9b6-b5484564771b admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:36.664920 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64750258-5213-4fff-a9b6-b5484564771b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:36.665229 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64750258-5213-4fff-a9b6-b5484564771b admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:36.665937 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64750258-5213-4fff-a9b6-b5484564771b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:36.667596 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64750258-5213-4fff-a9b6-b5484564771b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:36.668802 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024bde2-d58a-48f3-b67b-ab590cafa21b admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:36.669475 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024bde2-d58a-48f3-b67b-ab590cafa21b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:36.670001 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024bde2-d58a-48f3-b67b-ab590cafa21b admin admin] PATH_INFO: `/v3/projects/b9080ee22a534abf8ef8c01c7e899cd1/users/06527f5efb7e4b19b8a84c1b99df2bdd/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:36.678133 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b024bde2-d58a-48f3-b67b-ab590cafa21b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9080ee22a534abf8ef8c01c7e899cd1, user_id=06527f5efb7e4b19b8a84c1b99df2bdd, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:36.687245 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b024bde2-d58a-48f3-b67b-ab590cafa21b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:36.689318 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 852/1677] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:36.707805 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64750258-5213-4fff-a9b6-b5484564771b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:36.709769 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-64750258-5213-4fff-a9b6-b5484564771b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:36.718768 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 826/1678] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:36 2022] PUT /identity/v3/projects/b9080ee22a534abf8ef8c01c7e899cd1/users/06527f5efb7e4b19b8a84c1b99df2bdd/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:36.721259 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024bde2-d58a-48f3-b67b-ab590cafa21b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:36.889976 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64750258-5213-4fff-a9b6-b5484564771b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:36.957301 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024bde2-d58a-48f3-b67b-ab590cafa21b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:36.977178 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ba9d8-e34c-44b4-ad79-c3f79b67bbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:36.978136 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ba9d8-e34c-44b4-ad79-c3f79b67bbe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:36.978406 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ba9d8-e34c-44b4-ad79-c3f79b67bbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:36.978687 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ba9d8-e34c-44b4-ad79-c3f79b67bbe2 admin admin] PATH_INFO: `/v3/projects/a3c8419bb409482981559fda9d5bf1c0/users/87aa9274635e4ebfb72ddb2b231ccb62/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:37.035259 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ba9d8-e34c-44b4-ad79-c3f79b67bbe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3c8419bb409482981559fda9d5bf1c0, user_id=87aa9274635e4ebfb72ddb2b231ccb62, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:37.041637 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ba9d8-e34c-44b4-ad79-c3f79b67bbe2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:37.054775 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a120860-8e4d-4205-9a23-41d6f6632d86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:37.055768 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a120860-8e4d-4205-9a23-41d6f6632d86 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:37.056166 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a120860-8e4d-4205-9a23-41d6f6632d86 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:37.056952 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a120860-8e4d-4205-9a23-41d6f6632d86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:37.076439 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 827/1679] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:36 2022] PUT /identity/v3/projects/a3c8419bb409482981559fda9d5bf1c0/users/87aa9274635e4ebfb72ddb2b231ccb62/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:37.078165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13cad48-be7e-4aa5-8489-b0019acb8b6a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:37.078624 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13cad48-be7e-4aa5-8489-b0019acb8b6a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:37.078910 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13cad48-be7e-4aa5-8489-b0019acb8b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:37.090244 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:37.212142 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a120860-8e4d-4205-9a23-41d6f6632d86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:37.214333 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a120860-8e4d-4205-9a23-41d6f6632d86 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:37.217810 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e13cad48-be7e-4aa5-8489-b0019acb8b6a None None] MFA Rules not processed for user `06527f5efb7e4b19b8a84c1b99df2bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:37.223663 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e13cad48-be7e-4aa5-8489-b0019acb8b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:37.227359 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 853/1680] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:37.228826 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a120860-8e4d-4205-9a23-41d6f6632d86 service nova] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:37.230731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3a120860-8e4d-4205-9a23-41d6f6632d86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:37.260411 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a120860-8e4d-4205-9a23-41d6f6632d86 service nova] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:37.293933 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:37.437705 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 828/1681] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:37 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:37.439373 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a7e98-0de3-4eac-9fdc-1455de526be4 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:37.444767 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a7e98-0de3-4eac-9fdc-1455de526be4 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:37.445252 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a7e98-0de3-4eac-9fdc-1455de526be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:37.477326 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e4c54-bd47-4f9b-ac91-e3cc53ec58a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:37.478651 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e4c54-bd47-4f9b-ac91-e3cc53ec58a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:37.481935 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e4c54-bd47-4f9b-ac91-e3cc53ec58a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:37.482463 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e4c54-bd47-4f9b-ac91-e3cc53ec58a8 admin admin] PATH_INFO: `/v3/projects/e007c11ad5c84024a07784b54bf841d0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:37.486640 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e4c54-bd47-4f9b-ac91-e3cc53ec58a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e007c11ad5c84024a07784b54bf841d0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:37.489682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e4c54-bd47-4f9b-ac91-e3cc53ec58a8 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:37.507952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-668a7e98-0de3-4eac-9fdc-1455de526be4 None None] MFA Rules not processed for user `87aa9274635e4ebfb72ddb2b231ccb62`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:37.509301 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-668a7e98-0de3-4eac-9fdc-1455de526be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:37.616096 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-023e4c54-bd47-4f9b-ac91-e3cc53ec58a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e007c11ad5c84024a07784b54bf841d0', 'request_id': 'req-023e4c54-bd47-4f9b-ac91-e3cc53ec58a8'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:37.628984 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-023e4c54-bd47-4f9b-ac91-e3cc53ec58a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e007c11ad5c84024a07784b54bf841d0', 'request_id': 'req-023e4c54-bd47-4f9b-ac91-e3cc53ec58a8'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:37.639259 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-023e4c54-bd47-4f9b-ac91-e3cc53ec58a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e007c11ad5c84024a07784b54bf841d0', 'request_id': 'req-023e4c54-bd47-4f9b-ac91-e3cc53ec58a8'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:37.680076 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-023e4c54-bd47-4f9b-ac91-e3cc53ec58a8 admin admin] The token cache is being invalidate because project e007c11ad5c84024a07784b54bf841d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:56:37.681205 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-023e4c54-bd47-4f9b-ac91-e3cc53ec58a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:37.682188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-023e4c54-bd47-4f9b-ac91-e3cc53ec58a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:37.685744 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 854/1682] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:56:37 2022] DELETE /identity/v3/projects/e007c11ad5c84024a07784b54bf841d0 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:37.686746 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e4c54-bd47-4f9b-ac91-e3cc53ec58a8 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:37.691825 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-023e4c54-bd47-4f9b-ac91-e3cc53ec58a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:37.732278 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 829/1683] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:37.734643 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0c869-c675-4b9b-9ef0-6644d7b07f4d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:37.738128 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0c869-c675-4b9b-9ef0-6644d7b07f4d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:37.738900 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0c869-c675-4b9b-9ef0-6644d7b07f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:37.794228 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-25d0c869-c675-4b9b-9ef0-6644d7b07f4d None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:37.795753 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-25d0c869-c675-4b9b-9ef0-6644d7b07f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:37.804147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:37.831749 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e4c54-bd47-4f9b-ac91-e3cc53ec58a8 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:37.842302 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c79fd3a-7f0d-484e-8ee9-504972141658 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:37.842984 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79fd3a-7f0d-484e-8ee9-504972141658 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:37.843265 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79fd3a-7f0d-484e-8ee9-504972141658 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:37.843703 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79fd3a-7f0d-484e-8ee9-504972141658 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:37.849833 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4c79fd3a-7f0d-484e-8ee9-504972141658 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:37.939685 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 830/1684] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:37.943376 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0c869-c675-4b9b-9ef0-6644d7b07f4d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:37.950073 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-25d0c869-c675-4b9b-9ef0-6644d7b07f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:37.983331 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0c869-c675-4b9b-9ef0-6644d7b07f4d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:38.003069 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75518645-a2b9-43c5-8c85-dc8d4fefefb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:38.003748 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75518645-a2b9-43c5-8c85-dc8d4fefefb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:38.004063 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75518645-a2b9-43c5-8c85-dc8d4fefefb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:38.004343 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75518645-a2b9-43c5-8c85-dc8d4fefefb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:38.014510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75518645-a2b9-43c5-8c85-dc8d4fefefb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:38.019230 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75518645-a2b9-43c5-8c85-dc8d4fefefb3 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:38.057051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c79fd3a-7f0d-484e-8ee9-504972141658 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:38.060679 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c79fd3a-7f0d-484e-8ee9-504972141658 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:38.099079 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 855/1685] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:37 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:38.101382 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4cbc5-5c92-4e45-a421-d314b545c0f2 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:38.101382 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4cbc5-5c92-4e45-a421-d314b545c0f2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:38.101642 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4cbc5-5c92-4e45-a421-d314b545c0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:38.116601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 831/1686] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:37 2022] POST /identity/v3/projects => generated 389 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:38.118821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75518645-a2b9-43c5-8c85-dc8d4fefefb3 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:38.127539 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-67b4cbc5-5c92-4e45-a421-d314b545c0f2 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:38.129952 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-67b4cbc5-5c92-4e45-a421-d314b545c0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:38.224102 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:38.252762 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 856/1687] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:38.257331 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4cbc5-5c92-4e45-a421-d314b545c0f2 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:38.270511 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75518645-a2b9-43c5-8c85-dc8d4fefefb3 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:38.272604 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4cbc5-5c92-4e45-a421-d314b545c0f2 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:38.279161 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cafeb7e-d1dd-4680-8a3b-c6bcf482825c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:38.280795 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafeb7e-d1dd-4680-8a3b-c6bcf482825c admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:38.281236 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafeb7e-d1dd-4680-8a3b-c6bcf482825c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:38.281755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafeb7e-d1dd-4680-8a3b-c6bcf482825c admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:38.282871 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cafeb7e-d1dd-4680-8a3b-c6bcf482825c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:56:38.283423 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cafeb7e-d1dd-4680-8a3b-c6bcf482825c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:38.285543 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cafeb7e-d1dd-4680-8a3b-c6bcf482825c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:38.286379 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45a46b-568f-4fdb-bb97-4e244af661f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:38.287085 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45a46b-568f-4fdb-bb97-4e244af661f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:38.287370 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45a46b-568f-4fdb-bb97-4e244af661f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:38.287653 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45a46b-568f-4fdb-bb97-4e244af661f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:38.288732 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45a46b-568f-4fdb-bb97-4e244af661f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:38.290948 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45a46b-568f-4fdb-bb97-4e244af661f0 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:38.302688 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 857/1688] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:56:38.317953 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cafeb7e-d1dd-4680-8a3b-c6bcf482825c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:38.325429 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 832/1689] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:38 2022] POST /identity/v3/users => generated 301 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:38.329222 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45a46b-568f-4fdb-bb97-4e244af661f0 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:38.347787 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45a46b-568f-4fdb-bb97-4e244af661f0 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:38.358017 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cafeb7e-d1dd-4680-8a3b-c6bcf482825c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:38.364419 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190851fc-470a-4dca-a0a7-e4a7d1450b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:38.365137 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190851fc-470a-4dca-a0a7-e4a7d1450b94 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:38.365394 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190851fc-470a-4dca-a0a7-e4a7d1450b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:38.365673 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190851fc-470a-4dca-a0a7-e4a7d1450b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:38.366418 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190851fc-470a-4dca-a0a7-e4a7d1450b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:38.368310 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190851fc-470a-4dca-a0a7-e4a7d1450b94 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:38.375434 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31153d-da4c-455f-8f57-673549f0703e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:38.381365 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31153d-da4c-455f-8f57-673549f0703e admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:38.381925 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31153d-da4c-455f-8f57-673549f0703e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:38.384007 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31153d-da4c-455f-8f57-673549f0703e admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:38.389235 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 833/1690] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:56:38.389495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31153d-da4c-455f-8f57-673549f0703e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:38.393824 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190851fc-470a-4dca-a0a7-e4a7d1450b94 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:38.395359 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31153d-da4c-455f-8f57-673549f0703e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:38.416360 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190851fc-470a-4dca-a0a7-e4a7d1450b94 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:38.431712 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137ede1-6f53-4b58-9cae-4fe17736780f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:38.432819 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137ede1-6f53-4b58-9cae-4fe17736780f admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:38.433227 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137ede1-6f53-4b58-9cae-4fe17736780f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:38.433691 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137ede1-6f53-4b58-9cae-4fe17736780f admin admin] PATH_INFO: `/v3/projects/22b8155793494afba2c8248b468a5cb2/users/4205c3d94ba44d0a8997d48923b74993/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:38.471103 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137ede1-6f53-4b58-9cae-4fe17736780f admin admin] RBAC: Authorizing `identity:create_grant(project_id=22b8155793494afba2c8248b468a5cb2, user_id=4205c3d94ba44d0a8997d48923b74993, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:38.474724 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 858/1691] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:38 2022] POST /identity/v3/projects => generated 405 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:56:38.478057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137ede1-6f53-4b58-9cae-4fe17736780f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:38.479952 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31153d-da4c-455f-8f57-673549f0703e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:38.509574 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 834/1692] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:38 2022] PUT /identity/v3/projects/22b8155793494afba2c8248b468a5cb2/users/4205c3d94ba44d0a8997d48923b74993/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:38.513562 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137ede1-6f53-4b58-9cae-4fe17736780f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:38.639653 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31153d-da4c-455f-8f57-673549f0703e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:38.653235 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fcda74-aa36-41d6-8ec1-6d8644179500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:38.659934 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcda74-aa36-41d6-8ec1-6d8644179500 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:38.661307 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137ede1-6f53-4b58-9cae-4fe17736780f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:38.661550 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcda74-aa36-41d6-8ec1-6d8644179500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:38.662031 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcda74-aa36-41d6-8ec1-6d8644179500 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:38.663927 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fcda74-aa36-41d6-8ec1-6d8644179500 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:38.666089 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fcda74-aa36-41d6-8ec1-6d8644179500 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:38.680683 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736027f-bbda-495c-8a9b-8d493f7e536b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:38.681532 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736027f-bbda-495c-8a9b-8d493f7e536b admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:38.681925 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736027f-bbda-495c-8a9b-8d493f7e536b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:38.682322 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736027f-bbda-495c-8a9b-8d493f7e536b admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:38.683271 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5736027f-bbda-495c-8a9b-8d493f7e536b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:38.685134 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5736027f-bbda-495c-8a9b-8d493f7e536b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:38.686829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:38.705050 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 835/1693] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:38.709143 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736027f-bbda-495c-8a9b-8d493f7e536b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:38.721184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736027f-bbda-495c-8a9b-8d493f7e536b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:38.731524 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf05bd-eed2-4d30-9699-c33ce1a98e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:38.733317 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 859/1694] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:38 2022] POST /identity/v3/users => generated 303 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:38.744920 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf05bd-eed2-4d30-9699-c33ce1a98e5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:38.745893 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fcda74-aa36-41d6-8ec1-6d8644179500 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:38.746465 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf05bd-eed2-4d30-9699-c33ce1a98e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:38.747452 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf05bd-eed2-4d30-9699-c33ce1a98e5c admin admin] PATH_INFO: `/v3/projects/22b8155793494afba2c8248b468a5cb2/users/4205c3d94ba44d0a8997d48923b74993/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:38.755802 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf05bd-eed2-4d30-9699-c33ce1a98e5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=22b8155793494afba2c8248b468a5cb2, user_id=4205c3d94ba44d0a8997d48923b74993, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:38.767548 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf05bd-eed2-4d30-9699-c33ce1a98e5c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:38.784004 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fcda74-aa36-41d6-8ec1-6d8644179500 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:38.821341 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 836/1695] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:38 2022] PUT /identity/v3/projects/22b8155793494afba2c8248b468a5cb2/users/4205c3d94ba44d0a8997d48923b74993/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:38.823933 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6172ed6-af8d-449a-8060-677ceb8db4a3 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:38.827514 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6172ed6-af8d-449a-8060-677ceb8db4a3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:38.828099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6172ed6-af8d-449a-8060-677ceb8db4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:38.900474 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d6172ed6-af8d-449a-8060-677ceb8db4a3 None None] MFA Rules not processed for user `4205c3d94ba44d0a8997d48923b74993`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:38.905339 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d6172ed6-af8d-449a-8060-677ceb8db4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:38.956688 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84246bd-6ae6-4a9b-baff-424b8c66de52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:38.957878 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84246bd-6ae6-4a9b-baff-424b8c66de52 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:38.958328 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84246bd-6ae6-4a9b-baff-424b8c66de52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:38.958743 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84246bd-6ae6-4a9b-baff-424b8c66de52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:38.959618 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84246bd-6ae6-4a9b-baff-424b8c66de52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:38.964241 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84246bd-6ae6-4a9b-baff-424b8c66de52 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:38.992953 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 860/1696] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:38.996980 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84246bd-6ae6-4a9b-baff-424b8c66de52 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:39.013443 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84246bd-6ae6-4a9b-baff-424b8c66de52 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:39.028105 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1251dc2a-2f2a-4806-a1e7-b16d55f2a32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:39.029432 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1251dc2a-2f2a-4806-a1e7-b16d55f2a32e admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:39.029864 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1251dc2a-2f2a-4806-a1e7-b16d55f2a32e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:39.030330 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1251dc2a-2f2a-4806-a1e7-b16d55f2a32e admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:39.031241 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1251dc2a-2f2a-4806-a1e7-b16d55f2a32e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:39.035323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1251dc2a-2f2a-4806-a1e7-b16d55f2a32e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:39.059335 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 861/1697] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:39.063494 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1251dc2a-2f2a-4806-a1e7-b16d55f2a32e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:39.087443 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1251dc2a-2f2a-4806-a1e7-b16d55f2a32e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:39.093080 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccefac2-6a69-4ac4-a743-ca349b581038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:39.094282 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccefac2-6a69-4ac4-a743-ca349b581038 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:39.094707 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccefac2-6a69-4ac4-a743-ca349b581038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:39.095122 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccefac2-6a69-4ac4-a743-ca349b581038 admin admin] PATH_INFO: `/v3/projects/226fc32d674c480bbd1e2f9ccde46115/users/97924b24a1494189a202ecf25b24b2f4/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:39.114000 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:39.132595 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 837/1698] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:56:39.148529 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6172ed6-af8d-449a-8060-677ceb8db4a3 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:39.152271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccefac2-6a69-4ac4-a743-ca349b581038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=226fc32d674c480bbd1e2f9ccde46115, user_id=97924b24a1494189a202ecf25b24b2f4, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:39.156741 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccefac2-6a69-4ac4-a743-ca349b581038 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:39.181263 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 862/1699] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:39 2022] PUT /identity/v3/projects/226fc32d674c480bbd1e2f9ccde46115/users/97924b24a1494189a202ecf25b24b2f4/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:39.193413 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321a2ad-db29-4107-851a-9059685ca40b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:39.194117 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321a2ad-db29-4107-851a-9059685ca40b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:39.194621 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321a2ad-db29-4107-851a-9059685ca40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:39.227550 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6172ed6-af8d-449a-8060-677ceb8db4a3 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:39.277268 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-6321a2ad-db29-4107-851a-9059685ca40b None None] MFA Rules not processed for user `97924b24a1494189a202ecf25b24b2f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:39.280045 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6321a2ad-db29-4107-851a-9059685ca40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:39.310739 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa25c72-8e16-4a34-95fd-2aa02f5eeecb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:39.313678 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa25c72-8e16-4a34-95fd-2aa02f5eeecb service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:39.315039 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa25c72-8e16-4a34-95fd-2aa02f5eeecb service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:39.315299 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa25c72-8e16-4a34-95fd-2aa02f5eeecb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:39.449409 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa25c72-8e16-4a34-95fd-2aa02f5eeecb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:39.461839 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa25c72-8e16-4a34-95fd-2aa02f5eeecb service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:39.502666 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 838/1700] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:39 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:56:39.510163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543da5b8-b67d-4701-93d7-7136026e510c None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:39.510536 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543da5b8-b67d-4701-93d7-7136026e510c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:39.510837 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543da5b8-b67d-4701-93d7-7136026e510c None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:39.516223 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 839/1701] 10.222.0.85 () {54 vars in 912 bytes} [Thu Jun 16 14:56:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:56:39.523926 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c156745-5c97-49a1-8063-88925c0c5420 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:39.524403 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c156745-5c97-49a1-8063-88925c0c5420 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:39.524904 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c156745-5c97-49a1-8063-88925c0c5420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:39.563724 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 863/1702] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:39 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:56:39.566550 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321a2ad-db29-4107-851a-9059685ca40b None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:39.650666 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3c156745-5c97-49a1-8063-88925c0c5420 None None] MFA Rules not processed for user `3d3d59fabcf94718bbc005519cec6f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:39.652298 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3c156745-5c97-49a1-8063-88925c0c5420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:39.746136 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:39.786774 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321a2ad-db29-4107-851a-9059685ca40b None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:39.822675 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe7d86-f1c7-4e0c-9a51-e24d5a7bcd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:39.823457 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe7d86-f1c7-4e0c-9a51-e24d5a7bcd64 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:39.823830 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe7d86-f1c7-4e0c-9a51-e24d5a7bcd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:39.824197 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe7d86-f1c7-4e0c-9a51-e24d5a7bcd64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:39.825020 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe7d86-f1c7-4e0c-9a51-e24d5a7bcd64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:39.827216 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe7d86-f1c7-4e0c-9a51-e24d5a7bcd64 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:39.861130 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 840/1703] 10.222.0.85 () {58 vars in 1009 bytes} [Thu Jun 16 14:56:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:39.867417 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c156745-5c97-49a1-8063-88925c0c5420 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:39.888531 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:39.906125 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c156745-5c97-49a1-8063-88925c0c5420 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:39.916930 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d488c9a-8d6a-4f21-809a-452136e95fb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:39.917672 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d488c9a-8d6a-4f21-809a-452136e95fb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:39.917967 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d488c9a-8d6a-4f21-809a-452136e95fb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:39.919477 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d488c9a-8d6a-4f21-809a-452136e95fb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:39.922748 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6d488c9a-8d6a-4f21-809a-452136e95fb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:39.931994 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 864/1704] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:39 2022] POST /identity/v3/projects => generated 405 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:39.932673 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe7d86-f1c7-4e0c-9a51-e24d5a7bcd64 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:40.091901 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d488c9a-8d6a-4f21-809a-452136e95fb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:40.093758 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d488c9a-8d6a-4f21-809a-452136e95fb5 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:40.108397 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe7d86-f1c7-4e0c-9a51-e24d5a7bcd64 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:40.123757 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0916ef6-ab32-4f7f-b8c1-ea6ca70e9040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:40.126263 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0916ef6-ab32-4f7f-b8c1-ea6ca70e9040 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:40.126555 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0916ef6-ab32-4f7f-b8c1-ea6ca70e9040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:40.126834 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0916ef6-ab32-4f7f-b8c1-ea6ca70e9040 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:40.127553 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0916ef6-ab32-4f7f-b8c1-ea6ca70e9040 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:40.131789 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0916ef6-ab32-4f7f-b8c1-ea6ca70e9040 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:40.146901 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 841/1705] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:40.168324 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 865/1706] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:39 2022] POST /identity/v3/users => generated 309 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:40.173016 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d488c9a-8d6a-4f21-809a-452136e95fb5 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:40.187554 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0916ef6-ab32-4f7f-b8c1-ea6ca70e9040 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:40.191328 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a0916ef6-ab32-4f7f-b8c1-ea6ca70e9040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:40.205281 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d488c9a-8d6a-4f21-809a-452136e95fb5 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:40.222438 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8a2c8-6102-429e-b13b-9a24c8b35ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:40.229250 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8a2c8-6102-429e-b13b-9a24c8b35ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:40.229584 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8a2c8-6102-429e-b13b-9a24c8b35ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:40.229871 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8a2c8-6102-429e-b13b-9a24c8b35ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:40.230639 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8a2c8-6102-429e-b13b-9a24c8b35ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:40.248723 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8a2c8-6102-429e-b13b-9a24c8b35ae9 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:40.287258 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 842/1707] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:40.291771 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8a2c8-6102-429e-b13b-9a24c8b35ae9 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:40.329303 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8a2c8-6102-429e-b13b-9a24c8b35ae9 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:40.377275 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b56a21-bba2-4f01-80d9-6841ff1ac1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:40.378351 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b56a21-bba2-4f01-80d9-6841ff1ac1e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:40.379042 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b56a21-bba2-4f01-80d9-6841ff1ac1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:40.379481 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b56a21-bba2-4f01-80d9-6841ff1ac1e2 admin admin] PATH_INFO: `/v3/projects/3f86d61604504c25b61e2c54f947544e/users/fb7229c2ba36481b883f8b271a5471ec/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:40.428810 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b56a21-bba2-4f01-80d9-6841ff1ac1e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f86d61604504c25b61e2c54f947544e, user_id=fb7229c2ba36481b883f8b271a5471ec, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:40.444920 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b56a21-bba2-4f01-80d9-6841ff1ac1e2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:40.509501 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 843/1708] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:40 2022] PUT /identity/v3/projects/3f86d61604504c25b61e2c54f947544e/users/fb7229c2ba36481b883f8b271a5471ec/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:40.512432 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b56a21-bba2-4f01-80d9-6841ff1ac1e2 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:40.605998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0916ef6-ab32-4f7f-b8c1-ea6ca70e9040 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:40.771589 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b56a21-bba2-4f01-80d9-6841ff1ac1e2 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:40.788105 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2a6e6-e93f-4ada-b27c-aa3498049880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:40.797078 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2a6e6-e93f-4ada-b27c-aa3498049880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:40.797379 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2a6e6-e93f-4ada-b27c-aa3498049880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:40.797691 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2a6e6-e93f-4ada-b27c-aa3498049880 admin admin] PATH_INFO: `/v3/users/87aa9274635e4ebfb72ddb2b231ccb62` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:40.804883 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b2a6e6-e93f-4ada-b27c-aa3498049880 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87aa9274635e4ebfb72ddb2b231ccb62)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:40.805022 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef097c-2ddf-42fe-8313-0959fb002138 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:40.805555 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef097c-2ddf-42fe-8313-0959fb002138 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:40.805836 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef097c-2ddf-42fe-8313-0959fb002138 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:40.806150 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef097c-2ddf-42fe-8313-0959fb002138 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:40.814470 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b2a6e6-e93f-4ada-b27c-aa3498049880 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:40.846993 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef097c-2ddf-42fe-8313-0959fb002138 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:40.848491 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef097c-2ddf-42fe-8313-0959fb002138 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:40.889832 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 866/1709] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 703 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:56:40.890665 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef097c-2ddf-42fe-8313-0959fb002138 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:40.928727 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef097c-2ddf-42fe-8313-0959fb002138 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:40.947499 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5515fa1-3eea-4d82-8ff3-8ee1bd42cf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:40.948375 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5515fa1-3eea-4d82-8ff3-8ee1bd42cf89 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:40.948718 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5515fa1-3eea-4d82-8ff3-8ee1bd42cf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:40.948999 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5515fa1-3eea-4d82-8ff3-8ee1bd42cf89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:40.949725 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5515fa1-3eea-4d82-8ff3-8ee1bd42cf89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:40.951347 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5515fa1-3eea-4d82-8ff3-8ee1bd42cf89 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:40.990665 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 867/1710] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:40.997180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5515fa1-3eea-4d82-8ff3-8ee1bd42cf89 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:41.006386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e4b2a6e6-e93f-4ada-b27c-aa3498049880 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87aa9274635e4ebfb72ddb2b231ccb62'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:41.013016 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:41.042216 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5515fa1-3eea-4d82-8ff3-8ee1bd42cf89 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:41.059858 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e4b2a6e6-e93f-4ada-b27c-aa3498049880 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87aa9274635e4ebfb72ddb2b231ccb62'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:41.071532 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da0c47-d318-4304-a920-d9c59a807fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:41.083343 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da0c47-d318-4304-a920-d9c59a807fab admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:41.085321 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da0c47-d318-4304-a920-d9c59a807fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:41.085913 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e4b2a6e6-e93f-4ada-b27c-aa3498049880 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87aa9274635e4ebfb72ddb2b231ccb62'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:41.086703 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da0c47-d318-4304-a920-d9c59a807fab admin admin] PATH_INFO: `/v3/projects/3f86d61604504c25b61e2c54f947544e/users/fb7229c2ba36481b883f8b271a5471ec/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:41.105707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:41.109038 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da0c47-d318-4304-a920-d9c59a807fab admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f86d61604504c25b61e2c54f947544e, user_id=fb7229c2ba36481b883f8b271a5471ec, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:41.123430 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da0c47-d318-4304-a920-d9c59a807fab admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:41.143587 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e4b2a6e6-e93f-4ada-b27c-aa3498049880 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87aa9274635e4ebfb72ddb2b231ccb62'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:41.145386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e4b2a6e6-e93f-4ada-b27c-aa3498049880 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87aa9274635e4ebfb72ddb2b231ccb62'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:41.165167 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 844/1711] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:56:40 2022] DELETE /identity/v3/users/87aa9274635e4ebfb72ddb2b231ccb62 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:41.175069 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27cfaa-fe61-401c-886e-964583f4a159 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:41.175412 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27cfaa-fe61-401c-886e-964583f4a159 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:41.180836 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27cfaa-fe61-401c-886e-964583f4a159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:41.193762 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 868/1712] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:40 2022] PUT /identity/v3/projects/3f86d61604504c25b61e2c54f947544e/users/fb7229c2ba36481b883f8b271a5471ec/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:41.195665 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b41ba-147c-43ba-82b2-9d51d89e2f67 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:41.195985 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b41ba-147c-43ba-82b2-9d51d89e2f67 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:41.196267 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b41ba-147c-43ba-82b2-9d51d89e2f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:41.297453 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-375b41ba-147c-43ba-82b2-9d51d89e2f67 None None] MFA Rules not processed for user `fb7229c2ba36481b883f8b271a5471ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:41.298795 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-375b41ba-147c-43ba-82b2-9d51d89e2f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:41.307802 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-0c27cfaa-fe61-401c-886e-964583f4a159 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:41.314764 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0c27cfaa-fe61-401c-886e-964583f4a159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:41.538884 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 845/1713] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:41.541124 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83770dc5-494e-437b-bd3f-e28f16465282 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:41.541430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83770dc5-494e-437b-bd3f-e28f16465282 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:41.541706 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83770dc5-494e-437b-bd3f-e28f16465282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:41.630872 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-83770dc5-494e-437b-bd3f-e28f16465282 None None] MFA Rules not processed for user `74029b3845b4408bb58332e21e801ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:41.632122 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-83770dc5-494e-437b-bd3f-e28f16465282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:41.672661 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 869/1714] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:41 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 478 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:41.687075 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b41ba-147c-43ba-82b2-9d51d89e2f67 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:41.689274 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-375b41ba-147c-43ba-82b2-9d51d89e2f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:41.791943 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 846/1715] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:41.792772 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83770dc5-494e-437b-bd3f-e28f16465282 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:41.801276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-83770dc5-494e-437b-bd3f-e28f16465282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:41.845936 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b41ba-147c-43ba-82b2-9d51d89e2f67 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:41.859656 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b65759-942a-46d5-82fa-4a892bd4d1b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:41.865274 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b65759-942a-46d5-82fa-4a892bd4d1b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:41.865434 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b65759-942a-46d5-82fa-4a892bd4d1b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:41.865722 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b65759-942a-46d5-82fa-4a892bd4d1b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:41.898802 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b65759-942a-46d5-82fa-4a892bd4d1b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:41.902871 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b65759-942a-46d5-82fa-4a892bd4d1b0 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:41.925128 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83770dc5-494e-437b-bd3f-e28f16465282 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:41.937068 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2912730-a628-4a78-acdb-b0d7e28df899 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:41.939303 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2912730-a628-4a78-acdb-b0d7e28df899 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:41.939528 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2912730-a628-4a78-acdb-b0d7e28df899 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:41.942199 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2912730-a628-4a78-acdb-b0d7e28df899 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:41.954187 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 870/1716] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:41.954910 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b65759-942a-46d5-82fa-4a892bd4d1b0 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:41.964424 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2912730-a628-4a78-acdb-b0d7e28df899 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:41.965032 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-27b65759-942a-46d5-82fa-4a892bd4d1b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:41.965902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2912730-a628-4a78-acdb-b0d7e28df899 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:41.985258 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 847/1717] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:41 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:42.200413 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b65759-942a-46d5-82fa-4a892bd4d1b0 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:42.235983 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2912730-a628-4a78-acdb-b0d7e28df899 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:42.238120 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a2912730-a628-4a78-acdb-b0d7e28df899 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:42.241294 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eaa376-66c7-4b8f-8b70-0edae799b8bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:42.242062 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eaa376-66c7-4b8f-8b70-0edae799b8bf service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:42.242455 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eaa376-66c7-4b8f-8b70-0edae799b8bf service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:42.242803 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eaa376-66c7-4b8f-8b70-0edae799b8bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:42.260268 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2912730-a628-4a78-acdb-b0d7e28df899 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:42.263329 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eaa376-66c7-4b8f-8b70-0edae799b8bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:42.265161 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eaa376-66c7-4b8f-8b70-0edae799b8bf service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:42.266644 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81937c73-224d-4152-ba60-8c890c12ebd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:42.267631 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81937c73-224d-4152-ba60-8c890c12ebd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:42.275091 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81937c73-224d-4152-ba60-8c890c12ebd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:42.275390 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81937c73-224d-4152-ba60-8c890c12ebd3 admin admin] PATH_INFO: `/v3/users/97924b24a1494189a202ecf25b24b2f4` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:42.276920 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81937c73-224d-4152-ba60-8c890c12ebd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97924b24a1494189a202ecf25b24b2f4)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:42.288271 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81937c73-224d-4152-ba60-8c890c12ebd3 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:42.315696 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 871/1718] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:42.340012 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:42.440911 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-81937c73-224d-4152-ba60-8c890c12ebd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97924b24a1494189a202ecf25b24b2f4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:42.465392 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-81937c73-224d-4152-ba60-8c890c12ebd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97924b24a1494189a202ecf25b24b2f4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:42.489991 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-81937c73-224d-4152-ba60-8c890c12ebd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97924b24a1494189a202ecf25b24b2f4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:42.532222 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-81937c73-224d-4152-ba60-8c890c12ebd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97924b24a1494189a202ecf25b24b2f4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:42.536103 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-81937c73-224d-4152-ba60-8c890c12ebd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97924b24a1494189a202ecf25b24b2f4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:42.564861 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 848/1719] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:56:42 2022] DELETE /identity/v3/users/97924b24a1494189a202ecf25b24b2f4 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:42.570386 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad07e4-b410-4715-9f9b-1dc2b198c3bd None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:42.570684 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad07e4-b410-4715-9f9b-1dc2b198c3bd None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:42.570998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad07e4-b410-4715-9f9b-1dc2b198c3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:42.582853 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:42.587101 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310dafc-9f93-4d89-9977-bad64553fe91 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:42.587790 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310dafc-9f93-4d89-9977-bad64553fe91 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:42.588293 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310dafc-9f93-4d89-9977-bad64553fe91 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:42.593006 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 849/1720] 10.222.0.85 () {54 vars in 960 bytes} [Thu Jun 16 14:56:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:56:42.599113 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a684ebf-b029-4b10-a0c1-2a461c6a0a72 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:42.599970 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a684ebf-b029-4b10-a0c1-2a461c6a0a72 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:42.600493 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a684ebf-b029-4b10-a0c1-2a461c6a0a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:42.632477 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d7ad07e4-b410-4715-9f9b-1dc2b198c3bd None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:42.633778 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d7ad07e4-b410-4715-9f9b-1dc2b198c3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:42.678236 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1a684ebf-b029-4b10-a0c1-2a461c6a0a72 None None] MFA Rules not processed for user `819ad532defb4adaa2f4fd06b47630d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:42.683653 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1a684ebf-b029-4b10-a0c1-2a461c6a0a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:42.875111 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 872/1721] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:56:42.882380 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c1183-4ad7-4156-894b-5fbde3dad8dc None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:42.883290 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c1183-4ad7-4156-894b-5fbde3dad8dc None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:42.883397 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c1183-4ad7-4156-894b-5fbde3dad8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:42.918795 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 850/1722] 10.222.0.85 () {58 vars in 1057 bytes} [Thu Jun 16 14:56:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:42.925181 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a684ebf-b029-4b10-a0c1-2a461c6a0a72 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:42.931070 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-bd3c1183-4ad7-4156-894b-5fbde3dad8dc None None] MFA Rules not processed for user `4e10f63b54224607996ab53536ad00d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:42.945785 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-bd3c1183-4ad7-4156-894b-5fbde3dad8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:42.956262 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a684ebf-b029-4b10-a0c1-2a461c6a0a72 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:42.998908 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb3dd1-d764-47e7-a314-7fa5e16a295b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819ad532defb4adaa2f4fd06b47630d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:42.999811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb3dd1-d764-47e7-a314-7fa5e16a295b service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:43.000291 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb3dd1-d764-47e7-a314-7fa5e16a295b service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:43.003622 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb3dd1-d764-47e7-a314-7fa5e16a295b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:43.007666 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-acfb3dd1-d764-47e7-a314-7fa5e16a295b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:43.041722 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb3dd1-d764-47e7-a314-7fa5e16a295b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:43.043968 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb3dd1-d764-47e7-a314-7fa5e16a295b service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:43.066135 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 851/1723] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:43.067049 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb3dd1-d764-47e7-a314-7fa5e16a295b service placement] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:43.073952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-acfb3dd1-d764-47e7-a314-7fa5e16a295b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:43.122320 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 873/1724] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:43.259274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb3dd1-d764-47e7-a314-7fa5e16a295b service placement] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:43.264923 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39668f79-e31b-4e0c-9269-70d410d588dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:43.266135 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39668f79-e31b-4e0c-9269-70d410d588dd service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:43.266790 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39668f79-e31b-4e0c-9269-70d410d588dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:43.267163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39668f79-e31b-4e0c-9269-70d410d588dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:43.309826 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39668f79-e31b-4e0c-9269-70d410d588dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:43.311468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39668f79-e31b-4e0c-9269-70d410d588dd service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:43.340745 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 852/1725] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:43.861308 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69b085-f5ed-4fe7-9319-fbc6d30b8f4e None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:43.861670 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69b085-f5ed-4fe7-9319-fbc6d30b8f4e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:43.862026 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69b085-f5ed-4fe7-9319-fbc6d30b8f4e None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:43.863695 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 874/1726] 10.222.0.85 () {54 vars in 912 bytes} [Thu Jun 16 14:56:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:56:43.881921 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe5d36-3abc-46e2-9bdd-c9e43087110b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:43.882206 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe5d36-3abc-46e2-9bdd-c9e43087110b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:43.882486 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe5d36-3abc-46e2-9bdd-c9e43087110b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:43.925102 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1dbe5d36-3abc-46e2-9bdd-c9e43087110b None None] MFA Rules not processed for user `3d3d59fabcf94718bbc005519cec6f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:43.925202 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1dbe5d36-3abc-46e2-9bdd-c9e43087110b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:43.942334 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 853/1727] 10.222.0.85 () {58 vars in 1009 bytes} [Thu Jun 16 14:56:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:56:43.973120 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69b085-f5ed-4fe7-9319-fbc6d30b8f4e None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:43.976093 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-da69b085-f5ed-4fe7-9319-fbc6d30b8f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:44.017459 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69b085-f5ed-4fe7-9319-fbc6d30b8f4e None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:44.024607 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c164c64-dc70-4d82-8182-8920e7708942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:44.027108 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c164c64-dc70-4d82-8182-8920e7708942 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:44.027505 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c164c64-dc70-4d82-8182-8920e7708942 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:44.027915 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c164c64-dc70-4d82-8182-8920e7708942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:44.046254 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c164c64-dc70-4d82-8182-8920e7708942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:44.054649 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c164c64-dc70-4d82-8182-8920e7708942 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:44.105950 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 875/1728] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:44.535045 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe5d36-3abc-46e2-9bdd-c9e43087110b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:44.536594 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1dbe5d36-3abc-46e2-9bdd-c9e43087110b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:44.570379 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe5d36-3abc-46e2-9bdd-c9e43087110b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:44.598876 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb0bd8-8ad9-472c-b92a-81ca71e3ac41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:44.599862 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb0bd8-8ad9-472c-b92a-81ca71e3ac41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:44.600168 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb0bd8-8ad9-472c-b92a-81ca71e3ac41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:44.600447 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb0bd8-8ad9-472c-b92a-81ca71e3ac41 admin admin] PATH_INFO: `/v3/projects/a3c8419bb409482981559fda9d5bf1c0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:44.603787 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb0bd8-8ad9-472c-b92a-81ca71e3ac41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3c8419bb409482981559fda9d5bf1c0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:44.613016 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb0bd8-8ad9-472c-b92a-81ca71e3ac41 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:44.622068 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:44.663138 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9830353-4bef-4397-8c30-14c530cfc204 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:44.663580 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9830353-4bef-4397-8c30-14c530cfc204 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:44.664083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9830353-4bef-4397-8c30-14c530cfc204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:44.746475 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d9830353-4bef-4397-8c30-14c530cfc204 None None] MFA Rules not processed for user `80e736205b5f4f4588f74b33624a5c15`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:44.754798 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d9830353-4bef-4397-8c30-14c530cfc204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:44.816366 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-46cb0bd8-8ad9-472c-b92a-81ca71e3ac41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3c8419bb409482981559fda9d5bf1c0', 'request_id': 'req-46cb0bd8-8ad9-472c-b92a-81ca71e3ac41'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:44.843285 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-46cb0bd8-8ad9-472c-b92a-81ca71e3ac41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3c8419bb409482981559fda9d5bf1c0', 'request_id': 'req-46cb0bd8-8ad9-472c-b92a-81ca71e3ac41'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:44.873334 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-46cb0bd8-8ad9-472c-b92a-81ca71e3ac41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3c8419bb409482981559fda9d5bf1c0', 'request_id': 'req-46cb0bd8-8ad9-472c-b92a-81ca71e3ac41'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:44.943093 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-46cb0bd8-8ad9-472c-b92a-81ca71e3ac41 admin admin] The token cache is being invalidate because project a3c8419bb409482981559fda9d5bf1c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:56:44.943379 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-46cb0bd8-8ad9-472c-b92a-81ca71e3ac41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:44.951604 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-46cb0bd8-8ad9-472c-b92a-81ca71e3ac41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:44.965994 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 854/1729] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:56:44 2022] DELETE /identity/v3/projects/a3c8419bb409482981559fda9d5bf1c0 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:44.972618 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb0bd8-8ad9-472c-b92a-81ca71e3ac41 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:44.982330 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-46cb0bd8-8ad9-472c-b92a-81ca71e3ac41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:45.120622 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 876/1730] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:45.130660 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeee00d-b2c3-4721-abff-ff25a4fa82f4 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:45.132495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeee00d-b2c3-4721-abff-ff25a4fa82f4 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:45.132783 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeee00d-b2c3-4721-abff-ff25a4fa82f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:45.238822 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-cfeee00d-b2c3-4721-abff-ff25a4fa82f4 None None] MFA Rules not processed for user `80e736205b5f4f4588f74b33624a5c15`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:45.242768 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-cfeee00d-b2c3-4721-abff-ff25a4fa82f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:45.281115 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 877/1731] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:45.293463 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeee00d-b2c3-4721-abff-ff25a4fa82f4 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:45.293463 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-cfeee00d-b2c3-4721-abff-ff25a4fa82f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:45.317861 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb0bd8-8ad9-472c-b92a-81ca71e3ac41 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:45.323266 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be14106-b1f7-4db6-90e1-0fc9ce8fd665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:45.324476 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be14106-b1f7-4db6-90e1-0fc9ce8fd665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:45.327047 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be14106-b1f7-4db6-90e1-0fc9ce8fd665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:45.328499 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be14106-b1f7-4db6-90e1-0fc9ce8fd665 admin admin] PATH_INFO: `/v3/users/4205c3d94ba44d0a8997d48923b74993` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:45.331854 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be14106-b1f7-4db6-90e1-0fc9ce8fd665 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4205c3d94ba44d0a8997d48923b74993)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:45.337655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be14106-b1f7-4db6-90e1-0fc9ce8fd665 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:45.361582 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:45.496506 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8be14106-b1f7-4db6-90e1-0fc9ce8fd665 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4205c3d94ba44d0a8997d48923b74993'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:45.529738 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8be14106-b1f7-4db6-90e1-0fc9ce8fd665 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4205c3d94ba44d0a8997d48923b74993'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:45.541089 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8be14106-b1f7-4db6-90e1-0fc9ce8fd665 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4205c3d94ba44d0a8997d48923b74993'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:45.572378 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8be14106-b1f7-4db6-90e1-0fc9ce8fd665 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4205c3d94ba44d0a8997d48923b74993'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:45.573212 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8be14106-b1f7-4db6-90e1-0fc9ce8fd665 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4205c3d94ba44d0a8997d48923b74993'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:45.582574 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 855/1732] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:56:44 2022] DELETE /identity/v3/users/4205c3d94ba44d0a8997d48923b74993 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:45.606854 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeee00d-b2c3-4721-abff-ff25a4fa82f4 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:45.801233 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3437f-e930-43f0-b802-846daf48b51b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:45.802257 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3437f-e930-43f0-b802-846daf48b51b service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:45.802543 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3437f-e930-43f0-b802-846daf48b51b service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:45.802906 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3437f-e930-43f0-b802-846daf48b51b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:45.806681 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-aaf3437f-e930-43f0-b802-846daf48b51b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:45.933479 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf3437f-e930-43f0-b802-846daf48b51b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:45.937244 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf3437f-e930-43f0-b802-846daf48b51b service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:45.953824 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 878/1733] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:56:46.087684 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be14106-b1f7-4db6-90e1-0fc9ce8fd665 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:46.089167 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8be14106-b1f7-4db6-90e1-0fc9ce8fd665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:46.117262 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:46.302584 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be14106-b1f7-4db6-90e1-0fc9ce8fd665 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:46.319169 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600581d-3979-4d17-ad06-03dcf6ee68fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:46.322489 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600581d-3979-4d17-ad06-03dcf6ee68fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:46.323197 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600581d-3979-4d17-ad06-03dcf6ee68fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:46.323605 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600581d-3979-4d17-ad06-03dcf6ee68fb admin admin] PATH_INFO: `/v3/projects/226fc32d674c480bbd1e2f9ccde46115` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:46.340601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7600581d-3979-4d17-ad06-03dcf6ee68fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=226fc32d674c480bbd1e2f9ccde46115)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:46.343299 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7600581d-3979-4d17-ad06-03dcf6ee68fb admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:46.488279 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7600581d-3979-4d17-ad06-03dcf6ee68fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '226fc32d674c480bbd1e2f9ccde46115', 'request_id': 'req-7600581d-3979-4d17-ad06-03dcf6ee68fb'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:46.505286 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3437f-e930-43f0-b802-846daf48b51b service nova] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:46.508123 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-aaf3437f-e930-43f0-b802-846daf48b51b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:46.528787 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7600581d-3979-4d17-ad06-03dcf6ee68fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '226fc32d674c480bbd1e2f9ccde46115', 'request_id': 'req-7600581d-3979-4d17-ad06-03dcf6ee68fb'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:46.546332 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7600581d-3979-4d17-ad06-03dcf6ee68fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '226fc32d674c480bbd1e2f9ccde46115', 'request_id': 'req-7600581d-3979-4d17-ad06-03dcf6ee68fb'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:46.575382 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7600581d-3979-4d17-ad06-03dcf6ee68fb admin admin] The token cache is being invalidate because project 226fc32d674c480bbd1e2f9ccde46115 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:56:46.584792 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7600581d-3979-4d17-ad06-03dcf6ee68fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:46.586704 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7600581d-3979-4d17-ad06-03dcf6ee68fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:46.594993 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 856/1734] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:56:46 2022] DELETE /identity/v3/projects/226fc32d674c480bbd1e2f9ccde46115 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:46.596346 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600581d-3979-4d17-ad06-03dcf6ee68fb admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:46.602636 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7600581d-3979-4d17-ad06-03dcf6ee68fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:46.690043 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3437f-e930-43f0-b802-846daf48b51b service nova] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:46.700418 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:46.836467 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6cc7a3-7181-4976-8a89-151ba98217c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:46.862721 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cc7a3-7181-4976-8a89-151ba98217c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:46.864013 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cc7a3-7181-4976-8a89-151ba98217c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:46.865703 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cc7a3-7181-4976-8a89-151ba98217c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:46.871668 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1f6cc7a3-7181-4976-8a89-151ba98217c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:46.883194 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600581d-3979-4d17-ad06-03dcf6ee68fb admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:46.907503 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f5771-ca62-4a89-b8ea-2524af8866f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:46.908410 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f5771-ca62-4a89-b8ea-2524af8866f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:46.909493 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f5771-ca62-4a89-b8ea-2524af8866f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:46.909493 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f5771-ca62-4a89-b8ea-2524af8866f3 admin admin] PATH_INFO: `/v3/users/fb7229c2ba36481b883f8b271a5471ec` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:46.912187 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f5771-ca62-4a89-b8ea-2524af8866f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb7229c2ba36481b883f8b271a5471ec)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:46.914767 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f5771-ca62-4a89-b8ea-2524af8866f3 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:47.012620 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:47.027302 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-778f5771-ca62-4a89-b8ea-2524af8866f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb7229c2ba36481b883f8b271a5471ec'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:47.051533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-778f5771-ca62-4a89-b8ea-2524af8866f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb7229c2ba36481b883f8b271a5471ec'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:47.067794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-778f5771-ca62-4a89-b8ea-2524af8866f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb7229c2ba36481b883f8b271a5471ec'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:47.104752 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6cc7a3-7181-4976-8a89-151ba98217c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:47.108935 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6cc7a3-7181-4976-8a89-151ba98217c9 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:47.109170 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-778f5771-ca62-4a89-b8ea-2524af8866f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb7229c2ba36481b883f8b271a5471ec'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:47.110202 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-778f5771-ca62-4a89-b8ea-2524af8866f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb7229c2ba36481b883f8b271a5471ec'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:47.129589 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 857/1735] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:56:46 2022] DELETE /identity/v3/users/fb7229c2ba36481b883f8b271a5471ec => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:47.152352 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d8066-8c6e-4142-a026-08c3b4ae4bf5 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:47.152692 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d8066-8c6e-4142-a026-08c3b4ae4bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:47.152979 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d8066-8c6e-4142-a026-08c3b4ae4bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:47.174348 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 879/1736] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:56:47.175718 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a991ab9-591d-4676-99ba-f64567a233b2 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:47.176104 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a991ab9-591d-4676-99ba-f64567a233b2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:47.176288 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a991ab9-591d-4676-99ba-f64567a233b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:47.239535 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c63d8066-8c6e-4142-a026-08c3b4ae4bf5 None None] MFA Rules not processed for user `431f66d8c09d4eb194600509e7300bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:47.240346 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c63d8066-8c6e-4142-a026-08c3b4ae4bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:47.259046 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-7a991ab9-591d-4676-99ba-f64567a233b2 None None] MFA Rules not processed for user `db4d36e6837d4b2fa4b7ee5c7243b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:47.272444 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7a991ab9-591d-4676-99ba-f64567a233b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:47.412139 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 858/1737] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:47.428061 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d8066-8c6e-4142-a026-08c3b4ae4bf5 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:47.430553 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c63d8066-8c6e-4142-a026-08c3b4ae4bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:47.538706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 880/1738] 10.222.0.85 () {58 vars in 1009 bytes} [Thu Jun 16 14:56:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:47.744249 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d8066-8c6e-4142-a026-08c3b4ae4bf5 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:47.756055 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888bc3d-3706-4df0-b05b-a2686b9239a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:47.757855 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888bc3d-3706-4df0-b05b-a2686b9239a8 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:47.758494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888bc3d-3706-4df0-b05b-a2686b9239a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:47.759076 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888bc3d-3706-4df0-b05b-a2686b9239a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:47.789348 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0888bc3d-3706-4df0-b05b-a2686b9239a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:47.792693 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0888bc3d-3706-4df0-b05b-a2686b9239a8 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:47.848251 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 859/1739] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:56:47.849092 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a991ab9-591d-4676-99ba-f64567a233b2 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:47.884630 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7a991ab9-591d-4676-99ba-f64567a233b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:48.113481 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a991ab9-591d-4676-99ba-f64567a233b2 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:48.134101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96692dc8-65db-40e8-9c00-592c403e4d5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf9c39de29324b0ca6329c9a171367c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:48.135143 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96692dc8-65db-40e8-9c00-592c403e4d5a service swift] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:48.135556 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96692dc8-65db-40e8-9c00-592c403e4d5a service swift] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:48.136082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96692dc8-65db-40e8-9c00-592c403e4d5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:48.161342 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96692dc8-65db-40e8-9c00-592c403e4d5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:48.163242 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96692dc8-65db-40e8-9c00-592c403e4d5a service swift] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:48.167345 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:48.189273 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 881/1740] 10.222.0.85 () {60 vars in 1384 bytes} [Thu Jun 16 14:56:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 14:56:48.264398 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888bc3d-3706-4df0-b05b-a2686b9239a8 service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:48.266684 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0888bc3d-3706-4df0-b05b-a2686b9239a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:48.475986 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:48.596362 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888bc3d-3706-4df0-b05b-a2686b9239a8 service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:48.616164 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b196a-3358-4279-a454-64c6f10d4036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:48.622778 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b196a-3358-4279-a454-64c6f10d4036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:48.628246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b196a-3358-4279-a454-64c6f10d4036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:48.628669 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b196a-3358-4279-a454-64c6f10d4036 admin admin] PATH_INFO: `/v3/projects/22b8155793494afba2c8248b468a5cb2` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:48.637263 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b196a-3358-4279-a454-64c6f10d4036 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22b8155793494afba2c8248b468a5cb2)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:48.642705 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b196a-3358-4279-a454-64c6f10d4036 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:48.706057 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96692dc8-65db-40e8-9c00-592c403e4d5a service swift] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:48.713771 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-96692dc8-65db-40e8-9c00-592c403e4d5a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:48.759359 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96692dc8-65db-40e8-9c00-592c403e4d5a service swift] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:48.812201 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f2463-d4df-41fe-bb46-b99ec1e42420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:48.813031 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f2463-d4df-41fe-bb46-b99ec1e42420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:48.813315 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f2463-d4df-41fe-bb46-b99ec1e42420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:48.822162 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f2463-d4df-41fe-bb46-b99ec1e42420 admin admin] PATH_INFO: `/v3/projects/3f86d61604504c25b61e2c54f947544e` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:48.826525 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f2463-d4df-41fe-bb46-b99ec1e42420 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f86d61604504c25b61e2c54f947544e)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:48.832407 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f2463-d4df-41fe-bb46-b99ec1e42420 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:48.908922 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-de1b196a-3358-4279-a454-64c6f10d4036 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22b8155793494afba2c8248b468a5cb2', 'request_id': 'req-de1b196a-3358-4279-a454-64c6f10d4036'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:48.944636 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-de1b196a-3358-4279-a454-64c6f10d4036 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22b8155793494afba2c8248b468a5cb2', 'request_id': 'req-de1b196a-3358-4279-a454-64c6f10d4036'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:48.979417 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-de1b196a-3358-4279-a454-64c6f10d4036 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22b8155793494afba2c8248b468a5cb2', 'request_id': 'req-de1b196a-3358-4279-a454-64c6f10d4036'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:49.043732 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-de1b196a-3358-4279-a454-64c6f10d4036 admin admin] The token cache is being invalidate because project 22b8155793494afba2c8248b468a5cb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:56:49.049364 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-de1b196a-3358-4279-a454-64c6f10d4036 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:49.049789 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d59f2463-d4df-41fe-bb46-b99ec1e42420 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f86d61604504c25b61e2c54f947544e', 'request_id': 'req-d59f2463-d4df-41fe-bb46-b99ec1e42420'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:49.051603 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-de1b196a-3358-4279-a454-64c6f10d4036 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:49.075135 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 860/1741] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:56:48 2022] DELETE /identity/v3/projects/22b8155793494afba2c8248b468a5cb2 => generated 0 bytes in 808 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:49.082967 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fbc21-cca7-4e48-b871-64044e5474ea None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:49.091659 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fbc21-cca7-4e48-b871-64044e5474ea None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:49.092013 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fbc21-cca7-4e48-b871-64044e5474ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:49.129407 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d59f2463-d4df-41fe-bb46-b99ec1e42420 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f86d61604504c25b61e2c54f947544e', 'request_id': 'req-d59f2463-d4df-41fe-bb46-b99ec1e42420'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:49.174160 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d59f2463-d4df-41fe-bb46-b99ec1e42420 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f86d61604504c25b61e2c54f947544e', 'request_id': 'req-d59f2463-d4df-41fe-bb46-b99ec1e42420'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:49.181955 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-8a7fbc21-cca7-4e48-b871-64044e5474ea None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:49.193550 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8a7fbc21-cca7-4e48-b871-64044e5474ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:49.224591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d59f2463-d4df-41fe-bb46-b99ec1e42420 admin admin] The token cache is being invalidate because project 3f86d61604504c25b61e2c54f947544e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:56:49.225993 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d59f2463-d4df-41fe-bb46-b99ec1e42420 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:49.228124 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d59f2463-d4df-41fe-bb46-b99ec1e42420 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:49.236495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 882/1742] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:56:48 2022] DELETE /identity/v3/projects/3f86d61604504c25b61e2c54f947544e => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:49.244465 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d470767-bfc7-44ce-a70f-b9097c84a3fe None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:49.245354 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d470767-bfc7-44ce-a70f-b9097c84a3fe None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:49.245779 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d470767-bfc7-44ce-a70f-b9097c84a3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:49.302041 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-2d470767-bfc7-44ce-a70f-b9097c84a3fe None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:49.306592 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2d470767-bfc7-44ce-a70f-b9097c84a3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:49.539384 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 861/1743] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:49.549080 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90862a7-1bab-4d9f-8612-546b926811a7 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:49.549605 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90862a7-1bab-4d9f-8612-546b926811a7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:49.549935 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90862a7-1bab-4d9f-8612-546b926811a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:49.574503 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 883/1744] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:49.576195 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4321b0-5933-4a2c-9daf-809421d786bd None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:49.576490 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4321b0-5933-4a2c-9daf-809421d786bd None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:49.576773 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4321b0-5933-4a2c-9daf-809421d786bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:49.599910 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c90862a7-1bab-4d9f-8612-546b926811a7 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:49.601315 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c90862a7-1bab-4d9f-8612-546b926811a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:49.622085 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 862/1745] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:56:49.626997 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90862a7-1bab-4d9f-8612-546b926811a7 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:49.644755 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90862a7-1bab-4d9f-8612-546b926811a7 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:49.662019 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeac34f-32e3-40ff-9e02-a7d58b9a9d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:49.663520 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-ce4321b0-5933-4a2c-9daf-809421d786bd None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:49.664089 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeac34f-32e3-40ff-9e02-a7d58b9a9d6c admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:49.664393 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeac34f-32e3-40ff-9e02-a7d58b9a9d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:49.664685 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeac34f-32e3-40ff-9e02-a7d58b9a9d6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:49.666711 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeac34f-32e3-40ff-9e02-a7d58b9a9d6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:56:49.668109 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeac34f-32e3-40ff-9e02-a7d58b9a9d6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:49.673251 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeac34f-32e3-40ff-9e02-a7d58b9a9d6c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:49.673529 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ce4321b0-5933-4a2c-9daf-809421d786bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:49.697416 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 863/1746] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:56:49.705033 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeac34f-32e3-40ff-9e02-a7d58b9a9d6c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:49.713978 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 884/1747] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:49.717792 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4321b0-5933-4a2c-9daf-809421d786bd None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:49.732478 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeac34f-32e3-40ff-9e02-a7d58b9a9d6c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:49.746162 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4321b0-5933-4a2c-9daf-809421d786bd None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:49.752225 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830678e1-8b2e-44fd-bf49-90451ad324c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:49.752918 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830678e1-8b2e-44fd-bf49-90451ad324c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:49.753689 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830678e1-8b2e-44fd-bf49-90451ad324c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:49.753689 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830678e1-8b2e-44fd-bf49-90451ad324c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:49.754158 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830678e1-8b2e-44fd-bf49-90451ad324c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:49.756293 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830678e1-8b2e-44fd-bf49-90451ad324c4 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:49.759114 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecedb994-14be-4412-b254-173317b5260d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:49.759960 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedb994-14be-4412-b254-173317b5260d admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:49.760284 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedb994-14be-4412-b254-173317b5260d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:49.760567 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedb994-14be-4412-b254-173317b5260d admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:49.761817 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecedb994-14be-4412-b254-173317b5260d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:56:49.762250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecedb994-14be-4412-b254-173317b5260d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:49.764462 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecedb994-14be-4412-b254-173317b5260d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:49.820316 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 885/1748] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:56:49.822235 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecedb994-14be-4412-b254-173317b5260d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:49.863560 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecedb994-14be-4412-b254-173317b5260d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:49.864001 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 864/1749] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:49 2022] POST /identity/v3/projects => generated 409 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:49.867298 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830678e1-8b2e-44fd-bf49-90451ad324c4 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:49.967279 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:50.049700 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058e102-aed1-4a8a-bcec-305104547fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:50.051339 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058e102-aed1-4a8a-bcec-305104547fd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:50.052942 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058e102-aed1-4a8a-bcec-305104547fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:50.053301 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058e102-aed1-4a8a-bcec-305104547fd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:50.056832 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830678e1-8b2e-44fd-bf49-90451ad324c4 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:50.057712 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058e102-aed1-4a8a-bcec-305104547fd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:50.060043 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058e102-aed1-4a8a-bcec-305104547fd6 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:50.076101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:50.076533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cfbf1-cd93-4cea-a844-81b73f4ad70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:50.089833 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cfbf1-cd93-4cea-a844-81b73f4ad70a admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:50.090855 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cfbf1-cd93-4cea-a844-81b73f4ad70a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:50.094553 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cfbf1-cd93-4cea-a844-81b73f4ad70a admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:50.099366 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432cfbf1-cd93-4cea-a844-81b73f4ad70a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:50.120274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432cfbf1-cd93-4cea-a844-81b73f4ad70a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:50.209047 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 886/1750] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:49 2022] POST /identity/v3/projects => generated 363 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:50.209967 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058e102-aed1-4a8a-bcec-305104547fd6 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:50.213366 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 865/1751] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:49 2022] POST /identity/v3/users => generated 305 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:50.219064 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cfbf1-cd93-4cea-a844-81b73f4ad70a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:50.256805 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cfbf1-cd93-4cea-a844-81b73f4ad70a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:50.455578 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058e102-aed1-4a8a-bcec-305104547fd6 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:50.471390 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed6b0d-2ca8-4db3-ba28-5f71e617697f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:50.472081 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed6b0d-2ca8-4db3-ba28-5f71e617697f admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:50.472656 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed6b0d-2ca8-4db3-ba28-5f71e617697f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:50.473073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed6b0d-2ca8-4db3-ba28-5f71e617697f admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:50.473789 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed6b0d-2ca8-4db3-ba28-5f71e617697f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:50.483806 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed6b0d-2ca8-4db3-ba28-5f71e617697f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:50.552192 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 887/1752] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:50 2022] POST /identity/v3/users => generated 282 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:50.557225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed6b0d-2ca8-4db3-ba28-5f71e617697f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:50.572659 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df2c9e-482d-4f27-95cc-e45259cb3a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:50.573348 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df2c9e-482d-4f27-95cc-e45259cb3a88 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:50.573619 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df2c9e-482d-4f27-95cc-e45259cb3a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:50.573889 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df2c9e-482d-4f27-95cc-e45259cb3a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:50.574621 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df2c9e-482d-4f27-95cc-e45259cb3a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:50.576551 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df2c9e-482d-4f27-95cc-e45259cb3a88 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:50.596341 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 866/1753] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:50.596573 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed6b0d-2ca8-4db3-ba28-5f71e617697f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:50.597090 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df2c9e-482d-4f27-95cc-e45259cb3a88 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:50.621740 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df2c9e-482d-4f27-95cc-e45259cb3a88 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:50.623113 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ca761-fd1c-47bd-81a7-29a3adf0af76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:50.623864 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ca761-fd1c-47bd-81a7-29a3adf0af76 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:50.624247 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ca761-fd1c-47bd-81a7-29a3adf0af76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:50.624525 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ca761-fd1c-47bd-81a7-29a3adf0af76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:50.625308 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ca761-fd1c-47bd-81a7-29a3adf0af76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:50.627672 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ca761-fd1c-47bd-81a7-29a3adf0af76 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:50.634386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833d60a-c686-48da-ad40-9168e811e1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:50.635081 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833d60a-c686-48da-ad40-9168e811e1b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:50.635359 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833d60a-c686-48da-ad40-9168e811e1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:50.635642 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833d60a-c686-48da-ad40-9168e811e1b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:50.636404 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833d60a-c686-48da-ad40-9168e811e1b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:50.642855 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833d60a-c686-48da-ad40-9168e811e1b5 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:50.660811 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 888/1754] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:50.663544 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ca761-fd1c-47bd-81a7-29a3adf0af76 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:50.672424 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 867/1755] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:50.678300 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833d60a-c686-48da-ad40-9168e811e1b5 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:50.695333 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ca761-fd1c-47bd-81a7-29a3adf0af76 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:50.702514 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833d60a-c686-48da-ad40-9168e811e1b5 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:50.714109 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c05342-60c9-4945-a300-235268bdd22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:50.715507 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c05342-60c9-4945-a300-235268bdd22b admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:50.715988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c05342-60c9-4945-a300-235268bdd22b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:50.716421 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c05342-60c9-4945-a300-235268bdd22b admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:50.718808 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380e282-57ed-4c19-8694-15fa13399e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:50.719945 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c05342-60c9-4945-a300-235268bdd22b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:50.722092 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c05342-60c9-4945-a300-235268bdd22b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:50.726304 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380e282-57ed-4c19-8694-15fa13399e91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:50.731034 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380e282-57ed-4c19-8694-15fa13399e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:50.731413 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380e282-57ed-4c19-8694-15fa13399e91 admin admin] PATH_INFO: `/v3/projects/74931b59b6fd4ffc92fa227d4a454053/users/755eb9a53f004690afb35923d2185d6a/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:50.752518 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 889/1756] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:50.757929 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c05342-60c9-4945-a300-235268bdd22b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:50.789741 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c05342-60c9-4945-a300-235268bdd22b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:50.799016 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a0d9c-8b04-4edc-b5a7-b77855c7d495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:50.802226 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a0d9c-8b04-4edc-b5a7-b77855c7d495 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:50.802867 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a0d9c-8b04-4edc-b5a7-b77855c7d495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:50.803763 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a0d9c-8b04-4edc-b5a7-b77855c7d495 admin admin] PATH_INFO: `/v3/projects/23f8af93db2e46d5ac4eb4ab5060ee79/users/d1e2bcd786824cad99d62b7aae9e0528/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:50.842484 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380e282-57ed-4c19-8694-15fa13399e91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74931b59b6fd4ffc92fa227d4a454053, user_id=755eb9a53f004690afb35923d2185d6a, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:50.863246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380e282-57ed-4c19-8694-15fa13399e91 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:50.871615 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a0d9c-8b04-4edc-b5a7-b77855c7d495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23f8af93db2e46d5ac4eb4ab5060ee79, user_id=d1e2bcd786824cad99d62b7aae9e0528, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:50.874461 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a0d9c-8b04-4edc-b5a7-b77855c7d495 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:50.934716 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 890/1757] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:50 2022] PUT /identity/v3/projects/23f8af93db2e46d5ac4eb4ab5060ee79/users/d1e2bcd786824cad99d62b7aae9e0528/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:50.954350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 868/1758] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:50 2022] PUT /identity/v3/projects/74931b59b6fd4ffc92fa227d4a454053/users/755eb9a53f004690afb35923d2185d6a/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:50.965069 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84f963-92ee-4eed-b75f-c38ad4a0ebb6 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:50.965069 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84f963-92ee-4eed-b75f-c38ad4a0ebb6 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:50.965069 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84f963-92ee-4eed-b75f-c38ad4a0ebb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:50.976870 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b42b13-d22b-4b47-a0b2-a45d09a2e7a5 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:50.978137 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b42b13-d22b-4b47-a0b2-a45d09a2e7a5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:50.978572 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b42b13-d22b-4b47-a0b2-a45d09a2e7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:51.055310 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-8c84f963-92ee-4eed-b75f-c38ad4a0ebb6 None None] MFA Rules not processed for user `d1e2bcd786824cad99d62b7aae9e0528`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:51.058272 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8c84f963-92ee-4eed-b75f-c38ad4a0ebb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:51.155374 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b6b42b13-d22b-4b47-a0b2-a45d09a2e7a5 None None] MFA Rules not processed for user `755eb9a53f004690afb35923d2185d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:51.165535 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b6b42b13-d22b-4b47-a0b2-a45d09a2e7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:51.388754 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 891/1759] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:50 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:51.398687 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84f963-92ee-4eed-b75f-c38ad4a0ebb6 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:51.457777 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:51.621949 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 869/1760] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:50 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 654 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:51.624225 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b42b13-d22b-4b47-a0b2-a45d09a2e7a5 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:51.642462 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84f963-92ee-4eed-b75f-c38ad4a0ebb6 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:51.658903 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:51.664311 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f4192-b254-4095-965d-d4e9ee871206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:51.668551 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f4192-b254-4095-965d-d4e9ee871206 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:51.676409 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f4192-b254-4095-965d-d4e9ee871206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:51.676640 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f4192-b254-4095-965d-d4e9ee871206 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:51.680574 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b42b13-d22b-4b47-a0b2-a45d09a2e7a5 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:51.683466 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f4192-b254-4095-965d-d4e9ee871206 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:51.688285 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f4192-b254-4095-965d-d4e9ee871206 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:51.694708 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d0c50-1861-4a09-a3e3-da625e5d6560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:51.695707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d0c50-1861-4a09-a3e3-da625e5d6560 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:51.696263 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d0c50-1861-4a09-a3e3-da625e5d6560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:51.696900 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d0c50-1861-4a09-a3e3-da625e5d6560 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:51.698007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d0c50-1861-4a09-a3e3-da625e5d6560 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:51.700883 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d0c50-1861-4a09-a3e3-da625e5d6560 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:51.792506 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 892/1761] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:51 2022] POST /identity/v3/projects => generated 363 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:51.793954 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 870/1762] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:51 2022] POST /identity/v3/projects => generated 409 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:51.796202 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d0c50-1861-4a09-a3e3-da625e5d6560 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:51.816519 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f4192-b254-4095-965d-d4e9ee871206 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:52.029771 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d0c50-1861-4a09-a3e3-da625e5d6560 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:52.038730 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f4192-b254-4095-965d-d4e9ee871206 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:52.041555 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb9474-03ff-4eb0-a12c-1a2fed491c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:52.043513 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb9474-03ff-4eb0-a12c-1a2fed491c34 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:52.043801 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb9474-03ff-4eb0-a12c-1a2fed491c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:52.044090 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb9474-03ff-4eb0-a12c-1a2fed491c34 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:52.044813 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb9474-03ff-4eb0-a12c-1a2fed491c34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:52.049134 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb9474-03ff-4eb0-a12c-1a2fed491c34 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:52.052393 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4525942-32f3-4b9b-b125-82b661925c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:52.053486 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4525942-32f3-4b9b-b125-82b661925c12 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:52.053963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4525942-32f3-4b9b-b125-82b661925c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:52.054406 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4525942-32f3-4b9b-b125-82b661925c12 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:52.055156 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4525942-32f3-4b9b-b125-82b661925c12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:52.059467 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4525942-32f3-4b9b-b125-82b661925c12 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:52.117111 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 871/1763] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:51 2022] POST /identity/v3/users => generated 288 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:52.122067 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 893/1764] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:51 2022] POST /identity/v3/users => generated 311 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:52.122647 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb9474-03ff-4eb0-a12c-1a2fed491c34 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:52.127729 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-babb9474-03ff-4eb0-a12c-1a2fed491c34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:52.130689 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4525942-32f3-4b9b-b125-82b661925c12 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:52.171289 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4525942-32f3-4b9b-b125-82b661925c12 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:52.180654 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb9474-03ff-4eb0-a12c-1a2fed491c34 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:52.189287 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6c5d3-068c-4d3c-89ee-d6dd5bbd8df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:52.189984 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6c5d3-068c-4d3c-89ee-d6dd5bbd8df5 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:52.190273 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6c5d3-068c-4d3c-89ee-d6dd5bbd8df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:52.190552 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6c5d3-068c-4d3c-89ee-d6dd5bbd8df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:52.191772 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a6c5d3-068c-4d3c-89ee-d6dd5bbd8df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:52.192954 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a6c5d3-068c-4d3c-89ee-d6dd5bbd8df5 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:52.204064 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ffde3-2c8d-4640-8fa5-41e19d3c018e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:52.208794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ffde3-2c8d-4640-8fa5-41e19d3c018e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:52.209411 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ffde3-2c8d-4640-8fa5-41e19d3c018e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:52.209706 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ffde3-2c8d-4640-8fa5-41e19d3c018e admin admin] PATH_INFO: `/v3/users/a7d9d121e77a47f7af311eb22ae23252` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:52.223349 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17ffde3-2c8d-4640-8fa5-41e19d3c018e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7d9d121e77a47f7af311eb22ae23252)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:52.238408 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17ffde3-2c8d-4640-8fa5-41e19d3c018e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:52.267480 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 894/1765] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:52.273067 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6c5d3-068c-4d3c-89ee-d6dd5bbd8df5 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:52.335481 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6c5d3-068c-4d3c-89ee-d6dd5bbd8df5 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:52.364799 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be25bbb-d6e8-433f-9406-9766efa4009d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:52.366710 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be25bbb-d6e8-433f-9406-9766efa4009d admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:52.367660 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be25bbb-d6e8-433f-9406-9766efa4009d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:52.368385 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be25bbb-d6e8-433f-9406-9766efa4009d admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:52.371692 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be25bbb-d6e8-433f-9406-9766efa4009d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:52.403466 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be25bbb-d6e8-433f-9406-9766efa4009d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:52.413678 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c17ffde3-2c8d-4640-8fa5-41e19d3c018e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7d9d121e77a47f7af311eb22ae23252'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:52.432472 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c17ffde3-2c8d-4640-8fa5-41e19d3c018e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7d9d121e77a47f7af311eb22ae23252'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:52.448892 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c17ffde3-2c8d-4640-8fa5-41e19d3c018e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7d9d121e77a47f7af311eb22ae23252'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:52.475320 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 895/1766] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:52.476943 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be25bbb-d6e8-433f-9406-9766efa4009d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:52.487737 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c17ffde3-2c8d-4640-8fa5-41e19d3c018e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7d9d121e77a47f7af311eb22ae23252'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:52.488538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c17ffde3-2c8d-4640-8fa5-41e19d3c018e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7d9d121e77a47f7af311eb22ae23252'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:52.506207 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 872/1767] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:56:52 2022] DELETE /identity/v3/users/a7d9d121e77a47f7af311eb22ae23252 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:52.507793 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ffde3-2c8d-4640-8fa5-41e19d3c018e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:52.512052 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c17ffde3-2c8d-4640-8fa5-41e19d3c018e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:52.518593 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be25bbb-d6e8-433f-9406-9766efa4009d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:52.645948 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:52.695170 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e431a6-18b7-4af1-9bef-c8632c226f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:52.700339 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e431a6-18b7-4af1-9bef-c8632c226f8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:52.701311 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e431a6-18b7-4af1-9bef-c8632c226f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:52.701734 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e431a6-18b7-4af1-9bef-c8632c226f8b admin admin] PATH_INFO: `/v3/projects/8d01483b6fb04047b83fca9ddb782b2f/users/e5f43d747f2b404c9f83cbc3400fd8be/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:52.709557 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ffde3-2c8d-4640-8fa5-41e19d3c018e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:52.733059 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833db0d-6172-499e-82db-64886fb5f928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:52.748900 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833db0d-6172-499e-82db-64886fb5f928 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:52.752326 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833db0d-6172-499e-82db-64886fb5f928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:52.754400 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833db0d-6172-499e-82db-64886fb5f928 admin admin] PATH_INFO: `/v3/projects/f4b8008da0fa4fffad7914459150e2dd/users/7ef43ed1577c4717ba3911c2a9982fb0/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:52.778786 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e431a6-18b7-4af1-9bef-c8632c226f8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d01483b6fb04047b83fca9ddb782b2f, user_id=e5f43d747f2b404c9f83cbc3400fd8be, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:52.785890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e431a6-18b7-4af1-9bef-c8632c226f8b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:52.797844 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:52.822195 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 896/1768] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:52 2022] PUT /identity/v3/projects/8d01483b6fb04047b83fca9ddb782b2f/users/e5f43d747f2b404c9f83cbc3400fd8be/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:52.842846 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9dd088-db03-4d80-8f57-5676757ac7cf None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:52.845145 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9dd088-db03-4d80-8f57-5676757ac7cf None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:52.846834 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9dd088-db03-4d80-8f57-5676757ac7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:52.848938 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833db0d-6172-499e-82db-64886fb5f928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4b8008da0fa4fffad7914459150e2dd, user_id=7ef43ed1577c4717ba3911c2a9982fb0, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:52.852489 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833db0d-6172-499e-82db-64886fb5f928 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:52.913849 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 873/1769] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:52 2022] PUT /identity/v3/projects/f4b8008da0fa4fffad7914459150e2dd/users/7ef43ed1577c4717ba3911c2a9982fb0/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:52.922434 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833db0d-6172-499e-82db-64886fb5f928 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:52.928429 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-3e9dd088-db03-4d80-8f57-5676757ac7cf None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:52.929409 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e833db0d-6172-499e-82db-64886fb5f928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:52.934414 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3e9dd088-db03-4d80-8f57-5676757ac7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:53.155773 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 897/1770] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:53.157449 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9dd088-db03-4d80-8f57-5676757ac7cf None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:53.173851 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9dd088-db03-4d80-8f57-5676757ac7cf None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:53.183059 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207be09-839c-4a18-b756-df854dad7fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:53.184910 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207be09-839c-4a18-b756-df854dad7fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:53.185595 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207be09-839c-4a18-b756-df854dad7fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:53.186551 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207be09-839c-4a18-b756-df854dad7fd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:53.188804 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207be09-839c-4a18-b756-df854dad7fd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:53.191573 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207be09-839c-4a18-b756-df854dad7fd1 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:53.209495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 898/1771] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:53.214033 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207be09-839c-4a18-b756-df854dad7fd1 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:53.227753 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207be09-839c-4a18-b756-df854dad7fd1 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:53.237004 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff857eb4-afa4-4089-b040-4cc585dff82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:53.239594 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff857eb4-afa4-4089-b040-4cc585dff82f admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:53.241418 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff857eb4-afa4-4089-b040-4cc585dff82f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:53.242131 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff857eb4-afa4-4089-b040-4cc585dff82f admin admin] PATH_INFO: `/v3/projects/f4b8008da0fa4fffad7914459150e2dd/users/7ef43ed1577c4717ba3911c2a9982fb0/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:53.248830 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff857eb4-afa4-4089-b040-4cc585dff82f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4b8008da0fa4fffad7914459150e2dd, user_id=7ef43ed1577c4717ba3911c2a9982fb0, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:53.250599 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833db0d-6172-499e-82db-64886fb5f928 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:53.257441 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff857eb4-afa4-4089-b040-4cc585dff82f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:53.279024 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7837b4-83a6-4d79-bbb6-e23f945e3137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:53.280748 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7837b4-83a6-4d79-bbb6-e23f945e3137 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:53.284488 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7837b4-83a6-4d79-bbb6-e23f945e3137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:53.285054 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7837b4-83a6-4d79-bbb6-e23f945e3137 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:53.285993 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7837b4-83a6-4d79-bbb6-e23f945e3137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:53.288927 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7837b4-83a6-4d79-bbb6-e23f945e3137 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:53.298615 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 899/1772] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:53 2022] PUT /identity/v3/projects/f4b8008da0fa4fffad7914459150e2dd/users/7ef43ed1577c4717ba3911c2a9982fb0/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:56:53.298615 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff857eb4-afa4-4089-b040-4cc585dff82f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:53.298615 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ff857eb4-afa4-4089-b040-4cc585dff82f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:53.336752 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 874/1773] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:56:53.338553 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df3070-a3e0-490e-baee-8919a7adc7fc None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:53.340320 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df3070-a3e0-490e-baee-8919a7adc7fc None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:53.340808 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df3070-a3e0-490e-baee-8919a7adc7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:53.433666 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-45df3070-a3e0-490e-baee-8919a7adc7fc None None] MFA Rules not processed for user `7ef43ed1577c4717ba3911c2a9982fb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:53.435156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-45df3070-a3e0-490e-baee-8919a7adc7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:53.557920 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff857eb4-afa4-4089-b040-4cc585dff82f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:53.580044 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f8668-c076-4fbc-8795-df2371851e82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:53.584617 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f8668-c076-4fbc-8795-df2371851e82 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:53.584912 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f8668-c076-4fbc-8795-df2371851e82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:53.585194 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f8668-c076-4fbc-8795-df2371851e82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:53.713987 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 875/1774] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:53 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:53.715418 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df3070-a3e0-490e-baee-8919a7adc7fc None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:53.822665 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f8668-c076-4fbc-8795-df2371851e82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:53.824440 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f8668-c076-4fbc-8795-df2371851e82 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:53.840142 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 900/1775] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:53.841568 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f8668-c076-4fbc-8795-df2371851e82 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:53.843771 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f18f8668-c076-4fbc-8795-df2371851e82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:53.932549 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:53.941579 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:54.019136 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df3070-a3e0-490e-baee-8919a7adc7fc None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:54.038454 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a136e-ddd2-4670-b2ff-8a960b51b2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:54.039337 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a136e-ddd2-4670-b2ff-8a960b51b2ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:54.039773 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a136e-ddd2-4670-b2ff-8a960b51b2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:54.044049 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a136e-ddd2-4670-b2ff-8a960b51b2ab admin admin] PATH_INFO: `/v3/projects/8d01483b6fb04047b83fca9ddb782b2f/users/e5f43d747f2b404c9f83cbc3400fd8be/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:54.049664 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a136e-ddd2-4670-b2ff-8a960b51b2ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d01483b6fb04047b83fca9ddb782b2f, user_id=e5f43d747f2b404c9f83cbc3400fd8be, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:54.054640 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f8668-c076-4fbc-8795-df2371851e82 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:54.060203 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a136e-ddd2-4670-b2ff-8a960b51b2ab admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:54.067237 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5decec-51e4-4f3d-a2c2-3fda482b3b27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:54.071638 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5decec-51e4-4f3d-a2c2-3fda482b3b27 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:54.071950 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5decec-51e4-4f3d-a2c2-3fda482b3b27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:54.072226 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5decec-51e4-4f3d-a2c2-3fda482b3b27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:54.101718 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 876/1776] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:56:53 2022] PUT /identity/v3/projects/8d01483b6fb04047b83fca9ddb782b2f/users/e5f43d747f2b404c9f83cbc3400fd8be/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:54.111387 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aff7bc-d5a6-42e0-a88a-43d1e813abbc None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:54.111687 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aff7bc-d5a6-42e0-a88a-43d1e813abbc None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:54.114199 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aff7bc-d5a6-42e0-a88a-43d1e813abbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:54.130869 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5decec-51e4-4f3d-a2c2-3fda482b3b27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:54.132535 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5decec-51e4-4f3d-a2c2-3fda482b3b27 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:54.184482 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-30aff7bc-d5a6-42e0-a88a-43d1e813abbc None None] MFA Rules not processed for user `74029b3845b4408bb58332e21e801ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:54.192593 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-30aff7bc-d5a6-42e0-a88a-43d1e813abbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:54.209553 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 901/1777] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:53 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:54.213102 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd787a-d2af-48cb-a275-12faefbad892 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:54.214409 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd787a-d2af-48cb-a275-12faefbad892 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:54.214718 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd787a-d2af-48cb-a275-12faefbad892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:54.367589 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-25fd787a-d2af-48cb-a275-12faefbad892 None None] MFA Rules not processed for user `e5f43d747f2b404c9f83cbc3400fd8be`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:54.372666 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-25fd787a-d2af-48cb-a275-12faefbad892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:54.715378 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 902/1778] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:54 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:54.724364 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119959f9-434b-47a9-989b-6fdcbb5c942b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:54.724669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119959f9-434b-47a9-989b-6fdcbb5c942b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:54.724958 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119959f9-434b-47a9-989b-6fdcbb5c942b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:54.794203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-119959f9-434b-47a9-989b-6fdcbb5c942b None None] MFA Rules not processed for user `431f66d8c09d4eb194600509e7300bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:54.798759 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-119959f9-434b-47a9-989b-6fdcbb5c942b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:54.998561 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 903/1779] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:55.000912 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119959f9-434b-47a9-989b-6fdcbb5c942b None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:55.003092 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 877/1780] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 900 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:55.143647 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aff7bc-d5a6-42e0-a88a-43d1e813abbc None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:55.146246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-30aff7bc-d5a6-42e0-a88a-43d1e813abbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:55.161775 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119959f9-434b-47a9-989b-6fdcbb5c942b None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:55.168358 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63154d-bc82-4765-aeaf-0c5dcd00c1a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:55.169345 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63154d-bc82-4765-aeaf-0c5dcd00c1a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:55.169864 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63154d-bc82-4765-aeaf-0c5dcd00c1a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:55.170334 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63154d-bc82-4765-aeaf-0c5dcd00c1a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:55.187514 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63154d-bc82-4765-aeaf-0c5dcd00c1a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:55.190612 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63154d-bc82-4765-aeaf-0c5dcd00c1a3 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:55.195892 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aff7bc-d5a6-42e0-a88a-43d1e813abbc None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:55.213135 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:55.218063 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac4cbc-8c4c-4dec-bae4-80146fd7c5e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:55.225182 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac4cbc-8c4c-4dec-bae4-80146fd7c5e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:55.225182 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac4cbc-8c4c-4dec-bae4-80146fd7c5e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:55.225395 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac4cbc-8c4c-4dec-bae4-80146fd7c5e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:55.231656 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 904/1781] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:54 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:55.231831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-afac4cbc-8c4c-4dec-bae4-80146fd7c5e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:55.400798 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63154d-bc82-4765-aeaf-0c5dcd00c1a3 service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:55.406736 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3f63154d-bc82-4765-aeaf-0c5dcd00c1a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:55.499072 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac4cbc-8c4c-4dec-bae4-80146fd7c5e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:55.502962 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac4cbc-8c4c-4dec-bae4-80146fd7c5e1 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:55.552540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 878/1782] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:55 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:55.686157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63154d-bc82-4765-aeaf-0c5dcd00c1a3 service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:55.720473 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2e874-9fb6-422b-9943-3d2a90c203ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:55.720473 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2e874-9fb6-422b-9943-3d2a90c203ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:55.720473 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2e874-9fb6-422b-9943-3d2a90c203ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:55.720473 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2e874-9fb6-422b-9943-3d2a90c203ca admin admin] PATH_INFO: `/v3/projects/488a233918bc45a6a26635c6f28d6794` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:55.725077 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2e874-9fb6-422b-9943-3d2a90c203ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=488a233918bc45a6a26635c6f28d6794)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:55.727081 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2e874-9fb6-422b-9943-3d2a90c203ca admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:55.897400 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4de2e874-9fb6-422b-9943-3d2a90c203ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '488a233918bc45a6a26635c6f28d6794', 'request_id': 'req-4de2e874-9fb6-422b-9943-3d2a90c203ca'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:55.913298 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4de2e874-9fb6-422b-9943-3d2a90c203ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '488a233918bc45a6a26635c6f28d6794', 'request_id': 'req-4de2e874-9fb6-422b-9943-3d2a90c203ca'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:55.932037 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4de2e874-9fb6-422b-9943-3d2a90c203ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '488a233918bc45a6a26635c6f28d6794', 'request_id': 'req-4de2e874-9fb6-422b-9943-3d2a90c203ca'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:55.960744 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4de2e874-9fb6-422b-9943-3d2a90c203ca admin admin] The token cache is being invalidate because project 488a233918bc45a6a26635c6f28d6794 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:56:55.961317 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4de2e874-9fb6-422b-9943-3d2a90c203ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:55.962859 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4de2e874-9fb6-422b-9943-3d2a90c203ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:55.969060 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 905/1783] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:56:55 2022] DELETE /identity/v3/projects/488a233918bc45a6a26635c6f28d6794 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:56:55.973181 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac4cbc-8c4c-4dec-bae4-80146fd7c5e1 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:55.996572 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7c904-51d7-4183-9f18-4c3d07e5abf9 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:55.997221 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7c904-51d7-4183-9f18-4c3d07e5abf9 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:55.997897 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7c904-51d7-4183-9f18-4c3d07e5abf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:56.001999 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac4cbc-8c4c-4dec-bae4-80146fd7c5e1 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:56.046271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-80d7c904-51d7-4183-9f18-4c3d07e5abf9 None None] MFA Rules not processed for user `3d3d59fabcf94718bbc005519cec6f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:56.051388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-80d7c904-51d7-4183-9f18-4c3d07e5abf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:56.223481 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 906/1784] 10.222.0.91 () {58 vars in 1015 bytes} [Thu Jun 16 14:56:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:56.224659 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933aa97-2c63-46a7-9142-037ff2f7c4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:56.225742 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933aa97-2c63-46a7-9142-037ff2f7c4ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:56.226101 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933aa97-2c63-46a7-9142-037ff2f7c4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:56.226769 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933aa97-2c63-46a7-9142-037ff2f7c4ed admin admin] PATH_INFO: `/v3/users/2c9ecec07fe34609987ac12c4cfc43db` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:56.229805 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933aa97-2c63-46a7-9142-037ff2f7c4ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c9ecec07fe34609987ac12c4cfc43db)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:56.231305 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933aa97-2c63-46a7-9142-037ff2f7c4ed admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:56.278965 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7c904-51d7-4183-9f18-4c3d07e5abf9 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:56.281707 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-80d7c904-51d7-4183-9f18-4c3d07e5abf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:56.338258 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7c904-51d7-4183-9f18-4c3d07e5abf9 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:56.353629 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b954c-8355-4370-acf1-c513be007b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:56.355752 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:56.366177 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b954c-8355-4370-acf1-c513be007b17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:56.366596 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b954c-8355-4370-acf1-c513be007b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:56.366885 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b954c-8355-4370-acf1-c513be007b17 admin admin] PATH_INFO: `/v3/users/d1e2bcd786824cad99d62b7aae9e0528` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:56.376241 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b954c-8355-4370-acf1-c513be007b17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1e2bcd786824cad99d62b7aae9e0528)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:56.382814 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b954c-8355-4370-acf1-c513be007b17 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:56.422232 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8933aa97-2c63-46a7-9142-037ff2f7c4ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c9ecec07fe34609987ac12c4cfc43db'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:56.457584 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:56.472183 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8933aa97-2c63-46a7-9142-037ff2f7c4ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c9ecec07fe34609987ac12c4cfc43db'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:56.488760 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d66b954c-8355-4370-acf1-c513be007b17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1e2bcd786824cad99d62b7aae9e0528'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:56.502399 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8933aa97-2c63-46a7-9142-037ff2f7c4ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c9ecec07fe34609987ac12c4cfc43db'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:56.528278 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8933aa97-2c63-46a7-9142-037ff2f7c4ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c9ecec07fe34609987ac12c4cfc43db'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:56.529176 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d66b954c-8355-4370-acf1-c513be007b17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1e2bcd786824cad99d62b7aae9e0528'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:56.529290 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8933aa97-2c63-46a7-9142-037ff2f7c4ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c9ecec07fe34609987ac12c4cfc43db'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:56.529924 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d66b954c-8355-4370-acf1-c513be007b17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1e2bcd786824cad99d62b7aae9e0528'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:56.548558 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d66b954c-8355-4370-acf1-c513be007b17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1e2bcd786824cad99d62b7aae9e0528'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:56.549741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 879/1785] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:56:55 2022] DELETE /identity/v3/users/2c9ecec07fe34609987ac12c4cfc43db => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:56.550941 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933aa97-2c63-46a7-9142-037ff2f7c4ed admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:56.574750 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d66b954c-8355-4370-acf1-c513be007b17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1e2bcd786824cad99d62b7aae9e0528'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:56.582912 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8933aa97-2c63-46a7-9142-037ff2f7c4ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:56.591930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 907/1786] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:56:56 2022] DELETE /identity/v3/users/d1e2bcd786824cad99d62b7aae9e0528 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:56.596476 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caad933-b0d6-4282-bbce-0827f59e125f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:56.596771 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caad933-b0d6-4282-bbce-0827f59e125f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:56.597071 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caad933-b0d6-4282-bbce-0827f59e125f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:56.633668 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-5caad933-b0d6-4282-bbce-0827f59e125f None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:56.635012 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5caad933-b0d6-4282-bbce-0827f59e125f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:56.798549 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 908/1787] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:56:56.808612 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933aa97-2c63-46a7-9142-037ff2f7c4ed admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:56.862601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caad933-b0d6-4282-bbce-0827f59e125f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:56.864544 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5caad933-b0d6-4282-bbce-0827f59e125f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:56.957216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fd76a-b4d5-4c36-aa51-abbdd57bf756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:56.957530 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fd76a-b4d5-4c36-aa51-abbdd57bf756 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:56.957823 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fd76a-b4d5-4c36-aa51-abbdd57bf756 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:56.958100 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fd76a-b4d5-4c36-aa51-abbdd57bf756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:56.960632 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-157fd76a-b4d5-4c36-aa51-abbdd57bf756 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:56.977218 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157fd76a-b4d5-4c36-aa51-abbdd57bf756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:56.979652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157fd76a-b4d5-4c36-aa51-abbdd57bf756 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:57.007805 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 880/1788] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:57.050068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caad933-b0d6-4282-bbce-0827f59e125f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:57.054249 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41c938-93c9-41df-bf2f-ecd2350f85f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:57.055087 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41c938-93c9-41df-bf2f-ecd2350f85f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:57.055398 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41c938-93c9-41df-bf2f-ecd2350f85f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:57.055776 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41c938-93c9-41df-bf2f-ecd2350f85f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:57.067188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd41c938-93c9-41df-bf2f-ecd2350f85f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:57.068840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd41c938-93c9-41df-bf2f-ecd2350f85f9 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:57.101198 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 909/1789] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:56:57.105926 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fd76a-b4d5-4c36-aa51-abbdd57bf756 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:57.107356 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-157fd76a-b4d5-4c36-aa51-abbdd57bf756 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:57.123224 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fd76a-b4d5-4c36-aa51-abbdd57bf756 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:57.136460 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c954ef-6155-4140-a92a-390d7d67c3ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:57.136460 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c954ef-6155-4140-a92a-390d7d67c3ca service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:57.136460 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c954ef-6155-4140-a92a-390d7d67c3ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:57.136460 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c954ef-6155-4140-a92a-390d7d67c3ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:57.150775 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c954ef-6155-4140-a92a-390d7d67c3ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:57.152402 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c954ef-6155-4140-a92a-390d7d67c3ca service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:57.164106 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 881/1790] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:57.548705 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41c938-93c9-41df-bf2f-ecd2350f85f9 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:57.551086 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-bd41c938-93c9-41df-bf2f-ecd2350f85f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:57.582110 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41c938-93c9-41df-bf2f-ecd2350f85f9 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:57.596965 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70622e9f-dd4e-42f4-b943-8bad3c9c9764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:57.598582 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70622e9f-dd4e-42f4-b943-8bad3c9c9764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:57.600206 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70622e9f-dd4e-42f4-b943-8bad3c9c9764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:57.602414 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70622e9f-dd4e-42f4-b943-8bad3c9c9764 admin admin] PATH_INFO: `/v3/projects/0e9c892c1d414e1990f059378ccafaaa` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:57.621481 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70622e9f-dd4e-42f4-b943-8bad3c9c9764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e9c892c1d414e1990f059378ccafaaa)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:57.633510 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70622e9f-dd4e-42f4-b943-8bad3c9c9764 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:57.836000 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:57.842033 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-70622e9f-dd4e-42f4-b943-8bad3c9c9764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e9c892c1d414e1990f059378ccafaaa', 'request_id': 'req-70622e9f-dd4e-42f4-b943-8bad3c9c9764'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:57.866508 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-70622e9f-dd4e-42f4-b943-8bad3c9c9764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e9c892c1d414e1990f059378ccafaaa', 'request_id': 'req-70622e9f-dd4e-42f4-b943-8bad3c9c9764'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:57.888076 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-70622e9f-dd4e-42f4-b943-8bad3c9c9764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e9c892c1d414e1990f059378ccafaaa', 'request_id': 'req-70622e9f-dd4e-42f4-b943-8bad3c9c9764'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:57.923587 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-70622e9f-dd4e-42f4-b943-8bad3c9c9764 admin admin] The token cache is being invalidate because project 0e9c892c1d414e1990f059378ccafaaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:56:57.924602 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-70622e9f-dd4e-42f4-b943-8bad3c9c9764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:57.926514 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-70622e9f-dd4e-42f4-b943-8bad3c9c9764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:57.936879 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c954ef-6155-4140-a92a-390d7d67c3ca service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:57.938363 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 910/1791] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:56:57 2022] DELETE /identity/v3/projects/0e9c892c1d414e1990f059378ccafaaa => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:57.960274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c954ef-6155-4140-a92a-390d7d67c3ca service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:58.087179 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:58.117212 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d80bc6-8258-4153-8aa5-a9106e817ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:58.118324 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d80bc6-8258-4153-8aa5-a9106e817ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:58.118771 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d80bc6-8258-4153-8aa5-a9106e817ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:58.119185 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d80bc6-8258-4153-8aa5-a9106e817ff7 admin admin] PATH_INFO: `/v3/users/06527f5efb7e4b19b8a84c1b99df2bdd` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:58.122312 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d80bc6-8258-4153-8aa5-a9106e817ff7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06527f5efb7e4b19b8a84c1b99df2bdd)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:58.133196 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d80bc6-8258-4153-8aa5-a9106e817ff7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:58.236147 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e8d80bc6-8258-4153-8aa5-a9106e817ff7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06527f5efb7e4b19b8a84c1b99df2bdd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:58.254568 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e8d80bc6-8258-4153-8aa5-a9106e817ff7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06527f5efb7e4b19b8a84c1b99df2bdd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:58.269893 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e8d80bc6-8258-4153-8aa5-a9106e817ff7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06527f5efb7e4b19b8a84c1b99df2bdd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:58.297291 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e8d80bc6-8258-4153-8aa5-a9106e817ff7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06527f5efb7e4b19b8a84c1b99df2bdd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:58.299761 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e8d80bc6-8258-4153-8aa5-a9106e817ff7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06527f5efb7e4b19b8a84c1b99df2bdd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:58.331970 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 882/1792] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:56:57 2022] DELETE /identity/v3/users/06527f5efb7e4b19b8a84c1b99df2bdd => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:58.935094 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70622e9f-dd4e-42f4-b943-8bad3c9c9764 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:58.936654 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-70622e9f-dd4e-42f4-b943-8bad3c9c9764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:58.964952 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70622e9f-dd4e-42f4-b943-8bad3c9c9764 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:59.081010 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6c0a3-a24e-4be4-aea9-47d5673aa7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:59.082126 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6c0a3-a24e-4be4-aea9-47d5673aa7bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:59.082547 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6c0a3-a24e-4be4-aea9-47d5673aa7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:59.082825 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6c0a3-a24e-4be4-aea9-47d5673aa7bf admin admin] PATH_INFO: `/v3/projects/b9080ee22a534abf8ef8c01c7e899cd1` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:59.084222 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6c0a3-a24e-4be4-aea9-47d5673aa7bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9080ee22a534abf8ef8c01c7e899cd1)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:59.092968 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6c0a3-a24e-4be4-aea9-47d5673aa7bf admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:59.202370 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0cf6c0a3-a24e-4be4-aea9-47d5673aa7bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9080ee22a534abf8ef8c01c7e899cd1', 'request_id': 'req-0cf6c0a3-a24e-4be4-aea9-47d5673aa7bf'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:59.226438 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0cf6c0a3-a24e-4be4-aea9-47d5673aa7bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9080ee22a534abf8ef8c01c7e899cd1', 'request_id': 'req-0cf6c0a3-a24e-4be4-aea9-47d5673aa7bf'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:59.244978 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0cf6c0a3-a24e-4be4-aea9-47d5673aa7bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9080ee22a534abf8ef8c01c7e899cd1', 'request_id': 'req-0cf6c0a3-a24e-4be4-aea9-47d5673aa7bf'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:59.275722 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0cf6c0a3-a24e-4be4-aea9-47d5673aa7bf admin admin] The token cache is being invalidate because project b9080ee22a534abf8ef8c01c7e899cd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:56:59.276542 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0cf6c0a3-a24e-4be4-aea9-47d5673aa7bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:59.278001 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0cf6c0a3-a24e-4be4-aea9-47d5673aa7bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:56:59.280142 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 911/1793] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:56:58 2022] DELETE /identity/v3/projects/b9080ee22a534abf8ef8c01c7e899cd1 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:56:59.287999 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0e15c-7996-4b27-adb3-188193921371 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:59.288652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0e15c-7996-4b27-adb3-188193921371 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:59.289044 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0e15c-7996-4b27-adb3-188193921371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:59.317368 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-33b0e15c-7996-4b27-adb3-188193921371 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:59.319149 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-33b0e15c-7996-4b27-adb3-188193921371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:59.578209 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 883/1794] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:59.586508 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2e121-83ef-4304-9f9e-06f95b40708a None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:59.593755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2e121-83ef-4304-9f9e-06f95b40708a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:59.602492 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2e121-83ef-4304-9f9e-06f95b40708a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:59.637555 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-41e2e121-83ef-4304-9f9e-06f95b40708a None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:59.639555 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-41e2e121-83ef-4304-9f9e-06f95b40708a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:59.670287 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 912/1795] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:59.671350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0e15c-7996-4b27-adb3-188193921371 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:59.694896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0e15c-7996-4b27-adb3-188193921371 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:59.722168 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24a756-ca9e-4452-9afb-da8d0f31c419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:59.722868 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24a756-ca9e-4452-9afb-da8d0f31c419 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:59.723209 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24a756-ca9e-4452-9afb-da8d0f31c419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:59.723564 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24a756-ca9e-4452-9afb-da8d0f31c419 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:59.724436 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24a756-ca9e-4452-9afb-da8d0f31c419 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:56:59.724831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24a756-ca9e-4452-9afb-da8d0f31c419 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:59.726614 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24a756-ca9e-4452-9afb-da8d0f31c419 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:59.777002 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 884/1796] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:56:59.781455 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2e121-83ef-4304-9f9e-06f95b40708a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:59.794791 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2e121-83ef-4304-9f9e-06f95b40708a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:59.812563 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d42539-c679-4a55-8d3b-574824c32c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:59.813966 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d42539-c679-4a55-8d3b-574824c32c7a admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:59.815294 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d42539-c679-4a55-8d3b-574824c32c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:59.815729 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d42539-c679-4a55-8d3b-574824c32c7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:59.819199 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d42539-c679-4a55-8d3b-574824c32c7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:59.821937 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d42539-c679-4a55-8d3b-574824c32c7a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:59.935028 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 913/1797] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:56:59 2022] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:56:59.935394 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24a756-ca9e-4452-9afb-da8d0f31c419 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:59.955735 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24a756-ca9e-4452-9afb-da8d0f31c419 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:00.177705 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:00.200430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52fd4d-ab06-4320-9275-fc7fd805dd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:00.205071 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52fd4d-ab06-4320-9275-fc7fd805dd18 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:00.205441 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52fd4d-ab06-4320-9275-fc7fd805dd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:00.205893 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52fd4d-ab06-4320-9275-fc7fd805dd18 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:00.209639 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52fd4d-ab06-4320-9275-fc7fd805dd18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:00.212139 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52fd4d-ab06-4320-9275-fc7fd805dd18 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:00.281366 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d42539-c679-4a55-8d3b-574824c32c7a admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:00.284400 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 885/1798] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:56:59 2022] POST /identity/v3/users => generated 292 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:00.312828 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d42539-c679-4a55-8d3b-574824c32c7a admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:00.318939 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2cf598-b872-4ac9-894c-e89464a2be17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:00.319817 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2cf598-b872-4ac9-894c-e89464a2be17 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:00.320250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2cf598-b872-4ac9-894c-e89464a2be17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:00.320665 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2cf598-b872-4ac9-894c-e89464a2be17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:00.321520 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2cf598-b872-4ac9-894c-e89464a2be17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:00.336295 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2cf598-b872-4ac9-894c-e89464a2be17 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:00.372748 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 914/1799] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:00.376642 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52fd4d-ab06-4320-9275-fc7fd805dd18 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:00.402346 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52fd4d-ab06-4320-9275-fc7fd805dd18 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:00.413065 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f921224-bccb-4745-86ed-03e1a57f5292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:00.413824 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f921224-bccb-4745-86ed-03e1a57f5292 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:00.414172 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f921224-bccb-4745-86ed-03e1a57f5292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:00.414526 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f921224-bccb-4745-86ed-03e1a57f5292 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:00.415635 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f921224-bccb-4745-86ed-03e1a57f5292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:00.426326 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f921224-bccb-4745-86ed-03e1a57f5292 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:00.481371 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 886/1800] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:00.484316 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2cf598-b872-4ac9-894c-e89464a2be17 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:00.523258 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2cf598-b872-4ac9-894c-e89464a2be17 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:00.536657 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0857904-c8c8-46ab-a7af-90bec132fbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:00.550878 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0857904-c8c8-46ab-a7af-90bec132fbc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:00.553115 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0857904-c8c8-46ab-a7af-90bec132fbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:00.554297 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0857904-c8c8-46ab-a7af-90bec132fbc4 admin admin] PATH_INFO: `/v3/projects/a7e2c2ceff1244de811278aec7480d58/users/b0e11f6bc1ee488eb72fa35c3577b433/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:00.586824 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0857904-c8c8-46ab-a7af-90bec132fbc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7e2c2ceff1244de811278aec7480d58, user_id=b0e11f6bc1ee488eb72fa35c3577b433, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:00.590175 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0857904-c8c8-46ab-a7af-90bec132fbc4 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:00.613728 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 915/1801] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:00 2022] PUT /identity/v3/projects/a7e2c2ceff1244de811278aec7480d58/users/b0e11f6bc1ee488eb72fa35c3577b433/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:00.626187 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b9cd7-8f55-4dfe-b7b3-f94a320eaea9 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:00.626474 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b9cd7-8f55-4dfe-b7b3-f94a320eaea9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:00.626904 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b9cd7-8f55-4dfe-b7b3-f94a320eaea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:00.692398 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-7f8b9cd7-8f55-4dfe-b7b3-f94a320eaea9 None None] MFA Rules not processed for user `b0e11f6bc1ee488eb72fa35c3577b433`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:00.693751 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7f8b9cd7-8f55-4dfe-b7b3-f94a320eaea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:00.953980 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 887/1802] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:00.958938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0857904-c8c8-46ab-a7af-90bec132fbc4 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:00.987318 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:01.209877 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0857904-c8c8-46ab-a7af-90bec132fbc4 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:01.219466 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dddf8c-f175-40d6-8b98-8939a8598f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:01.220183 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dddf8c-f175-40d6-8b98-8939a8598f4e admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:01.220465 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dddf8c-f175-40d6-8b98-8939a8598f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:01.220856 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dddf8c-f175-40d6-8b98-8939a8598f4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:01.221561 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dddf8c-f175-40d6-8b98-8939a8598f4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:01.223757 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dddf8c-f175-40d6-8b98-8939a8598f4e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:01.281867 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b9cd7-8f55-4dfe-b7b3-f94a320eaea9 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:01.320214 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 916/1803] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:00 2022] POST /identity/v3/projects => generated 381 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:01.328634 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b9cd7-8f55-4dfe-b7b3-f94a320eaea9 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:01.414858 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06f6d7-e44c-437e-8514-a2ca9f864d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:01.416673 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06f6d7-e44c-437e-8514-a2ca9f864d05 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:01.417311 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06f6d7-e44c-437e-8514-a2ca9f864d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:01.417891 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06f6d7-e44c-437e-8514-a2ca9f864d05 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:01.418988 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06f6d7-e44c-437e-8514-a2ca9f864d05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:01.421686 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06f6d7-e44c-437e-8514-a2ca9f864d05 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:01.488923 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 888/1804] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:01 2022] POST /identity/v3/users => generated 297 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:01.491912 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dddf8c-f175-40d6-8b98-8939a8598f4e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:01.508691 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dddf8c-f175-40d6-8b98-8939a8598f4e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:01.522358 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87529f6-c57d-48ab-a67e-a2509f0ec628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:01.523358 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87529f6-c57d-48ab-a67e-a2509f0ec628 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:01.524113 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87529f6-c57d-48ab-a67e-a2509f0ec628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:01.525546 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87529f6-c57d-48ab-a67e-a2509f0ec628 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:01.542663 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87529f6-c57d-48ab-a67e-a2509f0ec628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:01.549058 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87529f6-c57d-48ab-a67e-a2509f0ec628 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:01.614595 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 917/1805] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:01.620282 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06f6d7-e44c-437e-8514-a2ca9f864d05 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:01.636916 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06f6d7-e44c-437e-8514-a2ca9f864d05 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:01.657772 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0717a40-f3a8-47dd-b880-c99671508a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:01.659794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0717a40-f3a8-47dd-b880-c99671508a7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:01.660660 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0717a40-f3a8-47dd-b880-c99671508a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:01.661177 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0717a40-f3a8-47dd-b880-c99671508a7b admin admin] PATH_INFO: `/v3/projects/337bec7cbc26456cbd0b978d3cf5d438/users/d06dbf82460c45d99e66853bf95cd0ce/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:01.697443 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87529f6-c57d-48ab-a67e-a2509f0ec628 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:01.699406 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a87529f6-c57d-48ab-a67e-a2509f0ec628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:01.722919 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0717a40-f3a8-47dd-b880-c99671508a7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=337bec7cbc26456cbd0b978d3cf5d438, user_id=d06dbf82460c45d99e66853bf95cd0ce, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:01.729071 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0717a40-f3a8-47dd-b880-c99671508a7b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:01.733014 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87529f6-c57d-48ab-a67e-a2509f0ec628 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:01.751610 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe1e04-b30f-4e67-9e48-1e89780ddf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:01.753519 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe1e04-b30f-4e67-9e48-1e89780ddf4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:01.754187 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe1e04-b30f-4e67-9e48-1e89780ddf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:01.754704 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe1e04-b30f-4e67-9e48-1e89780ddf4d admin admin] PATH_INFO: `/v3/projects/23f8af93db2e46d5ac4eb4ab5060ee79` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:01.756820 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe1e04-b30f-4e67-9e48-1e89780ddf4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=23f8af93db2e46d5ac4eb4ab5060ee79)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:01.762133 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe1e04-b30f-4e67-9e48-1e89780ddf4d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:01.802876 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 889/1806] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:01 2022] PUT /identity/v3/projects/337bec7cbc26456cbd0b978d3cf5d438/users/d06dbf82460c45d99e66853bf95cd0ce/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:01.806685 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0717a40-f3a8-47dd-b880-c99671508a7b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:01.942132 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9fbe1e04-b30f-4e67-9e48-1e89780ddf4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23f8af93db2e46d5ac4eb4ab5060ee79', 'request_id': 'req-9fbe1e04-b30f-4e67-9e48-1e89780ddf4d'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:01.968032 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9fbe1e04-b30f-4e67-9e48-1e89780ddf4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23f8af93db2e46d5ac4eb4ab5060ee79', 'request_id': 'req-9fbe1e04-b30f-4e67-9e48-1e89780ddf4d'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:01.980268 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:01.999562 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9fbe1e04-b30f-4e67-9e48-1e89780ddf4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23f8af93db2e46d5ac4eb4ab5060ee79', 'request_id': 'req-9fbe1e04-b30f-4e67-9e48-1e89780ddf4d'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:02.030388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9fbe1e04-b30f-4e67-9e48-1e89780ddf4d admin admin] The token cache is being invalidate because project 23f8af93db2e46d5ac4eb4ab5060ee79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:02.030740 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9fbe1e04-b30f-4e67-9e48-1e89780ddf4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:02.035094 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9fbe1e04-b30f-4e67-9e48-1e89780ddf4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:02.043582 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 918/1807] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:01 2022] DELETE /identity/v3/projects/23f8af93db2e46d5ac4eb4ab5060ee79 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:02.044640 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe1e04-b30f-4e67-9e48-1e89780ddf4d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:02.048729 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9fbe1e04-b30f-4e67-9e48-1e89780ddf4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:02.091397 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0717a40-f3a8-47dd-b880-c99671508a7b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:02.236295 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfbb77-1ff9-46b8-8263-643e17e3e0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:02.237194 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfbb77-1ff9-46b8-8263-643e17e3e0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:02.237577 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfbb77-1ff9-46b8-8263-643e17e3e0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:02.237950 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfbb77-1ff9-46b8-8263-643e17e3e0d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:02.238971 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdfbb77-1ff9-46b8-8263-643e17e3e0d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:02.241050 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdfbb77-1ff9-46b8-8263-643e17e3e0d7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:02.266332 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 890/1808] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 458 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:02.267513 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfbb77-1ff9-46b8-8263-643e17e3e0d7 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:02.270215 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fbdfbb77-1ff9-46b8-8263-643e17e3e0d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:02.299603 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfbb77-1ff9-46b8-8263-643e17e3e0d7 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:02.302127 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe1e04-b30f-4e67-9e48-1e89780ddf4d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:02.326070 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1c190-15dd-4a19-897c-ec02c566d381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:02.327289 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1c190-15dd-4a19-897c-ec02c566d381 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:02.327785 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1c190-15dd-4a19-897c-ec02c566d381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:02.328351 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1c190-15dd-4a19-897c-ec02c566d381 admin admin] PATH_INFO: `/v3/projects/337bec7cbc26456cbd0b978d3cf5d438/users/d06dbf82460c45d99e66853bf95cd0ce/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:02.336078 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1c190-15dd-4a19-897c-ec02c566d381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=337bec7cbc26456cbd0b978d3cf5d438, user_id=d06dbf82460c45d99e66853bf95cd0ce, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:02.338025 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5726e95-a242-43fd-867b-db8ff775eb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:02.338941 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5726e95-a242-43fd-867b-db8ff775eb5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:02.339224 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5726e95-a242-43fd-867b-db8ff775eb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:02.339494 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5726e95-a242-43fd-867b-db8ff775eb5d admin admin] PATH_INFO: `/v3/users/e5f43d747f2b404c9f83cbc3400fd8be` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:02.341243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1c190-15dd-4a19-897c-ec02c566d381 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:02.342404 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5726e95-a242-43fd-867b-db8ff775eb5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5f43d747f2b404c9f83cbc3400fd8be)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:02.345039 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5726e95-a242-43fd-867b-db8ff775eb5d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:02.351433 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:02.375965 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 891/1809] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:02 2022] PUT /identity/v3/projects/337bec7cbc26456cbd0b978d3cf5d438/users/d06dbf82460c45d99e66853bf95cd0ce/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:02.386337 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b0a2a-0408-4e02-a00c-a473265ad362 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:02.386910 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b0a2a-0408-4e02-a00c-a473265ad362 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:02.387162 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b0a2a-0408-4e02-a00c-a473265ad362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:02.490262 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b5726e95-a242-43fd-867b-db8ff775eb5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5f43d747f2b404c9f83cbc3400fd8be'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:02.512455 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d51b0a2a-0408-4e02-a00c-a473265ad362 None None] MFA Rules not processed for user `d06dbf82460c45d99e66853bf95cd0ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:02.522122 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d51b0a2a-0408-4e02-a00c-a473265ad362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:02.541639 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b5726e95-a242-43fd-867b-db8ff775eb5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5f43d747f2b404c9f83cbc3400fd8be'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:02.543656 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b5726e95-a242-43fd-867b-db8ff775eb5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5f43d747f2b404c9f83cbc3400fd8be'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:02.567797 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b5726e95-a242-43fd-867b-db8ff775eb5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5f43d747f2b404c9f83cbc3400fd8be'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:02.584250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b5726e95-a242-43fd-867b-db8ff775eb5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5f43d747f2b404c9f83cbc3400fd8be'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:02.652043 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 919/1810] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:02 2022] DELETE /identity/v3/users/e5f43d747f2b404c9f83cbc3400fd8be => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:02.804110 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 892/1811] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:57:02.822135 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5726e95-a242-43fd-867b-db8ff775eb5d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:02.824384 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b5726e95-a242-43fd-867b-db8ff775eb5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:03.053316 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5726e95-a242-43fd-867b-db8ff775eb5d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:03.060762 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d2dfc-62cc-4c97-a0bb-d685e51ed2b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:03.061465 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d2dfc-62cc-4c97-a0bb-d685e51ed2b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:03.061739 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d2dfc-62cc-4c97-a0bb-d685e51ed2b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:03.062014 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d2dfc-62cc-4c97-a0bb-d685e51ed2b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:03.189873 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b0a2a-0408-4e02-a00c-a473265ad362 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:03.192788 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d51b0a2a-0408-4e02-a00c-a473265ad362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:03.294401 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d2dfc-62cc-4c97-a0bb-d685e51ed2b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:03.307169 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d2dfc-62cc-4c97-a0bb-d685e51ed2b4 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:03.356824 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 920/1812] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:02 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:03.536379 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:03.582288 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d2dfc-62cc-4c97-a0bb-d685e51ed2b4 service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:03.591292 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b0a2a-0408-4e02-a00c-a473265ad362 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:03.595109 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d2dfc-62cc-4c97-a0bb-d685e51ed2b4 service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:03.609477 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725d5f0-c20a-4cda-9da8-893328eb45d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:03.610524 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725d5f0-c20a-4cda-9da8-893328eb45d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:03.612537 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725d5f0-c20a-4cda-9da8-893328eb45d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:03.613108 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725d5f0-c20a-4cda-9da8-893328eb45d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:03.625110 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6725d5f0-c20a-4cda-9da8-893328eb45d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:03.692423 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:03.756796 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efec1e4-08a9-4ab2-83f6-85a86d4eb7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:03.758308 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efec1e4-08a9-4ab2-83f6-85a86d4eb7be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:03.758751 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efec1e4-08a9-4ab2-83f6-85a86d4eb7be admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:03.759186 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efec1e4-08a9-4ab2-83f6-85a86d4eb7be admin admin] PATH_INFO: `/v3/users/755eb9a53f004690afb35923d2185d6a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:03.761370 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efec1e4-08a9-4ab2-83f6-85a86d4eb7be admin admin] RBAC: Authorizing `identity:delete_user(user_id=755eb9a53f004690afb35923d2185d6a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:03.765365 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efec1e4-08a9-4ab2-83f6-85a86d4eb7be admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:03.783977 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725d5f0-c20a-4cda-9da8-893328eb45d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:03.785638 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725d5f0-c20a-4cda-9da8-893328eb45d1 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:03.810048 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 921/1813] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:57:03.869618 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2efec1e4-08a9-4ab2-83f6-85a86d4eb7be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '755eb9a53f004690afb35923d2185d6a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:03.879928 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2efec1e4-08a9-4ab2-83f6-85a86d4eb7be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '755eb9a53f004690afb35923d2185d6a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:03.888699 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2efec1e4-08a9-4ab2-83f6-85a86d4eb7be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '755eb9a53f004690afb35923d2185d6a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:03.906568 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2efec1e4-08a9-4ab2-83f6-85a86d4eb7be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '755eb9a53f004690afb35923d2185d6a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:03.907649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2efec1e4-08a9-4ab2-83f6-85a86d4eb7be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '755eb9a53f004690afb35923d2185d6a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:03.919196 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 893/1814] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:03 2022] DELETE /identity/v3/users/755eb9a53f004690afb35923d2185d6a => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:03.921319 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c055d3b-1a1d-4e5d-8d30-5719e1d7ac56 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:03.921808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c055d3b-1a1d-4e5d-8d30-5719e1d7ac56 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:03.922209 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c055d3b-1a1d-4e5d-8d30-5719e1d7ac56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:03.943447 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-6c055d3b-1a1d-4e5d-8d30-5719e1d7ac56 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:03.944947 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6c055d3b-1a1d-4e5d-8d30-5719e1d7ac56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:04.090836 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 922/1815] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:57:04.252426 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efec1e4-08a9-4ab2-83f6-85a86d4eb7be admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:04.253892 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2efec1e4-08a9-4ab2-83f6-85a86d4eb7be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:04.365222 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417807d6-2eca-4902-a647-96fa9048d3f1 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:04.365803 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417807d6-2eca-4902-a647-96fa9048d3f1 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:04.365803 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417807d6-2eca-4902-a647-96fa9048d3f1 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:04.367453 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 923/1816] 10.222.0.85 () {54 vars in 921 bytes} [Thu Jun 16 14:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:57:04.404456 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efec1e4-08a9-4ab2-83f6-85a86d4eb7be admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:04.412171 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503617b1-3af3-43f8-a679-4482a7267444 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:04.413479 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503617b1-3af3-43f8-a679-4482a7267444 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:04.413950 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503617b1-3af3-43f8-a679-4482a7267444 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:04.414405 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503617b1-3af3-43f8-a679-4482a7267444 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:04.439707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503617b1-3af3-43f8-a679-4482a7267444 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:04.441550 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503617b1-3af3-43f8-a679-4482a7267444 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:04.465237 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 894/1817] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:04.599736 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af48bc-ef29-42f4-acdf-07952b82b05d None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:04.600549 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af48bc-ef29-42f4-acdf-07952b82b05d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:04.601011 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af48bc-ef29-42f4-acdf-07952b82b05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:04.641847 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-47af48bc-ef29-42f4-acdf-07952b82b05d None None] MFA Rules not processed for user `c74e4d1bdaa64ed280cc5f4c8e79b842`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:04.643903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-47af48bc-ef29-42f4-acdf-07952b82b05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:04.756343 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 924/1818] 10.222.0.85 () {58 vars in 1018 bytes} [Thu Jun 16 14:57:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:04.789138 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503617b1-3af3-43f8-a679-4482a7267444 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:04.790570 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-503617b1-3af3-43f8-a679-4482a7267444 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:04.807111 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503617b1-3af3-43f8-a679-4482a7267444 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:04.812846 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba278c7-3778-4f5e-8db3-132ac2132c1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:04.814024 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba278c7-3778-4f5e-8db3-132ac2132c1b service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:04.814024 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba278c7-3778-4f5e-8db3-132ac2132c1b service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:04.814024 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba278c7-3778-4f5e-8db3-132ac2132c1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:04.824458 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba278c7-3778-4f5e-8db3-132ac2132c1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:04.826632 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba278c7-3778-4f5e-8db3-132ac2132c1b service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:04.839507 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 895/1819] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:05.209273 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af48bc-ef29-42f4-acdf-07952b82b05d None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:05.211027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-47af48bc-ef29-42f4-acdf-07952b82b05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:05.227142 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af48bc-ef29-42f4-acdf-07952b82b05d None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:05.237673 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4812f-3037-4919-b7e0-eb376b34d80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:05.238555 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4812f-3037-4919-b7e0-eb376b34d80a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:05.238902 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4812f-3037-4919-b7e0-eb376b34d80a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:05.239273 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4812f-3037-4919-b7e0-eb376b34d80a admin admin] PATH_INFO: `/v3/projects/8d01483b6fb04047b83fca9ddb782b2f` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:05.264739 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4812f-3037-4919-b7e0-eb376b34d80a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d01483b6fb04047b83fca9ddb782b2f)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:05.278954 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4812f-3037-4919-b7e0-eb376b34d80a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:05.396060 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-27a4812f-3037-4919-b7e0-eb376b34d80a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d01483b6fb04047b83fca9ddb782b2f', 'request_id': 'req-27a4812f-3037-4919-b7e0-eb376b34d80a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:05.401756 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:05.405355 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-27a4812f-3037-4919-b7e0-eb376b34d80a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d01483b6fb04047b83fca9ddb782b2f', 'request_id': 'req-27a4812f-3037-4919-b7e0-eb376b34d80a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:05.428941 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-27a4812f-3037-4919-b7e0-eb376b34d80a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d01483b6fb04047b83fca9ddb782b2f', 'request_id': 'req-27a4812f-3037-4919-b7e0-eb376b34d80a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:05.463859 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-27a4812f-3037-4919-b7e0-eb376b34d80a admin admin] The token cache is being invalidate because project 8d01483b6fb04047b83fca9ddb782b2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:05.464713 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-27a4812f-3037-4919-b7e0-eb376b34d80a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:05.470475 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-27a4812f-3037-4919-b7e0-eb376b34d80a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:05.474847 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 925/1820] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:05 2022] DELETE /identity/v3/projects/8d01483b6fb04047b83fca9ddb782b2f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:05.479999 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608cff8-8415-48fe-b622-c51a498f3ecb None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:05.480495 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608cff8-8415-48fe-b622-c51a498f3ecb None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:05.481017 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608cff8-8415-48fe-b622-c51a498f3ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:05.491521 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:05.521907 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-9608cff8-8415-48fe-b622-c51a498f3ecb None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:05.524772 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9608cff8-8415-48fe-b622-c51a498f3ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:05.594446 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4812f-3037-4919-b7e0-eb376b34d80a admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:05.595787 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-27a4812f-3037-4919-b7e0-eb376b34d80a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:05.750058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 896/1821] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:05.759627 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fac5b0-51b6-48a2-9280-6e0c20233693 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:05.760219 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fac5b0-51b6-48a2-9280-6e0c20233693 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:05.760832 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fac5b0-51b6-48a2-9280-6e0c20233693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:05.769518 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4812f-3037-4919-b7e0-eb376b34d80a admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:05.779309 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ecf365-9bee-4030-a982-a45dc6b9be23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:05.782213 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecf365-9bee-4030-a982-a45dc6b9be23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:05.782503 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecf365-9bee-4030-a982-a45dc6b9be23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:05.789203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecf365-9bee-4030-a982-a45dc6b9be23 admin admin] PATH_INFO: `/v3/projects/74931b59b6fd4ffc92fa227d4a454053` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:05.790978 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ecf365-9bee-4030-a982-a45dc6b9be23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74931b59b6fd4ffc92fa227d4a454053)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:05.793509 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ecf365-9bee-4030-a982-a45dc6b9be23 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:05.805636 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-92fac5b0-51b6-48a2-9280-6e0c20233693 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:05.807085 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-92fac5b0-51b6-48a2-9280-6e0c20233693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:05.818777 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 897/1822] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:05.823825 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fac5b0-51b6-48a2-9280-6e0c20233693 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:05.849754 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fac5b0-51b6-48a2-9280-6e0c20233693 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:05.857548 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-00ecf365-9bee-4030-a982-a45dc6b9be23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74931b59b6fd4ffc92fa227d4a454053', 'request_id': 'req-00ecf365-9bee-4030-a982-a45dc6b9be23'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:05.869137 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-00ecf365-9bee-4030-a982-a45dc6b9be23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74931b59b6fd4ffc92fa227d4a454053', 'request_id': 'req-00ecf365-9bee-4030-a982-a45dc6b9be23'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:05.876184 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-00ecf365-9bee-4030-a982-a45dc6b9be23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74931b59b6fd4ffc92fa227d4a454053', 'request_id': 'req-00ecf365-9bee-4030-a982-a45dc6b9be23'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:05.890788 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-00ecf365-9bee-4030-a982-a45dc6b9be23 admin admin] The token cache is being invalidate because project 74931b59b6fd4ffc92fa227d4a454053 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:05.891352 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-00ecf365-9bee-4030-a982-a45dc6b9be23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:05.892399 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-00ecf365-9bee-4030-a982-a45dc6b9be23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:05.894640 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 926/1823] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:05 2022] DELETE /identity/v3/projects/74931b59b6fd4ffc92fa227d4a454053 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:05.899169 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ecf365-9bee-4030-a982-a45dc6b9be23 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:05.905241 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-00ecf365-9bee-4030-a982-a45dc6b9be23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:05.949107 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e4df3-204a-4215-8203-4ab216002c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:05.949784 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e4df3-204a-4215-8203-4ab216002c8f admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:05.950062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e4df3-204a-4215-8203-4ab216002c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:05.950334 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e4df3-204a-4215-8203-4ab216002c8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:05.951058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e4df3-204a-4215-8203-4ab216002c8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:57:05.953877 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e4df3-204a-4215-8203-4ab216002c8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:05.955534 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e4df3-204a-4215-8203-4ab216002c8f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:05.976267 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 898/1824] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:57:05.982378 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e4df3-204a-4215-8203-4ab216002c8f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:05.984223 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ce8e4df3-204a-4215-8203-4ab216002c8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:06.004512 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e4df3-204a-4215-8203-4ab216002c8f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:06.021066 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4dbca1-a55b-4d02-934c-2ee5458d5514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:06.022118 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4dbca1-a55b-4d02-934c-2ee5458d5514 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:06.022576 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4dbca1-a55b-4d02-934c-2ee5458d5514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:06.023007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4dbca1-a55b-4d02-934c-2ee5458d5514 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:06.023935 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4dbca1-a55b-4d02-934c-2ee5458d5514 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:06.025836 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4dbca1-a55b-4d02-934c-2ee5458d5514 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:06.053185 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ecf365-9bee-4030-a982-a45dc6b9be23 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:06.060004 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7892b0e-0c8c-4daf-8281-fc8e37aaa4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:06.064439 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7892b0e-0c8c-4daf-8281-fc8e37aaa4a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:06.065022 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7892b0e-0c8c-4daf-8281-fc8e37aaa4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:06.065498 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7892b0e-0c8c-4daf-8281-fc8e37aaa4a2 admin admin] PATH_INFO: `/v3/users/7ef43ed1577c4717ba3911c2a9982fb0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:06.067730 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7892b0e-0c8c-4daf-8281-fc8e37aaa4a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ef43ed1577c4717ba3911c2a9982fb0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:06.070436 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7892b0e-0c8c-4daf-8281-fc8e37aaa4a2 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:06.085731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 899/1825] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:05 2022] POST /identity/v3/projects => generated 357 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:06.090107 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4dbca1-a55b-4d02-934c-2ee5458d5514 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:06.107909 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:06.163187 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c7892b0e-0c8c-4daf-8281-fc8e37aaa4a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ef43ed1577c4717ba3911c2a9982fb0'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:06.206904 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4dbca1-a55b-4d02-934c-2ee5458d5514 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:06.207606 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c7892b0e-0c8c-4daf-8281-fc8e37aaa4a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ef43ed1577c4717ba3911c2a9982fb0'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:06.208556 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c7892b0e-0c8c-4daf-8281-fc8e37aaa4a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ef43ed1577c4717ba3911c2a9982fb0'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:06.213441 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0781c-7b56-45ef-8a4f-fb2b523c900b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:06.214191 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0781c-7b56-45ef-8a4f-fb2b523c900b admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:06.214923 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0781c-7b56-45ef-8a4f-fb2b523c900b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:06.215238 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0781c-7b56-45ef-8a4f-fb2b523c900b admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:06.216063 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0781c-7b56-45ef-8a4f-fb2b523c900b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:06.219263 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c7892b0e-0c8c-4daf-8281-fc8e37aaa4a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ef43ed1577c4717ba3911c2a9982fb0'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:06.219798 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0781c-7b56-45ef-8a4f-fb2b523c900b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:06.229376 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c7892b0e-0c8c-4daf-8281-fc8e37aaa4a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ef43ed1577c4717ba3911c2a9982fb0'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:06.237536 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 927/1826] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:05 2022] DELETE /identity/v3/users/7ef43ed1577c4717ba3911c2a9982fb0 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:06.239123 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:06.251446 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 900/1827] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:06 2022] POST /identity/v3/users => generated 279 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:06.264059 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7892b0e-0c8c-4daf-8281-fc8e37aaa4a2 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:06.275047 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c7892b0e-0c8c-4daf-8281-fc8e37aaa4a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:06.354763 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7892b0e-0c8c-4daf-8281-fc8e37aaa4a2 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:06.361667 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506fa0c4-f099-4ded-b76b-74caa52d0891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:06.362966 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fa0c4-f099-4ded-b76b-74caa52d0891 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:06.363249 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fa0c4-f099-4ded-b76b-74caa52d0891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:06.363548 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fa0c4-f099-4ded-b76b-74caa52d0891 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:06.364451 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506fa0c4-f099-4ded-b76b-74caa52d0891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:06.366194 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506fa0c4-f099-4ded-b76b-74caa52d0891 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:06.385687 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 928/1828] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:06.387752 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0781c-7b56-45ef-8a4f-fb2b523c900b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:06.403854 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0781c-7b56-45ef-8a4f-fb2b523c900b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:06.409543 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dfdc15-7d1c-4d68-b7f0-f27e70507ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:06.410336 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfdc15-7d1c-4d68-b7f0-f27e70507ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:06.410758 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfdc15-7d1c-4d68-b7f0-f27e70507ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:06.411176 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfdc15-7d1c-4d68-b7f0-f27e70507ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:06.412234 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dfdc15-7d1c-4d68-b7f0-f27e70507ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:06.414546 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dfdc15-7d1c-4d68-b7f0-f27e70507ec9 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:06.428758 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 901/1829] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:06.433065 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506fa0c4-f099-4ded-b76b-74caa52d0891 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:06.444208 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506fa0c4-f099-4ded-b76b-74caa52d0891 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:06.449725 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03d14d-6d31-4b11-a4d4-5fbb25d6318c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:06.450700 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03d14d-6d31-4b11-a4d4-5fbb25d6318c admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:06.451049 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03d14d-6d31-4b11-a4d4-5fbb25d6318c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:06.451384 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03d14d-6d31-4b11-a4d4-5fbb25d6318c admin admin] PATH_INFO: `/v3/projects/703d6cd6f06644dd86e12338085b8c34/users/54809c17447b4657b39447d485403f0c/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:06.470302 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03d14d-6d31-4b11-a4d4-5fbb25d6318c admin admin] RBAC: Authorizing `identity:create_grant(project_id=703d6cd6f06644dd86e12338085b8c34, user_id=54809c17447b4657b39447d485403f0c, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:06.474481 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03d14d-6d31-4b11-a4d4-5fbb25d6318c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:06.493929 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 929/1830] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:06 2022] PUT /identity/v3/projects/703d6cd6f06644dd86e12338085b8c34/users/54809c17447b4657b39447d485403f0c/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:06.506057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6d8f0-9485-4508-a08b-8a911338a66e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:06.506573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6d8f0-9485-4508-a08b-8a911338a66e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:06.507051 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6d8f0-9485-4508-a08b-8a911338a66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:06.540478 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-bdf6d8f0-9485-4508-a08b-8a911338a66e None None] MFA Rules not processed for user `54809c17447b4657b39447d485403f0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:06.541716 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-bdf6d8f0-9485-4508-a08b-8a911338a66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:06.619568 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 902/1831] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:06 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:06.623683 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03d14d-6d31-4b11-a4d4-5fbb25d6318c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:06.705883 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03d14d-6d31-4b11-a4d4-5fbb25d6318c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:06.714502 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a7708-4172-490c-a617-821068ad3c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:06.715364 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6d8f0-9485-4508-a08b-8a911338a66e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:06.715947 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a7708-4172-490c-a617-821068ad3c7d admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:06.716299 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a7708-4172-490c-a617-821068ad3c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:06.716592 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a7708-4172-490c-a617-821068ad3c7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:06.717317 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a7708-4172-490c-a617-821068ad3c7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:06.717795 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-bdf6d8f0-9485-4508-a08b-8a911338a66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:06.719701 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a7708-4172-490c-a617-821068ad3c7d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:06.736914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:06.738167 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6d8f0-9485-4508-a08b-8a911338a66e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:06.745507 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5140e-6fba-4b02-a0cd-b922ae7f86ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:06.746557 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5140e-6fba-4b02-a0cd-b922ae7f86ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:06.748193 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5140e-6fba-4b02-a0cd-b922ae7f86ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:06.748490 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5140e-6fba-4b02-a0cd-b922ae7f86ef admin admin] PATH_INFO: `/v3/projects/f4b8008da0fa4fffad7914459150e2dd` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:06.751163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da5140e-6fba-4b02-a0cd-b922ae7f86ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4b8008da0fa4fffad7914459150e2dd)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:06.753668 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da5140e-6fba-4b02-a0cd-b922ae7f86ef admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:06.789278 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 930/1832] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:06 2022] POST /identity/v3/projects => generated 357 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:06.793414 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a7708-4172-490c-a617-821068ad3c7d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:06.849045 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2da5140e-6fba-4b02-a0cd-b922ae7f86ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4b8008da0fa4fffad7914459150e2dd', 'request_id': 'req-2da5140e-6fba-4b02-a0cd-b922ae7f86ef'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:06.862653 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2da5140e-6fba-4b02-a0cd-b922ae7f86ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4b8008da0fa4fffad7914459150e2dd', 'request_id': 'req-2da5140e-6fba-4b02-a0cd-b922ae7f86ef'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:06.881058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2da5140e-6fba-4b02-a0cd-b922ae7f86ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4b8008da0fa4fffad7914459150e2dd', 'request_id': 'req-2da5140e-6fba-4b02-a0cd-b922ae7f86ef'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:06.932096 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2da5140e-6fba-4b02-a0cd-b922ae7f86ef admin admin] The token cache is being invalidate because project f4b8008da0fa4fffad7914459150e2dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:06.932471 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2da5140e-6fba-4b02-a0cd-b922ae7f86ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:06.938442 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2da5140e-6fba-4b02-a0cd-b922ae7f86ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:06.945062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 903/1833] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:06 2022] DELETE /identity/v3/projects/f4b8008da0fa4fffad7914459150e2dd => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:06.946747 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca2f4c-0e45-4c68-acc9-039ecf5b9bdf None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:06.947423 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca2f4c-0e45-4c68-acc9-039ecf5b9bdf None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:06.947655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca2f4c-0e45-4c68-acc9-039ecf5b9bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:06.979632 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a7708-4172-490c-a617-821068ad3c7d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:07.036379 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-52ca2f4c-0e45-4c68-acc9-039ecf5b9bdf None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:07.043683 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-52ca2f4c-0e45-4c68-acc9-039ecf5b9bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:07.148013 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5ce25-5ace-48a2-ba10-24762be7c809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:07.148940 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5ce25-5ace-48a2-ba10-24762be7c809 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:07.149436 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5ce25-5ace-48a2-ba10-24762be7c809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:07.149918 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5ce25-5ace-48a2-ba10-24762be7c809 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:07.150818 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5ce25-5ace-48a2-ba10-24762be7c809 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:07.153823 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5ce25-5ace-48a2-ba10-24762be7c809 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:07.173950 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:07.182668 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 931/1834] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:06 2022] POST /identity/v3/users => generated 285 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:07.183711 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5ce25-5ace-48a2-ba10-24762be7c809 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:07.186767 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-acc5ce25-5ace-48a2-ba10-24762be7c809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:07.189822 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 904/1835] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:07.190905 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca2f4c-0e45-4c68-acc9-039ecf5b9bdf None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:07.194322 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-52ca2f4c-0e45-4c68-acc9-039ecf5b9bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:07.222315 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5ce25-5ace-48a2-ba10-24762be7c809 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:07.226486 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca2f4c-0e45-4c68-acc9-039ecf5b9bdf None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:07.235266 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943688e-a278-40e4-8f9f-dca7855dc490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:07.236273 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943688e-a278-40e4-8f9f-dca7855dc490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:07.236578 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943688e-a278-40e4-8f9f-dca7855dc490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:07.236868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943688e-a278-40e4-8f9f-dca7855dc490 admin admin] PATH_INFO: `/v3/users/b0e11f6bc1ee488eb72fa35c3577b433` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:07.238689 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943688e-a278-40e4-8f9f-dca7855dc490 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0e11f6bc1ee488eb72fa35c3577b433)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:07.242778 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bac81-c844-4c4f-be3d-bd0fb5a286de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:07.243578 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bac81-c844-4c4f-be3d-bd0fb5a286de admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:07.244104 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bac81-c844-4c4f-be3d-bd0fb5a286de admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:07.244553 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bac81-c844-4c4f-be3d-bd0fb5a286de admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:07.245746 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0bac81-c844-4c4f-be3d-bd0fb5a286de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:07.247596 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943688e-a278-40e4-8f9f-dca7855dc490 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:07.248459 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0bac81-c844-4c4f-be3d-bd0fb5a286de admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:07.265827 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 905/1836] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:07.267056 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165cdff-fe32-417a-aeef-0eef8fb0e765 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:07.267369 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165cdff-fe32-417a-aeef-0eef8fb0e765 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:07.267650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165cdff-fe32-417a-aeef-0eef8fb0e765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:07.356226 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4165cdff-fe32-417a-aeef-0eef8fb0e765 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:07.360161 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4165cdff-fe32-417a-aeef-0eef8fb0e765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:07.383956 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 906/1837] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:07.384872 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165cdff-fe32-417a-aeef-0eef8fb0e765 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:07.391005 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7943688e-a278-40e4-8f9f-dca7855dc490 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0e11f6bc1ee488eb72fa35c3577b433'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:07.409672 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7943688e-a278-40e4-8f9f-dca7855dc490 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0e11f6bc1ee488eb72fa35c3577b433'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:07.411164 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7943688e-a278-40e4-8f9f-dca7855dc490 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0e11f6bc1ee488eb72fa35c3577b433'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:07.411631 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165cdff-fe32-417a-aeef-0eef8fb0e765 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:07.422785 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7943688e-a278-40e4-8f9f-dca7855dc490 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0e11f6bc1ee488eb72fa35c3577b433'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:07.424430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5c3ba-ec26-4831-9c1f-6a783b7f996a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:07.426510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5c3ba-ec26-4831-9c1f-6a783b7f996a admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:07.426796 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5c3ba-ec26-4831-9c1f-6a783b7f996a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:07.427096 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5c3ba-ec26-4831-9c1f-6a783b7f996a admin admin] PATH_INFO: `/v3/projects/40e7177dbfa94c50bbf71b99fd711d25/users/feb7286dccdd4520886e4bd1be55bb5c/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:07.449352 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7943688e-a278-40e4-8f9f-dca7855dc490 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0e11f6bc1ee488eb72fa35c3577b433'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:07.450908 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:07.457459 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 932/1838] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:07 2022] DELETE /identity/v3/users/b0e11f6bc1ee488eb72fa35c3577b433 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:07.461684 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943688e-a278-40e4-8f9f-dca7855dc490 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:07.467895 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5c3ba-ec26-4831-9c1f-6a783b7f996a admin admin] RBAC: Authorizing `identity:create_grant(project_id=40e7177dbfa94c50bbf71b99fd711d25, user_id=feb7286dccdd4520886e4bd1be55bb5c, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:07.468168 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7943688e-a278-40e4-8f9f-dca7855dc490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:07.472424 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5c3ba-ec26-4831-9c1f-6a783b7f996a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:07.511523 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 907/1839] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:07 2022] PUT /identity/v3/projects/40e7177dbfa94c50bbf71b99fd711d25/users/feb7286dccdd4520886e4bd1be55bb5c/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:07.513776 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cdd69-06b6-4b3b-b3f1-11e496c82bf7 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:07.520189 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cdd69-06b6-4b3b-b3f1-11e496c82bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:07.520189 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cdd69-06b6-4b3b-b3f1-11e496c82bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:07.547038 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-cc6cdd69-06b6-4b3b-b3f1-11e496c82bf7 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:07.548431 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-cc6cdd69-06b6-4b3b-b3f1-11e496c82bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:07.624232 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943688e-a278-40e4-8f9f-dca7855dc490 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:07.675375 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 908/1840] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:07.676289 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cdd69-06b6-4b3b-b3f1-11e496c82bf7 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:07.677765 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-cc6cdd69-06b6-4b3b-b3f1-11e496c82bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:07.706538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cdd69-06b6-4b3b-b3f1-11e496c82bf7 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:07.719048 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52c1da-4166-4000-ace9-b64c623d41e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:07.722143 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52c1da-4166-4000-ace9-b64c623d41e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:07.722663 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52c1da-4166-4000-ace9-b64c623d41e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:07.723123 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52c1da-4166-4000-ace9-b64c623d41e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:07.725029 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52c1da-4166-4000-ace9-b64c623d41e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:07.727014 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52c1da-4166-4000-ace9-b64c623d41e9 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:07.746631 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 909/1841] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:07.746631 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb61e1-4ad3-4e66-8f1f-a977d46a4d99 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:07.746631 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb61e1-4ad3-4e66-8f1f-a977d46a4d99 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:07.746631 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb61e1-4ad3-4e66-8f1f-a977d46a4d99 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:07.747377 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 910/1842] 10.222.0.85 () {54 vars in 921 bytes} [Thu Jun 16 14:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:57:07.748093 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb61e1-4ad3-4e66-8f1f-a977d46a4d99 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:07.750660 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ffdb61e1-4ad3-4e66-8f1f-a977d46a4d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:07.763655 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ab5e7-5058-44e0-a925-eacac198496c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:07.764476 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ab5e7-5058-44e0-a925-eacac198496c admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:07.764824 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ab5e7-5058-44e0-a925-eacac198496c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:07.765329 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ab5e7-5058-44e0-a925-eacac198496c admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:07.766471 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ab5e7-5058-44e0-a925-eacac198496c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:57:07.767220 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ab5e7-5058-44e0-a925-eacac198496c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:07.769664 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ab5e7-5058-44e0-a925-eacac198496c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:07.785125 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 933/1843] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:57:07.786140 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ab5e7-5058-44e0-a925-eacac198496c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:07.798410 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ab5e7-5058-44e0-a925-eacac198496c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:07.804123 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd7bcc-6341-4847-a1a9-2cae56384fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:07.805130 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd7bcc-6341-4847-a1a9-2cae56384fd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:07.805413 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd7bcc-6341-4847-a1a9-2cae56384fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:07.805750 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd7bcc-6341-4847-a1a9-2cae56384fd3 admin admin] PATH_INFO: `/v3/projects/40e7177dbfa94c50bbf71b99fd711d25/users/feb7286dccdd4520886e4bd1be55bb5c/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:07.807892 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd7bcc-6341-4847-a1a9-2cae56384fd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40e7177dbfa94c50bbf71b99fd711d25, user_id=feb7286dccdd4520886e4bd1be55bb5c, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:07.824386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb61e1-4ad3-4e66-8f1f-a977d46a4d99 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:07.824595 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd7bcc-6341-4847-a1a9-2cae56384fd3 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:07.837332 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afabd16-8375-4010-b5cc-cc85de0b0eac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:07.838015 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afabd16-8375-4010-b5cc-cc85de0b0eac service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:07.838287 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afabd16-8375-4010-b5cc-cc85de0b0eac service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:07.838562 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afabd16-8375-4010-b5cc-cc85de0b0eac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:07.868496 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 934/1844] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:07 2022] PUT /identity/v3/projects/40e7177dbfa94c50bbf71b99fd711d25/users/feb7286dccdd4520886e4bd1be55bb5c/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:07.869336 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd7bcc-6341-4847-a1a9-2cae56384fd3 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:07.876940 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afabd16-8375-4010-b5cc-cc85de0b0eac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:07.878391 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afabd16-8375-4010-b5cc-cc85de0b0eac service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:07.899437 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 911/1845] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:07.901676 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff0d3e-84c9-490e-a50a-982f1f992486 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:07.901963 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff0d3e-84c9-490e-a50a-982f1f992486 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:07.902773 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff0d3e-84c9-490e-a50a-982f1f992486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:07.963242 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-64ff0d3e-84c9-490e-a50a-982f1f992486 None None] MFA Rules not processed for user `feb7286dccdd4520886e4bd1be55bb5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:07.965599 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-64ff0d3e-84c9-490e-a50a-982f1f992486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:07.994981 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd7bcc-6341-4847-a1a9-2cae56384fd3 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:08.007336 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b314c5d-becf-4b64-bb43-214e0127f176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:08.008370 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b314c5d-becf-4b64-bb43-214e0127f176 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:08.008878 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b314c5d-becf-4b64-bb43-214e0127f176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:08.009166 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b314c5d-becf-4b64-bb43-214e0127f176 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:08.010667 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b314c5d-becf-4b64-bb43-214e0127f176 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:08.013923 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b314c5d-becf-4b64-bb43-214e0127f176 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:08.057424 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 935/1846] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:07 2022] POST /identity/v3/projects => generated 365 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:08.057424 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0d848-a701-4c74-83b0-d0bc23094bfa None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:08.057424 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0d848-a701-4c74-83b0-d0bc23094bfa None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:08.057424 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0d848-a701-4c74-83b0-d0bc23094bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:08.082568 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-7df0d848-a701-4c74-83b0-d0bc23094bfa None None] MFA Rules not processed for user `c74e4d1bdaa64ed280cc5f4c8e79b842`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:08.082857 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:08.084194 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7df0d848-a701-4c74-83b0-d0bc23094bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:08.094703 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:08.133062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 912/1847] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:07 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:08.134268 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff0d3e-84c9-490e-a50a-982f1f992486 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:08.148061 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff0d3e-84c9-490e-a50a-982f1f992486 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:08.196905 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 936/1848] 10.222.0.85 () {58 vars in 1018 bytes} [Thu Jun 16 14:57:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:08.197999 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df0d848-a701-4c74-83b0-d0bc23094bfa None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:08.199891 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7df0d848-a701-4c74-83b0-d0bc23094bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:08.223084 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77302191-5528-4717-949c-68b06812526b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:08.224647 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77302191-5528-4717-949c-68b06812526b admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:08.225089 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77302191-5528-4717-949c-68b06812526b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:08.225521 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77302191-5528-4717-949c-68b06812526b admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:08.226373 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77302191-5528-4717-949c-68b06812526b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:08.229183 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77302191-5528-4717-949c-68b06812526b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:08.272749 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 913/1849] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:08 2022] POST /identity/v3/users => generated 283 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:08.275228 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77302191-5528-4717-949c-68b06812526b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:08.280258 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-77302191-5528-4717-949c-68b06812526b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:08.300312 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77302191-5528-4717-949c-68b06812526b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:08.306509 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df0d848-a701-4c74-83b0-d0bc23094bfa None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:08.309201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67996723-0abe-4631-a3c9-51b6c6e5f6a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:08.311162 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67996723-0abe-4631-a3c9-51b6c6e5f6a5 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:08.311829 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67996723-0abe-4631-a3c9-51b6c6e5f6a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:08.312614 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67996723-0abe-4631-a3c9-51b6c6e5f6a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:08.313353 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab8d78-350c-4143-8dfb-0f07bc1e2380 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:08.314151 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab8d78-350c-4143-8dfb-0f07bc1e2380 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:08.314485 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab8d78-350c-4143-8dfb-0f07bc1e2380 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:08.314865 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab8d78-350c-4143-8dfb-0f07bc1e2380 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:08.327079 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67996723-0abe-4631-a3c9-51b6c6e5f6a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:08.329589 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67996723-0abe-4631-a3c9-51b6c6e5f6a5 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:08.350748 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 914/1850] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:08.351772 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67996723-0abe-4631-a3c9-51b6c6e5f6a5 service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:08.379803 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67996723-0abe-4631-a3c9-51b6c6e5f6a5 service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:08.390035 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3135da-acc4-4dfa-b40b-54e465be8784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:08.392477 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3135da-acc4-4dfa-b40b-54e465be8784 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:08.392748 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3135da-acc4-4dfa-b40b-54e465be8784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:08.393003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3135da-acc4-4dfa-b40b-54e465be8784 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:08.393741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3135da-acc4-4dfa-b40b-54e465be8784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:08.395414 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3135da-acc4-4dfa-b40b-54e465be8784 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:08.416109 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab8d78-350c-4143-8dfb-0f07bc1e2380 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:08.417680 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab8d78-350c-4143-8dfb-0f07bc1e2380 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:08.431423 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 915/1851] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:08.431423 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3135da-acc4-4dfa-b40b-54e465be8784 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:08.442402 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3135da-acc4-4dfa-b40b-54e465be8784 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:08.445227 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 937/1852] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:08 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:08.456680 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81b977-4b20-4c86-baed-b5dae6dd1130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:08.457437 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81b977-4b20-4c86-baed-b5dae6dd1130 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:08.457747 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81b977-4b20-4c86-baed-b5dae6dd1130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:08.458390 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81b977-4b20-4c86-baed-b5dae6dd1130 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:08.459081 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81b977-4b20-4c86-baed-b5dae6dd1130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:08.461141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81b977-4b20-4c86-baed-b5dae6dd1130 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:08.487179 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 916/1853] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:08.488093 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab8d78-350c-4143-8dfb-0f07bc1e2380 service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:08.502149 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab8d78-350c-4143-8dfb-0f07bc1e2380 service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:08.509772 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563464d-9831-46b8-bc62-54f1b5717087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:08.511121 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563464d-9831-46b8-bc62-54f1b5717087 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:08.511561 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563464d-9831-46b8-bc62-54f1b5717087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:08.512022 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563464d-9831-46b8-bc62-54f1b5717087 admin admin] PATH_INFO: `/v3/projects/34da0c2cacac404fa7f398ae71ef6ab2/users/5b59e84b1b7c48ce9e0c05a93ca431ce/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:08.536702 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81b977-4b20-4c86-baed-b5dae6dd1130 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:08.539486 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563464d-9831-46b8-bc62-54f1b5717087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34da0c2cacac404fa7f398ae71ef6ab2, user_id=5b59e84b1b7c48ce9e0c05a93ca431ce, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:08.542939 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563464d-9831-46b8-bc62-54f1b5717087 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:08.549939 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81b977-4b20-4c86-baed-b5dae6dd1130 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:08.556235 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca57d9d-88df-48f5-819a-a4e5178d6717 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:08.556601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca57d9d-88df-48f5-819a-a4e5178d6717 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:08.556915 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca57d9d-88df-48f5-819a-a4e5178d6717 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:08.557225 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca57d9d-88df-48f5-819a-a4e5178d6717 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:08.565810 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7ca57d9d-88df-48f5-819a-a4e5178d6717 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:08.567255 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 938/1854] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:08 2022] PUT /identity/v3/projects/34da0c2cacac404fa7f398ae71ef6ab2/users/5b59e84b1b7c48ce9e0c05a93ca431ce/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:08.579172 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb681223-cf56-4278-af14-e0a75d7168e3 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:08.581159 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb681223-cf56-4278-af14-e0a75d7168e3 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:08.581447 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb681223-cf56-4278-af14-e0a75d7168e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:08.617199 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-cb681223-cf56-4278-af14-e0a75d7168e3 None None] MFA Rules not processed for user `5b59e84b1b7c48ce9e0c05a93ca431ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:08.618443 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-cb681223-cf56-4278-af14-e0a75d7168e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:08.655653 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:08.721490 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 939/1855] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:08 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:08.725705 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb681223-cf56-4278-af14-e0a75d7168e3 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:08.742881 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca57d9d-88df-48f5-819a-a4e5178d6717 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:08.744510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca57d9d-88df-48f5-819a-a4e5178d6717 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:08.819146 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 917/1856] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:08 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:57:08.852856 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb681223-cf56-4278-af14-e0a75d7168e3 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:08.866718 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979b4fb-4f0e-4f14-ab53-372ecf7961d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:08.867488 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979b4fb-4f0e-4f14-ab53-372ecf7961d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:08.867817 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979b4fb-4f0e-4f14-ab53-372ecf7961d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:08.868138 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979b4fb-4f0e-4f14-ab53-372ecf7961d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:08.868847 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979b4fb-4f0e-4f14-ab53-372ecf7961d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:08.871316 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979b4fb-4f0e-4f14-ab53-372ecf7961d0 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:08.954767 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca57d9d-88df-48f5-819a-a4e5178d6717 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:08.957305 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 940/1857] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:08 2022] POST /identity/v3/projects => generated 367 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:09.003131 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca57d9d-88df-48f5-819a-a4e5178d6717 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:09.080677 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:09.161286 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7039c31-71e6-414a-bc92-07438df2b1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:09.161286 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7039c31-71e6-414a-bc92-07438df2b1a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:09.161286 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7039c31-71e6-414a-bc92-07438df2b1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:09.161286 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7039c31-71e6-414a-bc92-07438df2b1a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:09.161633 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7039c31-71e6-414a-bc92-07438df2b1a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:09.161633 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7039c31-71e6-414a-bc92-07438df2b1a2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:09.206727 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 918/1858] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:08 2022] POST /identity/v3/users => generated 290 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:09.208986 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979b4fb-4f0e-4f14-ab53-372ecf7961d0 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:09.209125 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7039c31-71e6-414a-bc92-07438df2b1a2 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:09.212716 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6979b4fb-4f0e-4f14-ab53-372ecf7961d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:09.223281 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7039c31-71e6-414a-bc92-07438df2b1a2 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:09.229908 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98756b8a-0f24-4fd1-8d9e-869ef2df3648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:09.230865 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98756b8a-0f24-4fd1-8d9e-869ef2df3648 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:09.231306 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98756b8a-0f24-4fd1-8d9e-869ef2df3648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:09.231746 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98756b8a-0f24-4fd1-8d9e-869ef2df3648 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:09.232937 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98756b8a-0f24-4fd1-8d9e-869ef2df3648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:09.234933 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98756b8a-0f24-4fd1-8d9e-869ef2df3648 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:09.237145 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979b4fb-4f0e-4f14-ab53-372ecf7961d0 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:09.243207 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe485b5-a6d0-43d7-85b1-e53bcafc3105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:09.245077 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe485b5-a6d0-43d7-85b1-e53bcafc3105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:09.245444 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe485b5-a6d0-43d7-85b1-e53bcafc3105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:09.245795 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe485b5-a6d0-43d7-85b1-e53bcafc3105 admin admin] PATH_INFO: `/v3/projects/a7e2c2ceff1244de811278aec7480d58` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:09.247133 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe485b5-a6d0-43d7-85b1-e53bcafc3105 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7e2c2ceff1244de811278aec7480d58)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:09.250446 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe485b5-a6d0-43d7-85b1-e53bcafc3105 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:09.251418 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 919/1859] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:09.255776 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98756b8a-0f24-4fd1-8d9e-869ef2df3648 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:09.302023 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98756b8a-0f24-4fd1-8d9e-869ef2df3648 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:09.308836 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0431f53-3a77-41bd-afda-84f343718ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:09.310107 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0431f53-3a77-41bd-afda-84f343718ba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:09.310409 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0431f53-3a77-41bd-afda-84f343718ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:09.310925 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0431f53-3a77-41bd-afda-84f343718ba7 admin admin] PATH_INFO: `/v3/projects/4dc8f6e3d66841ceb5f182caec8abc6f/users/4cc7d488b2f1443c8d598f4c725d4e28/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:09.333357 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-ebe485b5-a6d0-43d7-85b1-e53bcafc3105 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7e2c2ceff1244de811278aec7480d58', 'request_id': 'req-ebe485b5-a6d0-43d7-85b1-e53bcafc3105'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:09.336691 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0431f53-3a77-41bd-afda-84f343718ba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dc8f6e3d66841ceb5f182caec8abc6f, user_id=4cc7d488b2f1443c8d598f4c725d4e28, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:09.340861 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0431f53-3a77-41bd-afda-84f343718ba7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:09.343456 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-ebe485b5-a6d0-43d7-85b1-e53bcafc3105 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7e2c2ceff1244de811278aec7480d58', 'request_id': 'req-ebe485b5-a6d0-43d7-85b1-e53bcafc3105'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:09.353495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-ebe485b5-a6d0-43d7-85b1-e53bcafc3105 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7e2c2ceff1244de811278aec7480d58', 'request_id': 'req-ebe485b5-a6d0-43d7-85b1-e53bcafc3105'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:09.367519 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 920/1860] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:09 2022] PUT /identity/v3/projects/4dc8f6e3d66841ceb5f182caec8abc6f/users/4cc7d488b2f1443c8d598f4c725d4e28/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:09.371992 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0431f53-3a77-41bd-afda-84f343718ba7 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:09.377422 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-ebe485b5-a6d0-43d7-85b1-e53bcafc3105 admin admin] The token cache is being invalidate because project a7e2c2ceff1244de811278aec7480d58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:09.377992 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-ebe485b5-a6d0-43d7-85b1-e53bcafc3105 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:09.379549 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-ebe485b5-a6d0-43d7-85b1-e53bcafc3105 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:09.383332 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 941/1861] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:09 2022] DELETE /identity/v3/projects/a7e2c2ceff1244de811278aec7480d58 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:09.386962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe485b5-a6d0-43d7-85b1-e53bcafc3105 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:09.389367 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ebe485b5-a6d0-43d7-85b1-e53bcafc3105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:09.430550 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:09.476782 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0431f53-3a77-41bd-afda-84f343718ba7 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:09.485845 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a75cd-e724-4ee5-9ae9-6b572bfd6852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:09.486595 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a75cd-e724-4ee5-9ae9-6b572bfd6852 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:09.486934 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a75cd-e724-4ee5-9ae9-6b572bfd6852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:09.487204 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a75cd-e724-4ee5-9ae9-6b572bfd6852 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:09.488564 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a75cd-e724-4ee5-9ae9-6b572bfd6852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:09.489568 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a75cd-e724-4ee5-9ae9-6b572bfd6852 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:09.491687 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe485b5-a6d0-43d7-85b1-e53bcafc3105 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:09.497665 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33dcb5-0be1-4d3f-8265-c23414cb89fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:09.498554 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33dcb5-0be1-4d3f-8265-c23414cb89fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:09.498840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33dcb5-0be1-4d3f-8265-c23414cb89fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:09.499600 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33dcb5-0be1-4d3f-8265-c23414cb89fb admin admin] PATH_INFO: `/v3/users/d06dbf82460c45d99e66853bf95cd0ce` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:09.500608 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 921/1862] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:57:09.500753 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33dcb5-0be1-4d3f-8265-c23414cb89fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d06dbf82460c45d99e66853bf95cd0ce)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:09.502810 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33dcb5-0be1-4d3f-8265-c23414cb89fb admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:09.506195 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a75cd-e724-4ee5-9ae9-6b572bfd6852 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:09.508885 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5d3a75cd-e724-4ee5-9ae9-6b572bfd6852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:09.523892 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a75cd-e724-4ee5-9ae9-6b572bfd6852 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:09.532289 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e18c7c-1a6c-4f71-b084-19042734e77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:09.533347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e18c7c-1a6c-4f71-b084-19042734e77c admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:09.533938 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e18c7c-1a6c-4f71-b084-19042734e77c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:09.534257 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e18c7c-1a6c-4f71-b084-19042734e77c admin admin] PATH_INFO: `/v3/projects/4dc8f6e3d66841ceb5f182caec8abc6f/users/4cc7d488b2f1443c8d598f4c725d4e28/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:09.537800 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e18c7c-1a6c-4f71-b084-19042734e77c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dc8f6e3d66841ceb5f182caec8abc6f, user_id=4cc7d488b2f1443c8d598f4c725d4e28, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:09.540854 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e18c7c-1a6c-4f71-b084-19042734e77c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:09.552467 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 922/1863] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:09 2022] PUT /identity/v3/projects/4dc8f6e3d66841ceb5f182caec8abc6f/users/4cc7d488b2f1443c8d598f4c725d4e28/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:09.557612 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fa33dcb5-0be1-4d3f-8265-c23414cb89fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd06dbf82460c45d99e66853bf95cd0ce'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:09.564524 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c069c3-f0ba-4ced-a348-7f7c0ccef89c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:09.564728 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c069c3-f0ba-4ced-a348-7f7c0ccef89c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:09.564994 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c069c3-f0ba-4ced-a348-7f7c0ccef89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:09.576797 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fa33dcb5-0be1-4d3f-8265-c23414cb89fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd06dbf82460c45d99e66853bf95cd0ce'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:09.577928 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fa33dcb5-0be1-4d3f-8265-c23414cb89fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd06dbf82460c45d99e66853bf95cd0ce'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:09.587694 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fa33dcb5-0be1-4d3f-8265-c23414cb89fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd06dbf82460c45d99e66853bf95cd0ce'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:09.596582 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-fa33dcb5-0be1-4d3f-8265-c23414cb89fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd06dbf82460c45d99e66853bf95cd0ce'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:09.597842 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-40c069c3-f0ba-4ced-a348-7f7c0ccef89c None None] MFA Rules not processed for user `4cc7d488b2f1443c8d598f4c725d4e28`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:09.599185 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-40c069c3-f0ba-4ced-a348-7f7c0ccef89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:09.603807 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 942/1864] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:09 2022] DELETE /identity/v3/users/d06dbf82460c45d99e66853bf95cd0ce => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:09.670965 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:09.699471 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 923/1865] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:09 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:09.711457 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33dcb5-0be1-4d3f-8265-c23414cb89fb admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:09.712988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-fa33dcb5-0be1-4d3f-8265-c23414cb89fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:09.786464 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33dcb5-0be1-4d3f-8265-c23414cb89fb admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:09.792293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c298f-3b02-4c66-bd42-a763c6bfe5ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:09.793174 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c298f-3b02-4c66-bd42-a763c6bfe5ea service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:09.793277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c298f-3b02-4c66-bd42-a763c6bfe5ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:09.793547 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c298f-3b02-4c66-bd42-a763c6bfe5ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:09.867306 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:09.880392 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c298f-3b02-4c66-bd42-a763c6bfe5ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:09.882748 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c298f-3b02-4c66-bd42-a763c6bfe5ea service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:09.900319 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 943/1866] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:09 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:09.985288 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c069c3-f0ba-4ced-a348-7f7c0ccef89c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:10.049271 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c069c3-f0ba-4ced-a348-7f7c0ccef89c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:10.053180 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d08e42-bc4c-4ce3-879e-47986fd595a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:10.053890 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d08e42-bc4c-4ce3-879e-47986fd595a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:10.054165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d08e42-bc4c-4ce3-879e-47986fd595a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:10.054437 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d08e42-bc4c-4ce3-879e-47986fd595a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:10.056392 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-32d08e42-bc4c-4ce3-879e-47986fd595a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:10.061854 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c298f-3b02-4c66-bd42-a763c6bfe5ea service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:10.064216 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-700c298f-3b02-4c66-bd42-a763c6bfe5ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:10.123079 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d08e42-bc4c-4ce3-879e-47986fd595a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:10.124600 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d08e42-bc4c-4ce3-879e-47986fd595a8 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:10.133610 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 924/1867] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:09 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:10.141058 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c298f-3b02-4c66-bd42-a763c6bfe5ea service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:10.146521 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4c5c9-f1f8-4e62-9739-683d0e6d4d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:10.147658 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4c5c9-f1f8-4e62-9739-683d0e6d4d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:10.148089 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4c5c9-f1f8-4e62-9739-683d0e6d4d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:10.148312 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4c5c9-f1f8-4e62-9739-683d0e6d4d1c admin admin] PATH_INFO: `/v3/projects/337bec7cbc26456cbd0b978d3cf5d438` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:10.149657 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f4c5c9-f1f8-4e62-9739-683d0e6d4d1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=337bec7cbc26456cbd0b978d3cf5d438)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:10.153313 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f4c5c9-f1f8-4e62-9739-683d0e6d4d1c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:10.202586 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-03f4c5c9-f1f8-4e62-9739-683d0e6d4d1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '337bec7cbc26456cbd0b978d3cf5d438', 'request_id': 'req-03f4c5c9-f1f8-4e62-9739-683d0e6d4d1c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:10.210226 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-03f4c5c9-f1f8-4e62-9739-683d0e6d4d1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '337bec7cbc26456cbd0b978d3cf5d438', 'request_id': 'req-03f4c5c9-f1f8-4e62-9739-683d0e6d4d1c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:10.218377 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-03f4c5c9-f1f8-4e62-9739-683d0e6d4d1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '337bec7cbc26456cbd0b978d3cf5d438', 'request_id': 'req-03f4c5c9-f1f8-4e62-9739-683d0e6d4d1c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:10.234532 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-03f4c5c9-f1f8-4e62-9739-683d0e6d4d1c admin admin] The token cache is being invalidate because project 337bec7cbc26456cbd0b978d3cf5d438 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:10.234837 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-03f4c5c9-f1f8-4e62-9739-683d0e6d4d1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:10.235734 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-03f4c5c9-f1f8-4e62-9739-683d0e6d4d1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:10.237492 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 944/1868] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:10 2022] DELETE /identity/v3/projects/337bec7cbc26456cbd0b978d3cf5d438 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:10.242687 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cf73f-8d15-4322-9dad-bea5953db391 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:10.242985 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cf73f-8d15-4322-9dad-bea5953db391 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:10.243340 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cf73f-8d15-4322-9dad-bea5953db391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:10.263266 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-909cf73f-8d15-4322-9dad-bea5953db391 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:10.264676 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-909cf73f-8d15-4322-9dad-bea5953db391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:10.371863 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 925/1869] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:10.380190 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eda84f-7d49-45e1-bf24-592f98e688f7 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:10.380551 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eda84f-7d49-45e1-bf24-592f98e688f7 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:10.380768 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eda84f-7d49-45e1-bf24-592f98e688f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:10.401118 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-47eda84f-7d49-45e1-bf24-592f98e688f7 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:10.402348 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-47eda84f-7d49-45e1-bf24-592f98e688f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:10.411827 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 945/1870] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:10.416885 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909cf73f-8d15-4322-9dad-bea5953db391 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:10.427506 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909cf73f-8d15-4322-9dad-bea5953db391 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:10.432737 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8c787-d721-46ee-ba4e-35ff119c0219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:10.433479 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8c787-d721-46ee-ba4e-35ff119c0219 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:10.433805 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8c787-d721-46ee-ba4e-35ff119c0219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:10.434076 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8c787-d721-46ee-ba4e-35ff119c0219 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:10.434814 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b8c787-d721-46ee-ba4e-35ff119c0219 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:57:10.435118 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b8c787-d721-46ee-ba4e-35ff119c0219 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:10.436982 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b8c787-d721-46ee-ba4e-35ff119c0219 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:10.455362 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 926/1871] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:57:10.460776 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eda84f-7d49-45e1-bf24-592f98e688f7 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:10.473833 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eda84f-7d49-45e1-bf24-592f98e688f7 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:10.479718 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8168ecb-8d60-42e4-96c8-915aa48cbc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:10.480486 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8168ecb-8d60-42e4-96c8-915aa48cbc25 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:10.480833 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8168ecb-8d60-42e4-96c8-915aa48cbc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:10.481176 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8168ecb-8d60-42e4-96c8-915aa48cbc25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:10.481945 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8168ecb-8d60-42e4-96c8-915aa48cbc25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:10.484280 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8168ecb-8d60-42e4-96c8-915aa48cbc25 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:10.531898 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 946/1872] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:10 2022] POST /identity/v3/projects => generated 387 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:10.533227 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8c787-d721-46ee-ba4e-35ff119c0219 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:10.550065 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8c787-d721-46ee-ba4e-35ff119c0219 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:10.608701 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:10.650562 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec380d-cd2e-42b5-9cb6-e782dfdacdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:10.651145 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec380d-cd2e-42b5-9cb6-e782dfdacdc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:10.651424 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec380d-cd2e-42b5-9cb6-e782dfdacdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:10.651701 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec380d-cd2e-42b5-9cb6-e782dfdacdc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:10.652541 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec380d-cd2e-42b5-9cb6-e782dfdacdc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:10.654495 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec380d-cd2e-42b5-9cb6-e782dfdacdc6 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:10.680373 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 927/1873] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:10 2022] POST /identity/v3/users => generated 294 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:57:10.686189 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8168ecb-8d60-42e4-96c8-915aa48cbc25 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:10.697330 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8168ecb-8d60-42e4-96c8-915aa48cbc25 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:10.702678 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea82bba-2204-4902-985e-cd712c86c6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:10.703357 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea82bba-2204-4902-985e-cd712c86c6aa admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:10.703637 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea82bba-2204-4902-985e-cd712c86c6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:10.704111 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea82bba-2204-4902-985e-cd712c86c6aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:10.704846 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea82bba-2204-4902-985e-cd712c86c6aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:10.706799 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea82bba-2204-4902-985e-cd712c86c6aa admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:10.722289 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 947/1874] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:10.723026 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec380d-cd2e-42b5-9cb6-e782dfdacdc6 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:10.734009 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec380d-cd2e-42b5-9cb6-e782dfdacdc6 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:10.739717 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29de89b-6c4a-4f4c-88dd-a7196bac2f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:10.740158 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29de89b-6c4a-4f4c-88dd-a7196bac2f48 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:10.740455 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29de89b-6c4a-4f4c-88dd-a7196bac2f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:10.740719 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29de89b-6c4a-4f4c-88dd-a7196bac2f48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:10.741449 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29de89b-6c4a-4f4c-88dd-a7196bac2f48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:10.743125 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29de89b-6c4a-4f4c-88dd-a7196bac2f48 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:10.759307 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 928/1875] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:57:10.760452 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea82bba-2204-4902-985e-cd712c86c6aa admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:10.771577 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea82bba-2204-4902-985e-cd712c86c6aa admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:10.776732 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe8d53-85b5-441f-9cbb-c1bf08de0aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:10.777794 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe8d53-85b5-441f-9cbb-c1bf08de0aac admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:10.778099 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe8d53-85b5-441f-9cbb-c1bf08de0aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:10.778515 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe8d53-85b5-441f-9cbb-c1bf08de0aac admin admin] PATH_INFO: `/v3/projects/307f404e99144f4cada7959a2b43e028/users/99b3b1f27cc24c50ae1463317cebdf24/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:10.795849 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe8d53-85b5-441f-9cbb-c1bf08de0aac admin admin] RBAC: Authorizing `identity:create_grant(project_id=307f404e99144f4cada7959a2b43e028, user_id=99b3b1f27cc24c50ae1463317cebdf24, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:10.800270 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe8d53-85b5-441f-9cbb-c1bf08de0aac admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:10.816238 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 948/1876] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:10 2022] PUT /identity/v3/projects/307f404e99144f4cada7959a2b43e028/users/99b3b1f27cc24c50ae1463317cebdf24/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:10.828108 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bb13e-c5cd-4049-af7f-463f7e7b440f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:10.828531 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bb13e-c5cd-4049-af7f-463f7e7b440f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:10.828879 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bb13e-c5cd-4049-af7f-463f7e7b440f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:10.858475 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-789bb13e-c5cd-4049-af7f-463f7e7b440f None None] MFA Rules not processed for user `99b3b1f27cc24c50ae1463317cebdf24`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:10.859947 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-789bb13e-c5cd-4049-af7f-463f7e7b440f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:10.940554 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 929/1877] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:10.948916 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe8d53-85b5-441f-9cbb-c1bf08de0aac admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:10.974747 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:11.014015 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe8d53-85b5-441f-9cbb-c1bf08de0aac admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:11.019168 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970377bd-98fd-4bcc-810e-9a071298aeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:11.019851 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970377bd-98fd-4bcc-810e-9a071298aeec admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:11.020177 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970377bd-98fd-4bcc-810e-9a071298aeec admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:11.020458 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970377bd-98fd-4bcc-810e-9a071298aeec admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:11.021168 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970377bd-98fd-4bcc-810e-9a071298aeec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:11.023173 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970377bd-98fd-4bcc-810e-9a071298aeec admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:11.041573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bb13e-c5cd-4049-af7f-463f7e7b440f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:11.043171 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-789bb13e-c5cd-4049-af7f-463f7e7b440f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:11.050831 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 949/1878] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:10 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:57:11.054585 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970377bd-98fd-4bcc-810e-9a071298aeec admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:11.059192 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bb13e-c5cd-4049-af7f-463f7e7b440f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:11.122864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc312b0-e951-4acf-9602-2ac4937cf962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:11.124201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc312b0-e951-4acf-9602-2ac4937cf962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:11.125190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc312b0-e951-4acf-9602-2ac4937cf962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:11.125503 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc312b0-e951-4acf-9602-2ac4937cf962 admin admin] PATH_INFO: `/v3/users/7c01522e3a5c4e779ea2bc16aeeb04cd` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:11.126315 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970377bd-98fd-4bcc-810e-9a071298aeec admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:11.126904 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc312b0-e951-4acf-9602-2ac4937cf962 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c01522e3a5c4e779ea2bc16aeeb04cd)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:11.129307 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc312b0-e951-4acf-9602-2ac4937cf962 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:11.131163 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e2743-16f6-4e2a-bdb1-6964fccdc2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:11.131840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e2743-16f6-4e2a-bdb1-6964fccdc2d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:11.132154 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e2743-16f6-4e2a-bdb1-6964fccdc2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:11.132436 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e2743-16f6-4e2a-bdb1-6964fccdc2d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:11.133146 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367e2743-16f6-4e2a-bdb1-6964fccdc2d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:11.135085 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367e2743-16f6-4e2a-bdb1-6964fccdc2d8 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:11.160954 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 950/1879] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:11 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:57:11.164892 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e2743-16f6-4e2a-bdb1-6964fccdc2d8 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:11.176203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e2743-16f6-4e2a-bdb1-6964fccdc2d8 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:11.181848 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16d55a-d60a-49c6-88d2-6342c4064a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:11.182515 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16d55a-d60a-49c6-88d2-6342c4064a5d admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:11.182794 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16d55a-d60a-49c6-88d2-6342c4064a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:11.183065 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16d55a-d60a-49c6-88d2-6342c4064a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:11.183786 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb16d55a-d60a-49c6-88d2-6342c4064a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:11.185653 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb16d55a-d60a-49c6-88d2-6342c4064a5d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:11.190943 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:11.194585 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4cc312b0-e951-4acf-9602-2ac4937cf962 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c01522e3a5c4e779ea2bc16aeeb04cd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:11.198716 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 951/1880] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:11.204275 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16d55a-d60a-49c6-88d2-6342c4064a5d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:11.205750 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4cc312b0-e951-4acf-9602-2ac4937cf962 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c01522e3a5c4e779ea2bc16aeeb04cd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:11.214566 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4cc312b0-e951-4acf-9602-2ac4937cf962 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c01522e3a5c4e779ea2bc16aeeb04cd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:11.217293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16d55a-d60a-49c6-88d2-6342c4064a5d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:11.222807 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38bec8-8d90-46f9-b783-a9ae9f0e05fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:11.223836 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38bec8-8d90-46f9-b783-a9ae9f0e05fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:11.224336 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38bec8-8d90-46f9-b783-a9ae9f0e05fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:11.224443 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38bec8-8d90-46f9-b783-a9ae9f0e05fb admin admin] PATH_INFO: `/v3/projects/cffeccd7ff754d98b845167dfbf42245/users/36f15ceebb34465499291e751219ef76/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:11.228806 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4cc312b0-e951-4acf-9602-2ac4937cf962 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c01522e3a5c4e779ea2bc16aeeb04cd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:11.229525 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4cc312b0-e951-4acf-9602-2ac4937cf962 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c01522e3a5c4e779ea2bc16aeeb04cd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:11.235976 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 930/1881] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:11 2022] DELETE /identity/v3/users/7c01522e3a5c4e779ea2bc16aeeb04cd => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:11.241234 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbd8b7-9af5-4c40-8c2e-1e545f36692d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:11.241522 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbd8b7-9af5-4c40-8c2e-1e545f36692d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:11.241801 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbd8b7-9af5-4c40-8c2e-1e545f36692d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:11.246956 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b38bec8-8d90-46f9-b783-a9ae9f0e05fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cffeccd7ff754d98b845167dfbf42245, user_id=36f15ceebb34465499291e751219ef76, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:11.249726 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b38bec8-8d90-46f9-b783-a9ae9f0e05fb admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:11.259652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-84cbd8b7-9af5-4c40-8c2e-1e545f36692d None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:11.261013 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-84cbd8b7-9af5-4c40-8c2e-1e545f36692d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:11.264429 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 952/1882] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:11 2022] PUT /identity/v3/projects/cffeccd7ff754d98b845167dfbf42245/users/36f15ceebb34465499291e751219ef76/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:11.268388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38bec8-8d90-46f9-b783-a9ae9f0e05fb admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:11.270024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4b38bec8-8d90-46f9-b783-a9ae9f0e05fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:11.331585 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 931/1883] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:11.341658 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbd8b7-9af5-4c40-8c2e-1e545f36692d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:11.343099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-84cbd8b7-9af5-4c40-8c2e-1e545f36692d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:11.345917 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38bec8-8d90-46f9-b783-a9ae9f0e05fb admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:11.350671 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6600e6-8470-4daf-870d-9949013c04f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:11.351407 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6600e6-8470-4daf-870d-9949013c04f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:11.351690 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6600e6-8470-4daf-870d-9949013c04f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:11.351969 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6600e6-8470-4daf-870d-9949013c04f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:11.352742 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6600e6-8470-4daf-870d-9949013c04f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:11.354356 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6600e6-8470-4daf-870d-9949013c04f5 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:11.357338 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:11.369237 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 953/1884] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:57:11.373487 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6600e6-8470-4daf-870d-9949013c04f5 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:11.385052 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6600e6-8470-4daf-870d-9949013c04f5 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:11.389858 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed0e7f-b8ac-43e1-a015-eadab47e79e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:11.390842 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed0e7f-b8ac-43e1-a015-eadab47e79e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:11.391135 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed0e7f-b8ac-43e1-a015-eadab47e79e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:11.391415 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed0e7f-b8ac-43e1-a015-eadab47e79e7 admin admin] PATH_INFO: `/v3/projects/cffeccd7ff754d98b845167dfbf42245/users/36f15ceebb34465499291e751219ef76/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:11.393482 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed0e7f-b8ac-43e1-a015-eadab47e79e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cffeccd7ff754d98b845167dfbf42245, user_id=36f15ceebb34465499291e751219ef76, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:11.396159 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed0e7f-b8ac-43e1-a015-eadab47e79e7 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:11.413795 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 954/1885] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:11 2022] PUT /identity/v3/projects/cffeccd7ff754d98b845167dfbf42245/users/36f15ceebb34465499291e751219ef76/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:11.417821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbd8b7-9af5-4c40-8c2e-1e545f36692d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:11.425182 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953e4bc-cfa6-4acb-a1bd-e25caa96a6af None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:11.425542 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953e4bc-cfa6-4acb-a1bd-e25caa96a6af None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:11.425824 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953e4bc-cfa6-4acb-a1bd-e25caa96a6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:11.456339 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-1953e4bc-cfa6-4acb-a1bd-e25caa96a6af None None] MFA Rules not processed for user `36f15ceebb34465499291e751219ef76`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:11.457809 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1953e4bc-cfa6-4acb-a1bd-e25caa96a6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:11.467619 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46e90b-9685-4d9a-9cf0-2fb13b2304ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:11.468359 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46e90b-9685-4d9a-9cf0-2fb13b2304ed service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:11.468642 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46e90b-9685-4d9a-9cf0-2fb13b2304ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:11.468911 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46e90b-9685-4d9a-9cf0-2fb13b2304ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:11.506482 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:11.548047 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 955/1886] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:57:11.548572 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46e90b-9685-4d9a-9cf0-2fb13b2304ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:11.550071 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46e90b-9685-4d9a-9cf0-2fb13b2304ed service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:11.565607 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 932/1887] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:57:11.570812 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953e4bc-cfa6-4acb-a1bd-e25caa96a6af None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:11.572971 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1953e4bc-cfa6-4acb-a1bd-e25caa96a6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:11.664201 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953e4bc-cfa6-4acb-a1bd-e25caa96a6af None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:11.670650 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ea801-3f06-4683-b82a-a3f15901d013 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:11.671912 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ea801-3f06-4683-b82a-a3f15901d013 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:11.672408 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ea801-3f06-4683-b82a-a3f15901d013 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:11.673383 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ea801-3f06-4683-b82a-a3f15901d013 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:11.689208 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ea801-3f06-4683-b82a-a3f15901d013 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:11.692128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ea801-3f06-4683-b82a-a3f15901d013 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:11.705084 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 956/1888] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:12.747188 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46e90b-9685-4d9a-9cf0-2fb13b2304ed service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:12.760039 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46e90b-9685-4d9a-9cf0-2fb13b2304ed service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:12.766668 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc0d77-3f53-4426-8dfc-6086f0e927b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:12.768142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc0d77-3f53-4426-8dfc-6086f0e927b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:12.768591 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc0d77-3f53-4426-8dfc-6086f0e927b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:12.768924 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc0d77-3f53-4426-8dfc-6086f0e927b0 admin admin] PATH_INFO: `/v3/users/99b3b1f27cc24c50ae1463317cebdf24` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:12.770494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc0d77-3f53-4426-8dfc-6086f0e927b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99b3b1f27cc24c50ae1463317cebdf24)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:12.772899 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc0d77-3f53-4426-8dfc-6086f0e927b0 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:12.836630 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6adc0d77-3f53-4426-8dfc-6086f0e927b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99b3b1f27cc24c50ae1463317cebdf24'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:12.850860 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6adc0d77-3f53-4426-8dfc-6086f0e927b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99b3b1f27cc24c50ae1463317cebdf24'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:12.864281 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6adc0d77-3f53-4426-8dfc-6086f0e927b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99b3b1f27cc24c50ae1463317cebdf24'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:12.882409 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6adc0d77-3f53-4426-8dfc-6086f0e927b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99b3b1f27cc24c50ae1463317cebdf24'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:12.883324 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6adc0d77-3f53-4426-8dfc-6086f0e927b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99b3b1f27cc24c50ae1463317cebdf24'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:12.896118 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 933/1889] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:12 2022] DELETE /identity/v3/users/99b3b1f27cc24c50ae1463317cebdf24 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:12.899020 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639e3e8-b6a0-407f-abaf-fbf52de3ddb4 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:12.899904 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639e3e8-b6a0-407f-abaf-fbf52de3ddb4 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:12.900245 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639e3e8-b6a0-407f-abaf-fbf52de3ddb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:12.916159 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc0d77-3f53-4426-8dfc-6086f0e927b0 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:12.919653 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6adc0d77-3f53-4426-8dfc-6086f0e927b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:12.929887 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-9639e3e8-b6a0-407f-abaf-fbf52de3ddb4 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:12.931350 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9639e3e8-b6a0-407f-abaf-fbf52de3ddb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:12.994021 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc0d77-3f53-4426-8dfc-6086f0e927b0 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:12.998827 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ada83-9531-46c3-819f-9de2b7878e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:12.999973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ada83-9531-46c3-819f-9de2b7878e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:13.000349 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ada83-9531-46c3-819f-9de2b7878e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:13.000832 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ada83-9531-46c3-819f-9de2b7878e2e admin admin] PATH_INFO: `/v3/projects/a069b7e822d3418885face6224f1ad32` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:13.002392 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ada83-9531-46c3-819f-9de2b7878e2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a069b7e822d3418885face6224f1ad32)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:13.004144 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ada83-9531-46c3-819f-9de2b7878e2e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:13.013250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 957/1890] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:13.023117 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639e3e8-b6a0-407f-abaf-fbf52de3ddb4 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:13.026613 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9639e3e8-b6a0-407f-abaf-fbf52de3ddb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:13.043231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:13.062310 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:13.073379 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ea4ada83-9531-46c3-819f-9de2b7878e2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a069b7e822d3418885face6224f1ad32', 'request_id': 'req-ea4ada83-9531-46c3-819f-9de2b7878e2e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:13.083515 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ea4ada83-9531-46c3-819f-9de2b7878e2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a069b7e822d3418885face6224f1ad32', 'request_id': 'req-ea4ada83-9531-46c3-819f-9de2b7878e2e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:13.090969 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ea4ada83-9531-46c3-819f-9de2b7878e2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a069b7e822d3418885face6224f1ad32', 'request_id': 'req-ea4ada83-9531-46c3-819f-9de2b7878e2e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:13.098268 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639e3e8-b6a0-407f-abaf-fbf52de3ddb4 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:13.112584 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ea4ada83-9531-46c3-819f-9de2b7878e2e admin admin] The token cache is being invalidate because project a069b7e822d3418885face6224f1ad32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:13.113248 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ea4ada83-9531-46c3-819f-9de2b7878e2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:13.113967 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ea4ada83-9531-46c3-819f-9de2b7878e2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:13.115648 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 934/1891] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:12 2022] DELETE /identity/v3/projects/a069b7e822d3418885face6224f1ad32 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:13.120177 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ada83-9531-46c3-819f-9de2b7878e2e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:13.122271 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ea4ada83-9531-46c3-819f-9de2b7878e2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:13.157329 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f916af-0523-4e9c-8bb0-b2836608d221 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:13.158167 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f916af-0523-4e9c-8bb0-b2836608d221 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:13.158594 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f916af-0523-4e9c-8bb0-b2836608d221 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:13.158885 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f916af-0523-4e9c-8bb0-b2836608d221 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:13.160880 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-79f916af-0523-4e9c-8bb0-b2836608d221 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:13.214497 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ada83-9531-46c3-819f-9de2b7878e2e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:13.220734 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4cf849-1d7a-42d7-8c3c-292d6eebeda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:13.222477 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cf849-1d7a-42d7-8c3c-292d6eebeda8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:13.222883 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cf849-1d7a-42d7-8c3c-292d6eebeda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:13.223168 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cf849-1d7a-42d7-8c3c-292d6eebeda8 admin admin] PATH_INFO: `/v3/users/aad9f494db864338915cd28d9afae99c` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:13.224584 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4cf849-1d7a-42d7-8c3c-292d6eebeda8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aad9f494db864338915cd28d9afae99c)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:13.226647 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4cf849-1d7a-42d7-8c3c-292d6eebeda8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:13.234090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f916af-0523-4e9c-8bb0-b2836608d221 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:13.235531 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f916af-0523-4e9c-8bb0-b2836608d221 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:13.247323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 958/1892] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:57:13.282479 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6c4cf849-1d7a-42d7-8c3c-292d6eebeda8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aad9f494db864338915cd28d9afae99c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:13.290688 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6c4cf849-1d7a-42d7-8c3c-292d6eebeda8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aad9f494db864338915cd28d9afae99c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:13.299265 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6c4cf849-1d7a-42d7-8c3c-292d6eebeda8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aad9f494db864338915cd28d9afae99c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:13.320599 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6c4cf849-1d7a-42d7-8c3c-292d6eebeda8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aad9f494db864338915cd28d9afae99c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:13.321539 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6c4cf849-1d7a-42d7-8c3c-292d6eebeda8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aad9f494db864338915cd28d9afae99c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:13.332602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 935/1893] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:13 2022] DELETE /identity/v3/users/aad9f494db864338915cd28d9afae99c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:13.663803 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f916af-0523-4e9c-8bb0-b2836608d221 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:13.665317 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-79f916af-0523-4e9c-8bb0-b2836608d221 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:13.686100 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f916af-0523-4e9c-8bb0-b2836608d221 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:13.774932 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aaeae2-8376-4601-adb9-70be37161d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:13.776147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aaeae2-8376-4601-adb9-70be37161d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:13.776426 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aaeae2-8376-4601-adb9-70be37161d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:13.776703 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aaeae2-8376-4601-adb9-70be37161d1b admin admin] PATH_INFO: `/v3/projects/307f404e99144f4cada7959a2b43e028` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:13.778366 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aaeae2-8376-4601-adb9-70be37161d1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=307f404e99144f4cada7959a2b43e028)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:13.780452 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aaeae2-8376-4601-adb9-70be37161d1b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:13.849429 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:13.879449 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4cf849-1d7a-42d7-8c3c-292d6eebeda8 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:13.881877 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6c4cf849-1d7a-42d7-8c3c-292d6eebeda8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:13.902185 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-85aaeae2-8376-4601-adb9-70be37161d1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '307f404e99144f4cada7959a2b43e028', 'request_id': 'req-85aaeae2-8376-4601-adb9-70be37161d1b'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:13.908891 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4cf849-1d7a-42d7-8c3c-292d6eebeda8 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:13.910508 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-85aaeae2-8376-4601-adb9-70be37161d1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '307f404e99144f4cada7959a2b43e028', 'request_id': 'req-85aaeae2-8376-4601-adb9-70be37161d1b'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:13.919448 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-85aaeae2-8376-4601-adb9-70be37161d1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '307f404e99144f4cada7959a2b43e028', 'request_id': 'req-85aaeae2-8376-4601-adb9-70be37161d1b'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:13.960492 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-85aaeae2-8376-4601-adb9-70be37161d1b admin admin] The token cache is being invalidate because project 307f404e99144f4cada7959a2b43e028 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:13.960781 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-85aaeae2-8376-4601-adb9-70be37161d1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:13.961977 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-85aaeae2-8376-4601-adb9-70be37161d1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:13.964823 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 959/1894] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:13 2022] DELETE /identity/v3/projects/307f404e99144f4cada7959a2b43e028 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:13.968901 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aaeae2-8376-4601-adb9-70be37161d1b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:13.971589 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-85aaeae2-8376-4601-adb9-70be37161d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:14.009595 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:14.034864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbfc30-7295-43c9-b09e-9cc40024c176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:14.036010 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbfc30-7295-43c9-b09e-9cc40024c176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:14.036455 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbfc30-7295-43c9-b09e-9cc40024c176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:14.036741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbfc30-7295-43c9-b09e-9cc40024c176 admin admin] PATH_INFO: `/v3/projects/650e7b049bec4ee08a095a70e188ab01` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:14.038329 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dbfc30-7295-43c9-b09e-9cc40024c176 admin admin] RBAC: Authorizing `identity:delete_project(project_id=650e7b049bec4ee08a095a70e188ab01)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:14.041932 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dbfc30-7295-43c9-b09e-9cc40024c176 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:14.081614 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aaeae2-8376-4601-adb9-70be37161d1b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:14.087634 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d659d5c0-42fe-4c1d-bc91-81b4a8deb6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:14.088644 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659d5c0-42fe-4c1d-bc91-81b4a8deb6df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:14.088926 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659d5c0-42fe-4c1d-bc91-81b4a8deb6df admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:14.089212 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659d5c0-42fe-4c1d-bc91-81b4a8deb6df admin admin] PATH_INFO: `/v3/users/36f15ceebb34465499291e751219ef76` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:14.091401 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d659d5c0-42fe-4c1d-bc91-81b4a8deb6df admin admin] RBAC: Authorizing `identity:delete_user(user_id=36f15ceebb34465499291e751219ef76)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:14.100114 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d659d5c0-42fe-4c1d-bc91-81b4a8deb6df admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:14.132990 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-37dbfc30-7295-43c9-b09e-9cc40024c176 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '650e7b049bec4ee08a095a70e188ab01', 'request_id': 'req-37dbfc30-7295-43c9-b09e-9cc40024c176'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:14.148352 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-37dbfc30-7295-43c9-b09e-9cc40024c176 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '650e7b049bec4ee08a095a70e188ab01', 'request_id': 'req-37dbfc30-7295-43c9-b09e-9cc40024c176'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:14.165308 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-37dbfc30-7295-43c9-b09e-9cc40024c176 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '650e7b049bec4ee08a095a70e188ab01', 'request_id': 'req-37dbfc30-7295-43c9-b09e-9cc40024c176'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:14.187396 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-37dbfc30-7295-43c9-b09e-9cc40024c176 admin admin] The token cache is being invalidate because project 650e7b049bec4ee08a095a70e188ab01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:14.187771 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-37dbfc30-7295-43c9-b09e-9cc40024c176 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:14.188275 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d659d5c0-42fe-4c1d-bc91-81b4a8deb6df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36f15ceebb34465499291e751219ef76'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:14.188880 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-37dbfc30-7295-43c9-b09e-9cc40024c176 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:14.192907 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 936/1895] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:13 2022] DELETE /identity/v3/projects/650e7b049bec4ee08a095a70e188ab01 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:14.201523 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad58e8e-072b-409d-91bf-c40223495cc8 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:14.201816 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad58e8e-072b-409d-91bf-c40223495cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:14.202167 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad58e8e-072b-409d-91bf-c40223495cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:14.209548 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d659d5c0-42fe-4c1d-bc91-81b4a8deb6df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36f15ceebb34465499291e751219ef76'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:14.211282 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d659d5c0-42fe-4c1d-bc91-81b4a8deb6df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36f15ceebb34465499291e751219ef76'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:14.222385 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d659d5c0-42fe-4c1d-bc91-81b4a8deb6df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36f15ceebb34465499291e751219ef76'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:14.231342 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4ad58e8e-072b-409d-91bf-c40223495cc8 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:14.232153 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d659d5c0-42fe-4c1d-bc91-81b4a8deb6df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36f15ceebb34465499291e751219ef76'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:14.233165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4ad58e8e-072b-409d-91bf-c40223495cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:14.251121 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 960/1896] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:13 2022] DELETE /identity/v3/users/36f15ceebb34465499291e751219ef76 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:14.332174 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 937/1897] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:57:14.340246 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4c9f8-680c-482d-9292-71689d806dca None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:14.340565 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4c9f8-680c-482d-9292-71689d806dca None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:14.340819 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4c9f8-680c-482d-9292-71689d806dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:14.361242 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-ebd4c9f8-680c-482d-9292-71689d806dca None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:14.362571 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ebd4c9f8-680c-482d-9292-71689d806dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:14.582811 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:14.643956 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 961/1898] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:14.647052 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad58e8e-072b-409d-91bf-c40223495cc8 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:14.668500 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad58e8e-072b-409d-91bf-c40223495cc8 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:14.675940 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd4c9f8-680c-482d-9292-71689d806dca None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:14.678098 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be5b54-d91d-4348-8b17-fb42343e3fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:14.678519 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ebd4c9f8-680c-482d-9292-71689d806dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:14.680023 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be5b54-d91d-4348-8b17-fb42343e3fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:14.680604 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be5b54-d91d-4348-8b17-fb42343e3fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:14.681191 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be5b54-d91d-4348-8b17-fb42343e3fb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:14.683424 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be5b54-d91d-4348-8b17-fb42343e3fb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:57:14.684095 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be5b54-d91d-4348-8b17-fb42343e3fb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:14.688741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be5b54-d91d-4348-8b17-fb42343e3fb8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:14.726227 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 938/1899] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:57:14.726227 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be5b54-d91d-4348-8b17-fb42343e3fb8 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:14.740098 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd4c9f8-680c-482d-9292-71689d806dca None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:14.748496 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d926798-f76b-4dfa-8896-ef8dc4c527dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:14.752481 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d926798-f76b-4dfa-8896-ef8dc4c527dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:14.753259 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d926798-f76b-4dfa-8896-ef8dc4c527dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:14.754481 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d926798-f76b-4dfa-8896-ef8dc4c527dd admin admin] PATH_INFO: `/v3/projects/cffeccd7ff754d98b845167dfbf42245` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:14.757667 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d926798-f76b-4dfa-8896-ef8dc4c527dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=cffeccd7ff754d98b845167dfbf42245)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:14.767582 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d926798-f76b-4dfa-8896-ef8dc4c527dd admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:14.773825 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be5b54-d91d-4348-8b17-fb42343e3fb8 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:14.794650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ac2c2-5759-4c25-af39-9a70a7cad37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:14.798326 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ac2c2-5759-4c25-af39-9a70a7cad37b admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:14.798996 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ac2c2-5759-4c25-af39-9a70a7cad37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:14.800350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ac2c2-5759-4c25-af39-9a70a7cad37b admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:14.803373 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ac2c2-5759-4c25-af39-9a70a7cad37b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:14.805643 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ac2c2-5759-4c25-af39-9a70a7cad37b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:14.847271 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 939/1900] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:14 2022] POST /identity/v3/projects => generated 381 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:14.852916 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ac2c2-5759-4c25-af39-9a70a7cad37b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:14.881892 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5d926798-f76b-4dfa-8896-ef8dc4c527dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cffeccd7ff754d98b845167dfbf42245', 'request_id': 'req-5d926798-f76b-4dfa-8896-ef8dc4c527dd'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:14.896685 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5d926798-f76b-4dfa-8896-ef8dc4c527dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cffeccd7ff754d98b845167dfbf42245', 'request_id': 'req-5d926798-f76b-4dfa-8896-ef8dc4c527dd'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:14.913051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5d926798-f76b-4dfa-8896-ef8dc4c527dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cffeccd7ff754d98b845167dfbf42245', 'request_id': 'req-5d926798-f76b-4dfa-8896-ef8dc4c527dd'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:14.938322 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5d926798-f76b-4dfa-8896-ef8dc4c527dd admin admin] The token cache is being invalidate because project cffeccd7ff754d98b845167dfbf42245 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:14.938616 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5d926798-f76b-4dfa-8896-ef8dc4c527dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:14.939354 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5d926798-f76b-4dfa-8896-ef8dc4c527dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:14.945778 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 962/1901] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:14 2022] DELETE /identity/v3/projects/cffeccd7ff754d98b845167dfbf42245 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:14.952341 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b8763-37d2-4e6a-b4b9-985b77a3b356 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:14.954183 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:14.954703 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b8763-37d2-4e6a-b4b9-985b77a3b356 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:14.955721 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b8763-37d2-4e6a-b4b9-985b77a3b356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:14.989775 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ac2c2-5759-4c25-af39-9a70a7cad37b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:14.996964 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc4d99-3398-4a64-b23e-62bda11fc6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:14.998136 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc4d99-3398-4a64-b23e-62bda11fc6c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:14.998643 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc4d99-3398-4a64-b23e-62bda11fc6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:14.999550 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc4d99-3398-4a64-b23e-62bda11fc6c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:15.001093 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc4d99-3398-4a64-b23e-62bda11fc6c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:15.003398 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc4d99-3398-4a64-b23e-62bda11fc6c3 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:15.031548 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 940/1902] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:14 2022] POST /identity/v3/users => generated 291 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:57:15.033663 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-490b8763-37d2-4e6a-b4b9-985b77a3b356 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:15.037476 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-490b8763-37d2-4e6a-b4b9-985b77a3b356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:15.038718 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc4d99-3398-4a64-b23e-62bda11fc6c3 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:15.040873 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e5fc4d99-3398-4a64-b23e-62bda11fc6c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:15.051283 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 963/1903] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:57:15.058285 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc4d99-3398-4a64-b23e-62bda11fc6c3 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:15.060412 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d1ad3-00d5-450e-b28b-09cc3e05d3dd None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:15.061352 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d1ad3-00d5-450e-b28b-09cc3e05d3dd None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:15.061537 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d1ad3-00d5-450e-b28b-09cc3e05d3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:15.073826 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f75aa6-71d1-4525-9cbf-b00fd774a53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:15.075174 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f75aa6-71d1-4525-9cbf-b00fd774a53b admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:15.075657 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f75aa6-71d1-4525-9cbf-b00fd774a53b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:15.076136 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f75aa6-71d1-4525-9cbf-b00fd774a53b admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:15.077095 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f75aa6-71d1-4525-9cbf-b00fd774a53b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:15.083781 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f75aa6-71d1-4525-9cbf-b00fd774a53b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:15.093698 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-488d1ad3-00d5-450e-b28b-09cc3e05d3dd None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:15.095668 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-488d1ad3-00d5-450e-b28b-09cc3e05d3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:15.108578 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 941/1904] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:15.114850 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f75aa6-71d1-4525-9cbf-b00fd774a53b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:15.117910 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 964/1905] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:57:15.128964 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f75aa6-71d1-4525-9cbf-b00fd774a53b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:15.136973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e1d75-a791-4f60-a1d7-3e7afdef1870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:15.137666 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e1d75-a791-4f60-a1d7-3e7afdef1870 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:15.138147 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e1d75-a791-4f60-a1d7-3e7afdef1870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:15.138435 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e1d75-a791-4f60-a1d7-3e7afdef1870 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:15.138791 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d1ad3-00d5-450e-b28b-09cc3e05d3dd None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:15.139332 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e1d75-a791-4f60-a1d7-3e7afdef1870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:15.142561 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e1d75-a791-4f60-a1d7-3e7afdef1870 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:15.165876 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d1ad3-00d5-450e-b28b-09cc3e05d3dd None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:15.168789 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 942/1906] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:15.176895 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e1d75-a791-4f60-a1d7-3e7afdef1870 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:15.182650 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e7244-0f73-46c5-bec9-16595cc31d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:15.185308 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e7244-0f73-46c5-bec9-16595cc31d1b admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:15.185603 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e7244-0f73-46c5-bec9-16595cc31d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:15.187566 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e7244-0f73-46c5-bec9-16595cc31d1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:15.189051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e7244-0f73-46c5-bec9-16595cc31d1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:57:15.189364 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e7244-0f73-46c5-bec9-16595cc31d1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:15.192872 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e7244-0f73-46c5-bec9-16595cc31d1b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:15.211538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e1d75-a791-4f60-a1d7-3e7afdef1870 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:15.224281 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed144e-5832-4180-8e72-41605461a3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:15.225182 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed144e-5832-4180-8e72-41605461a3d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:15.225458 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed144e-5832-4180-8e72-41605461a3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:15.227977 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed144e-5832-4180-8e72-41605461a3d9 admin admin] PATH_INFO: `/v3/projects/8e0f80cc47464c2f88be55def5d9cf49/users/35bdf517819b418ead0a35553ad6249f/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:15.243322 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 965/1907] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:57:15.248365 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e7244-0f73-46c5-bec9-16595cc31d1b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:15.260771 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e7244-0f73-46c5-bec9-16595cc31d1b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:15.261542 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed144e-5832-4180-8e72-41605461a3d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e0f80cc47464c2f88be55def5d9cf49, user_id=35bdf517819b418ead0a35553ad6249f, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:15.273496 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed144e-5832-4180-8e72-41605461a3d9 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:15.273841 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e8cda-4ef6-4658-b746-30fba240e9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:15.273841 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e8cda-4ef6-4658-b746-30fba240e9bf admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:15.273841 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e8cda-4ef6-4658-b746-30fba240e9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:15.273841 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e8cda-4ef6-4658-b746-30fba240e9bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:15.274182 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e8cda-4ef6-4658-b746-30fba240e9bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:15.274182 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e8cda-4ef6-4658-b746-30fba240e9bf admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:15.289244 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 943/1908] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:15 2022] PUT /identity/v3/projects/8e0f80cc47464c2f88be55def5d9cf49/users/35bdf517819b418ead0a35553ad6249f/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:15.309292 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f699b2-95d4-40f7-9d7f-c2696e6320a4 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:15.309631 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f699b2-95d4-40f7-9d7f-c2696e6320a4 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:15.310073 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f699b2-95d4-40f7-9d7f-c2696e6320a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:15.329561 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 966/1909] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:15 2022] POST /identity/v3/projects => generated 385 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:15.330675 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e8cda-4ef6-4658-b746-30fba240e9bf admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:15.349990 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-34f699b2-95d4-40f7-9d7f-c2696e6320a4 None None] MFA Rules not processed for user `35bdf517819b418ead0a35553ad6249f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:15.351226 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-34f699b2-95d4-40f7-9d7f-c2696e6320a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:15.426924 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e8cda-4ef6-4658-b746-30fba240e9bf admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:15.427433 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 944/1910] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:57:15.432167 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f699b2-95d4-40f7-9d7f-c2696e6320a4 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:15.435617 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8872893-8c1a-4da9-8518-aeadfc9cd0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:15.437035 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8872893-8c1a-4da9-8518-aeadfc9cd0c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:15.437035 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8872893-8c1a-4da9-8518-aeadfc9cd0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:15.437035 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8872893-8c1a-4da9-8518-aeadfc9cd0c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:15.443697 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f699b2-95d4-40f7-9d7f-c2696e6320a4 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:15.444875 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8872893-8c1a-4da9-8518-aeadfc9cd0c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:15.447345 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8872893-8c1a-4da9-8518-aeadfc9cd0c0 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:15.449161 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea5f5db-9081-4c35-bf8c-68741ef3abc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:15.449928 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5f5db-9081-4c35-bf8c-68741ef3abc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:15.450306 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5f5db-9081-4c35-bf8c-68741ef3abc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:15.450933 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5f5db-9081-4c35-bf8c-68741ef3abc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:15.451734 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea5f5db-9081-4c35-bf8c-68741ef3abc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:15.454037 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea5f5db-9081-4c35-bf8c-68741ef3abc3 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:15.465740 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:15.487407 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 967/1911] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:15 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:15.488595 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8872893-8c1a-4da9-8518-aeadfc9cd0c0 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:15.493847 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 945/1912] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:15 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:15.495014 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea5f5db-9081-4c35-bf8c-68741ef3abc3 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:15.500247 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8872893-8c1a-4da9-8518-aeadfc9cd0c0 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:15.582635 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38742a4c-67b6-41cc-9fc3-7784218ad3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:15.582997 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:15.583401 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38742a4c-67b6-41cc-9fc3-7784218ad3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:15.583692 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38742a4c-67b6-41cc-9fc3-7784218ad3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:15.584013 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38742a4c-67b6-41cc-9fc3-7784218ad3c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:15.584743 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38742a4c-67b6-41cc-9fc3-7784218ad3c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:15.586458 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38742a4c-67b6-41cc-9fc3-7784218ad3c3 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:15.588461 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea5f5db-9081-4c35-bf8c-68741ef3abc3 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:15.594948 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da355fe-819d-46de-a5f4-2a4f03b70746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:15.595698 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da355fe-819d-46de-a5f4-2a4f03b70746 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:15.596015 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da355fe-819d-46de-a5f4-2a4f03b70746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:15.596294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da355fe-819d-46de-a5f4-2a4f03b70746 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:15.596987 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da355fe-819d-46de-a5f4-2a4f03b70746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:15.597927 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 968/1913] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:15.599024 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da355fe-819d-46de-a5f4-2a4f03b70746 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:15.601822 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38742a4c-67b6-41cc-9fc3-7784218ad3c3 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:15.612560 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38742a4c-67b6-41cc-9fc3-7784218ad3c3 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:15.618454 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcf785-085b-46ba-89bb-8792dc0882ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:15.619257 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcf785-085b-46ba-89bb-8792dc0882ac admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:15.619556 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcf785-085b-46ba-89bb-8792dc0882ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:15.619995 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcf785-085b-46ba-89bb-8792dc0882ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:15.620770 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dcf785-085b-46ba-89bb-8792dc0882ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:15.621395 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 946/1914] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:15 2022] POST /identity/v3/users => generated 297 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:15.622613 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dcf785-085b-46ba-89bb-8792dc0882ac admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:15.625255 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da355fe-819d-46de-a5f4-2a4f03b70746 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:15.634469 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 969/1915] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:57:15.634999 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da355fe-819d-46de-a5f4-2a4f03b70746 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:15.638772 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcf785-085b-46ba-89bb-8792dc0882ac admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:15.639770 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df1cfa-1714-4da2-a96f-d687814a6394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:15.640544 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df1cfa-1714-4da2-a96f-d687814a6394 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:15.640829 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df1cfa-1714-4da2-a96f-d687814a6394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:15.641110 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df1cfa-1714-4da2-a96f-d687814a6394 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:15.641835 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df1cfa-1714-4da2-a96f-d687814a6394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:15.643448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df1cfa-1714-4da2-a96f-d687814a6394 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:15.648961 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcf785-085b-46ba-89bb-8792dc0882ac admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:15.653883 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822bf24-4484-426c-b37c-4ac73f1bb5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:15.654412 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 947/1916] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:57:15.655303 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822bf24-4484-426c-b37c-4ac73f1bb5de admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:15.655693 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822bf24-4484-426c-b37c-4ac73f1bb5de admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:15.656011 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822bf24-4484-426c-b37c-4ac73f1bb5de admin admin] PATH_INFO: `/v3/projects/26f9e2a3a6b845bea75eea27f1015e60/users/31c9b3c964f34aafb2ff237ae40fad83/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:15.658531 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df1cfa-1714-4da2-a96f-d687814a6394 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:15.669238 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df1cfa-1714-4da2-a96f-d687814a6394 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:15.673153 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5822bf24-4484-426c-b37c-4ac73f1bb5de admin admin] RBAC: Authorizing `identity:create_grant(project_id=26f9e2a3a6b845bea75eea27f1015e60, user_id=31c9b3c964f34aafb2ff237ae40fad83, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:15.674832 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6f711-84fe-4201-86e1-3ca01b610196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:15.675718 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6f711-84fe-4201-86e1-3ca01b610196 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:15.676085 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6f711-84fe-4201-86e1-3ca01b610196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:15.676367 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6f711-84fe-4201-86e1-3ca01b610196 admin admin] PATH_INFO: `/v3/projects/6a060528d94040b196fd505dfa588ded/users/758a107bb6a4431cbbd139a5e5e03f2f/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:15.676468 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5822bf24-4484-426c-b37c-4ac73f1bb5de admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:15.691983 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 970/1917] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:15 2022] PUT /identity/v3/projects/26f9e2a3a6b845bea75eea27f1015e60/users/31c9b3c964f34aafb2ff237ae40fad83/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:15.692595 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b6f711-84fe-4201-86e1-3ca01b610196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a060528d94040b196fd505dfa588ded, user_id=758a107bb6a4431cbbd139a5e5e03f2f, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:15.695314 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b6f711-84fe-4201-86e1-3ca01b610196 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:15.704038 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3a9ec-3805-486a-9011-e145d9845354 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:15.704330 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3a9ec-3805-486a-9011-e145d9845354 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:15.704609 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3a9ec-3805-486a-9011-e145d9845354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:15.709639 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 948/1918] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:15 2022] PUT /identity/v3/projects/6a060528d94040b196fd505dfa588ded/users/758a107bb6a4431cbbd139a5e5e03f2f/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:15.713558 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6f711-84fe-4201-86e1-3ca01b610196 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:15.733312 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-85c3a9ec-3805-486a-9011-e145d9845354 None None] MFA Rules not processed for user `31c9b3c964f34aafb2ff237ae40fad83`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:15.734603 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-85c3a9ec-3805-486a-9011-e145d9845354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:15.781632 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6f711-84fe-4201-86e1-3ca01b610196 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:15.786570 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa0abd-a5c3-4c21-9b75-744ba473f5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:15.787596 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa0abd-a5c3-4c21-9b75-744ba473f5d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:15.787899 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa0abd-a5c3-4c21-9b75-744ba473f5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:15.788186 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa0abd-a5c3-4c21-9b75-744ba473f5d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:15.788913 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aa0abd-a5c3-4c21-9b75-744ba473f5d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:15.790811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aa0abd-a5c3-4c21-9b75-744ba473f5d7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:15.799786 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 971/1919] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:57:15.801902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 949/1920] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:57:15.805710 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3a9ec-3805-486a-9011-e145d9845354 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:15.811094 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa0abd-a5c3-4c21-9b75-744ba473f5d7 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:15.813844 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-44aa0abd-a5c3-4c21-9b75-744ba473f5d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:15.816725 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3a9ec-3805-486a-9011-e145d9845354 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:15.821316 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd968303-59e9-4844-b2e8-3183b324b0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:15.822200 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd968303-59e9-4844-b2e8-3183b324b0c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:15.822483 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd968303-59e9-4844-b2e8-3183b324b0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:15.822757 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd968303-59e9-4844-b2e8-3183b324b0c3 admin admin] PATH_INFO: `/v3/projects/6a060528d94040b196fd505dfa588ded/users/758a107bb6a4431cbbd139a5e5e03f2f/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:15.824853 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd968303-59e9-4844-b2e8-3183b324b0c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a060528d94040b196fd505dfa588ded, user_id=758a107bb6a4431cbbd139a5e5e03f2f, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:15.827486 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd968303-59e9-4844-b2e8-3183b324b0c3 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:15.837939 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 972/1921] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:15 2022] PUT /identity/v3/projects/6a060528d94040b196fd505dfa588ded/users/758a107bb6a4431cbbd139a5e5e03f2f/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:15.847961 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7abe6-dca9-476d-82fb-61175b41905b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:15.848251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7abe6-dca9-476d-82fb-61175b41905b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:15.848528 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7abe6-dca9-476d-82fb-61175b41905b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:15.873409 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa0abd-a5c3-4c21-9b75-744ba473f5d7 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:15.877147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-9da7abe6-dca9-476d-82fb-61175b41905b None None] MFA Rules not processed for user `758a107bb6a4431cbbd139a5e5e03f2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:15.878351 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9da7abe6-dca9-476d-82fb-61175b41905b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:15.896580 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:15.923732 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad37aa-aecf-42fe-ae4b-c655e6bca9e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:15.924427 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad37aa-aecf-42fe-ae4b-c655e6bca9e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:15.924712 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad37aa-aecf-42fe-ae4b-c655e6bca9e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:15.924992 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad37aa-aecf-42fe-ae4b-c655e6bca9e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:15.939142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:15.950916 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 973/1922] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:57:15.985403 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad37aa-aecf-42fe-ae4b-c655e6bca9e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:15.987036 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad37aa-aecf-42fe-ae4b-c655e6bca9e5 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:15.997180 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 950/1923] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:15.997430 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7abe6-dca9-476d-82fb-61175b41905b None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:15.998973 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9da7abe6-dca9-476d-82fb-61175b41905b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:16.011413 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7abe6-dca9-476d-82fb-61175b41905b None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:16.015287 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad96ce7-afb1-4de3-b1c1-f38eb662fc54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:16.016013 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad96ce7-afb1-4de3-b1c1-f38eb662fc54 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:16.016410 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad96ce7-afb1-4de3-b1c1-f38eb662fc54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:16.016695 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad96ce7-afb1-4de3-b1c1-f38eb662fc54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:16.026074 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad96ce7-afb1-4de3-b1c1-f38eb662fc54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:16.027610 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad96ce7-afb1-4de3-b1c1-f38eb662fc54 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:16.037819 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 974/1924] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:57:16.175012 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad37aa-aecf-42fe-ae4b-c655e6bca9e5 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:16.184188 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad37aa-aecf-42fe-ae4b-c655e6bca9e5 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:16.188476 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031fed4-2f43-461a-8a92-8d52a154e99f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:16.189196 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031fed4-2f43-461a-8a92-8d52a154e99f service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:16.189550 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031fed4-2f43-461a-8a92-8d52a154e99f service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:16.189895 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031fed4-2f43-461a-8a92-8d52a154e99f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:16.261955 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031fed4-2f43-461a-8a92-8d52a154e99f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:16.262875 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad96ce7-afb1-4de3-b1c1-f38eb662fc54 service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:16.263931 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031fed4-2f43-461a-8a92-8d52a154e99f service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:16.265036 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-fad96ce7-afb1-4de3-b1c1-f38eb662fc54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:16.276318 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 951/1925] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:16.486603 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad96ce7-afb1-4de3-b1c1-f38eb662fc54 service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:16.503077 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354cbc2-dc7e-4bd4-bb6f-3fab65e9ea66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:16.504071 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354cbc2-dc7e-4bd4-bb6f-3fab65e9ea66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:16.504359 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354cbc2-dc7e-4bd4-bb6f-3fab65e9ea66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:16.504638 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354cbc2-dc7e-4bd4-bb6f-3fab65e9ea66 admin admin] PATH_INFO: `/v3/users/5b59e84b1b7c48ce9e0c05a93ca431ce` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:16.507142 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5354cbc2-dc7e-4bd4-bb6f-3fab65e9ea66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b59e84b1b7c48ce9e0c05a93ca431ce)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:16.512117 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5354cbc2-dc7e-4bd4-bb6f-3fab65e9ea66 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:16.614635 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5354cbc2-dc7e-4bd4-bb6f-3fab65e9ea66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b59e84b1b7c48ce9e0c05a93ca431ce'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:16.632534 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5354cbc2-dc7e-4bd4-bb6f-3fab65e9ea66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b59e84b1b7c48ce9e0c05a93ca431ce'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:16.633693 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5354cbc2-dc7e-4bd4-bb6f-3fab65e9ea66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b59e84b1b7c48ce9e0c05a93ca431ce'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:16.645800 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5354cbc2-dc7e-4bd4-bb6f-3fab65e9ea66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b59e84b1b7c48ce9e0c05a93ca431ce'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:16.664683 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5354cbc2-dc7e-4bd4-bb6f-3fab65e9ea66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b59e84b1b7c48ce9e0c05a93ca431ce'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:16.673308 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 975/1926] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:16 2022] DELETE /identity/v3/users/5b59e84b1b7c48ce9e0c05a93ca431ce => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:16.678466 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bc455-dc82-4361-9b67-79a21597d99e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:16.678979 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bc455-dc82-4361-9b67-79a21597d99e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:16.679328 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bc455-dc82-4361-9b67-79a21597d99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:16.716452 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4a2bc455-dc82-4361-9b67-79a21597d99e None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:16.717899 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4a2bc455-dc82-4361-9b67-79a21597d99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:16.804037 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 952/1927] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:16.815393 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354cbc2-dc7e-4bd4-bb6f-3fab65e9ea66 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:16.817672 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5354cbc2-dc7e-4bd4-bb6f-3fab65e9ea66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:16.861219 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:16.872733 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c689988-dd38-40c2-9324-691d6da4856e None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:16.873062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c689988-dd38-40c2-9324-691d6da4856e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:16.873417 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c689988-dd38-40c2-9324-691d6da4856e None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:16.875166 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 953/1928] 10.222.0.85 () {54 vars in 921 bytes} [Thu Jun 16 14:57:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:57:16.939259 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354cbc2-dc7e-4bd4-bb6f-3fab65e9ea66 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:16.953751 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0b46a-05e1-4d41-b15b-9a9470efbdd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:16.955006 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0b46a-05e1-4d41-b15b-9a9470efbdd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:16.957109 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0b46a-05e1-4d41-b15b-9a9470efbdd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:16.957624 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0b46a-05e1-4d41-b15b-9a9470efbdd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:16.965061 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927363c-e372-44e5-9b9a-70daf77fba72 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:16.965432 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927363c-e372-44e5-9b9a-70daf77fba72 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:16.965726 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927363c-e372-44e5-9b9a-70daf77fba72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:16.980961 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0b46a-05e1-4d41-b15b-9a9470efbdd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:16.982631 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0b46a-05e1-4d41-b15b-9a9470efbdd1 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:17.014984 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d927363c-e372-44e5-9b9a-70daf77fba72 None None] MFA Rules not processed for user `c74e4d1bdaa64ed280cc5f4c8e79b842`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:17.018884 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 976/1929] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:17.021803 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d927363c-e372-44e5-9b9a-70daf77fba72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:17.110904 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:17.134311 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 954/1930] 10.222.0.85 () {58 vars in 1018 bytes} [Thu Jun 16 14:57:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:17.201066 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0b46a-05e1-4d41-b15b-9a9470efbdd1 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:17.202548 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f9e0b46a-05e1-4d41-b15b-9a9470efbdd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:17.219168 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0b46a-05e1-4d41-b15b-9a9470efbdd1 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:17.225216 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d267c-62de-494b-ac9a-f9fea4097ab7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:17.225884 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d267c-62de-494b-ac9a-f9fea4097ab7 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:17.226166 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d267c-62de-494b-ac9a-f9fea4097ab7 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:17.226502 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d267c-62de-494b-ac9a-f9fea4097ab7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:17.239816 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d267c-62de-494b-ac9a-f9fea4097ab7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:17.240623 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d267c-62de-494b-ac9a-f9fea4097ab7 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:17.258884 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 977/1931] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:17.367572 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927363c-e372-44e5-9b9a-70daf77fba72 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:17.370718 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d927363c-e372-44e5-9b9a-70daf77fba72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:17.408204 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927363c-e372-44e5-9b9a-70daf77fba72 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:17.434862 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b047b576-9e8e-47da-ba18-b93bffd55460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:17.453072 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047b576-9e8e-47da-ba18-b93bffd55460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:17.453364 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047b576-9e8e-47da-ba18-b93bffd55460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:17.453683 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047b576-9e8e-47da-ba18-b93bffd55460 admin admin] PATH_INFO: `/v3/projects/34da0c2cacac404fa7f398ae71ef6ab2` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:17.458355 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b047b576-9e8e-47da-ba18-b93bffd55460 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34da0c2cacac404fa7f398ae71ef6ab2)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:17.469270 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b047b576-9e8e-47da-ba18-b93bffd55460 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:17.573458 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b047b576-9e8e-47da-ba18-b93bffd55460 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34da0c2cacac404fa7f398ae71ef6ab2', 'request_id': 'req-b047b576-9e8e-47da-ba18-b93bffd55460'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:17.593390 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b047b576-9e8e-47da-ba18-b93bffd55460 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34da0c2cacac404fa7f398ae71ef6ab2', 'request_id': 'req-b047b576-9e8e-47da-ba18-b93bffd55460'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:17.607864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b047b576-9e8e-47da-ba18-b93bffd55460 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34da0c2cacac404fa7f398ae71ef6ab2', 'request_id': 'req-b047b576-9e8e-47da-ba18-b93bffd55460'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:17.628208 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b047b576-9e8e-47da-ba18-b93bffd55460 admin admin] The token cache is being invalidate because project 34da0c2cacac404fa7f398ae71ef6ab2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:17.628587 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b047b576-9e8e-47da-ba18-b93bffd55460 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:17.629830 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b047b576-9e8e-47da-ba18-b93bffd55460 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:17.634868 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 955/1932] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:17 2022] DELETE /identity/v3/projects/34da0c2cacac404fa7f398ae71ef6ab2 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:17.638441 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d267c-62de-494b-ac9a-f9fea4097ab7 service nova] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:17.656389 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d267c-62de-494b-ac9a-f9fea4097ab7 service nova] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:17.755704 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6c018-17b7-4edd-987b-a62ab91fc08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:17.764993 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6c018-17b7-4edd-987b-a62ab91fc08c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:17.767942 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6c018-17b7-4edd-987b-a62ab91fc08c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:17.768145 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6c018-17b7-4edd-987b-a62ab91fc08c admin admin] PATH_INFO: `/v3/users/4cc7d488b2f1443c8d598f4c725d4e28` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:17.773451 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6c018-17b7-4edd-987b-a62ab91fc08c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cc7d488b2f1443c8d598f4c725d4e28)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:17.777685 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6c018-17b7-4edd-987b-a62ab91fc08c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:17.844597 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-dad6c018-17b7-4edd-987b-a62ab91fc08c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cc7d488b2f1443c8d598f4c725d4e28'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:17.860360 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-dad6c018-17b7-4edd-987b-a62ab91fc08c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cc7d488b2f1443c8d598f4c725d4e28'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:17.861192 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-dad6c018-17b7-4edd-987b-a62ab91fc08c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cc7d488b2f1443c8d598f4c725d4e28'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:17.872003 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-dad6c018-17b7-4edd-987b-a62ab91fc08c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cc7d488b2f1443c8d598f4c725d4e28'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:17.884514 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-dad6c018-17b7-4edd-987b-a62ab91fc08c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cc7d488b2f1443c8d598f4c725d4e28'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:17.892318 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 978/1933] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:17 2022] DELETE /identity/v3/users/4cc7d488b2f1443c8d598f4c725d4e28 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:18.603750 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b047b576-9e8e-47da-ba18-b93bffd55460 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:18.605348 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b047b576-9e8e-47da-ba18-b93bffd55460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:18.620424 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b047b576-9e8e-47da-ba18-b93bffd55460 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:18.680991 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4877e5c-7739-4f2c-9f99-87d44fb373cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:18.681788 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4877e5c-7739-4f2c-9f99-87d44fb373cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:18.682074 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4877e5c-7739-4f2c-9f99-87d44fb373cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:18.682375 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4877e5c-7739-4f2c-9f99-87d44fb373cf admin admin] PATH_INFO: `/v3/projects/4dc8f6e3d66841ceb5f182caec8abc6f` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:18.683553 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4877e5c-7739-4f2c-9f99-87d44fb373cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dc8f6e3d66841ceb5f182caec8abc6f)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:18.685526 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4877e5c-7739-4f2c-9f99-87d44fb373cf admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:18.735309 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d4877e5c-7739-4f2c-9f99-87d44fb373cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dc8f6e3d66841ceb5f182caec8abc6f', 'request_id': 'req-d4877e5c-7739-4f2c-9f99-87d44fb373cf'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:18.741867 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d4877e5c-7739-4f2c-9f99-87d44fb373cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dc8f6e3d66841ceb5f182caec8abc6f', 'request_id': 'req-d4877e5c-7739-4f2c-9f99-87d44fb373cf'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:18.748032 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d4877e5c-7739-4f2c-9f99-87d44fb373cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dc8f6e3d66841ceb5f182caec8abc6f', 'request_id': 'req-d4877e5c-7739-4f2c-9f99-87d44fb373cf'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:18.758054 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:18.762940 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d4877e5c-7739-4f2c-9f99-87d44fb373cf admin admin] The token cache is being invalidate because project 4dc8f6e3d66841ceb5f182caec8abc6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:18.763444 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d4877e5c-7739-4f2c-9f99-87d44fb373cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:18.764141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d4877e5c-7739-4f2c-9f99-87d44fb373cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:18.770036 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 956/1934] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:18 2022] DELETE /identity/v3/projects/4dc8f6e3d66841ceb5f182caec8abc6f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:18.772185 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fed2e-0df9-49cc-acdf-f8ff05d36443 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:18.772671 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fed2e-0df9-49cc-acdf-f8ff05d36443 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:18.772746 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fed2e-0df9-49cc-acdf-f8ff05d36443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:18.792655 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-957fed2e-0df9-49cc-acdf-f8ff05d36443 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:18.793781 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-957fed2e-0df9-49cc-acdf-f8ff05d36443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:18.825995 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:18.877459 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 979/1935] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:18.886340 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a1fdb-8cda-4f16-b42e-6471156ee528 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:18.886632 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a1fdb-8cda-4f16-b42e-6471156ee528 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:18.886955 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a1fdb-8cda-4f16-b42e-6471156ee528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:18.910662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-6a0a1fdb-8cda-4f16-b42e-6471156ee528 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:18.912355 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6a0a1fdb-8cda-4f16-b42e-6471156ee528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:18.932075 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 957/1936] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:18.933190 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fed2e-0df9-49cc-acdf-f8ff05d36443 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:18.946619 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fed2e-0df9-49cc-acdf-f8ff05d36443 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:18.951898 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d310b-13d8-425e-9d91-618b07f26715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:18.952938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d310b-13d8-425e-9d91-618b07f26715 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:18.953421 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d310b-13d8-425e-9d91-618b07f26715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:18.953817 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d310b-13d8-425e-9d91-618b07f26715 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:18.954942 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d310b-13d8-425e-9d91-618b07f26715 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:57:18.955252 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d310b-13d8-425e-9d91-618b07f26715 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:18.956927 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d310b-13d8-425e-9d91-618b07f26715 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:18.975132 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 980/1937] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:57:18.979989 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a1fdb-8cda-4f16-b42e-6471156ee528 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:18.991167 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a1fdb-8cda-4f16-b42e-6471156ee528 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:19.005898 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b39a0-6119-4114-93c6-3e929fb7fc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:19.006713 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b39a0-6119-4114-93c6-3e929fb7fc25 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:19.007185 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b39a0-6119-4114-93c6-3e929fb7fc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:19.007551 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b39a0-6119-4114-93c6-3e929fb7fc25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:19.008773 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b39a0-6119-4114-93c6-3e929fb7fc25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:19.010850 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b39a0-6119-4114-93c6-3e929fb7fc25 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:19.051358 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 958/1938] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:18 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:57:19.052304 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d310b-13d8-425e-9d91-618b07f26715 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:19.062543 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d310b-13d8-425e-9d91-618b07f26715 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:19.146671 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4fc9a-6331-47ef-b8e4-a9654cc1e099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:19.147367 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4fc9a-6331-47ef-b8e4-a9654cc1e099 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:19.147655 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4fc9a-6331-47ef-b8e4-a9654cc1e099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:19.147967 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4fc9a-6331-47ef-b8e4-a9654cc1e099 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:19.148685 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4fc9a-6331-47ef-b8e4-a9654cc1e099 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:19.150822 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4fc9a-6331-47ef-b8e4-a9654cc1e099 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:19.175631 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 981/1939] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:19 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:57:19.180363 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b39a0-6119-4114-93c6-3e929fb7fc25 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:19.193123 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b39a0-6119-4114-93c6-3e929fb7fc25 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:19.203775 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50c50f-923b-4b85-85df-f4c234896dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:19.205691 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50c50f-923b-4b85-85df-f4c234896dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:19.205976 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50c50f-923b-4b85-85df-f4c234896dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:19.206249 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50c50f-923b-4b85-85df-f4c234896dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:19.207006 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50c50f-923b-4b85-85df-f4c234896dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:19.209174 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50c50f-923b-4b85-85df-f4c234896dc5 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:19.225358 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 959/1940] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:19.229788 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4fc9a-6331-47ef-b8e4-a9654cc1e099 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:19.244336 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4fc9a-6331-47ef-b8e4-a9654cc1e099 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:19.259008 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2ff5f-efa4-462b-8e92-fe420ab423ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:19.261076 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2ff5f-efa4-462b-8e92-fe420ab423ce admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:19.262099 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2ff5f-efa4-462b-8e92-fe420ab423ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:19.264481 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2ff5f-efa4-462b-8e92-fe420ab423ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:19.266542 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2ff5f-efa4-462b-8e92-fe420ab423ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:19.270492 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2ff5f-efa4-462b-8e92-fe420ab423ce admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:19.291736 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 982/1941] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:19.300659 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50c50f-923b-4b85-85df-f4c234896dc5 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:19.318241 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50c50f-923b-4b85-85df-f4c234896dc5 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:19.332847 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a768f33-116f-45d2-b88f-e21fc061b322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:19.334151 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a768f33-116f-45d2-b88f-e21fc061b322 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:19.334258 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a768f33-116f-45d2-b88f-e21fc061b322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:19.334478 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a768f33-116f-45d2-b88f-e21fc061b322 admin admin] PATH_INFO: `/v3/projects/bb2268167db7442a920268dd6cefa55a/users/4d2bb1cbbc7b473d8c584d0321c6f717/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:19.374635 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a768f33-116f-45d2-b88f-e21fc061b322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb2268167db7442a920268dd6cefa55a, user_id=4d2bb1cbbc7b473d8c584d0321c6f717, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:19.377776 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a768f33-116f-45d2-b88f-e21fc061b322 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:19.414838 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 960/1942] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:19 2022] PUT /identity/v3/projects/bb2268167db7442a920268dd6cefa55a/users/4d2bb1cbbc7b473d8c584d0321c6f717/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:19.425731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e23357-9ee9-4d76-bbdc-dd6fcd5c7f9e None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:19.427704 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e23357-9ee9-4d76-bbdc-dd6fcd5c7f9e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:19.428896 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e23357-9ee9-4d76-bbdc-dd6fcd5c7f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:19.478864 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-c3e23357-9ee9-4d76-bbdc-dd6fcd5c7f9e None None] MFA Rules not processed for user `4d2bb1cbbc7b473d8c584d0321c6f717`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:19.480265 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c3e23357-9ee9-4d76-bbdc-dd6fcd5c7f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:19.587812 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 983/1943] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:19.640032 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a768f33-116f-45d2-b88f-e21fc061b322 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:19.642066 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9a768f33-116f-45d2-b88f-e21fc061b322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:19.707777 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a768f33-116f-45d2-b88f-e21fc061b322 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:19.712653 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb411c-c09c-46f1-b0ad-f8db8f678cf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:19.713330 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb411c-c09c-46f1-b0ad-f8db8f678cf7 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:19.713614 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb411c-c09c-46f1-b0ad-f8db8f678cf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:19.713889 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb411c-c09c-46f1-b0ad-f8db8f678cf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:19.723192 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb411c-c09c-46f1-b0ad-f8db8f678cf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:19.724669 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb411c-c09c-46f1-b0ad-f8db8f678cf7 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:19.735454 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 961/1944] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:19.760088 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e23357-9ee9-4d76-bbdc-dd6fcd5c7f9e None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:19.821359 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:19.861254 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e23357-9ee9-4d76-bbdc-dd6fcd5c7f9e None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:19.866744 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a8a21-8eea-4d51-9c1e-5af9b7f2f960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:19.867767 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a8a21-8eea-4d51-9c1e-5af9b7f2f960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:19.868282 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a8a21-8eea-4d51-9c1e-5af9b7f2f960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:19.869009 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a8a21-8eea-4d51-9c1e-5af9b7f2f960 admin admin] PATH_INFO: `/v3/users/4d2bb1cbbc7b473d8c584d0321c6f717` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:19.870564 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a8a21-8eea-4d51-9c1e-5af9b7f2f960 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d2bb1cbbc7b473d8c584d0321c6f717)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:19.875022 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a8a21-8eea-4d51-9c1e-5af9b7f2f960 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:19.940851 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-cb1a8a21-8eea-4d51-9c1e-5af9b7f2f960 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d2bb1cbbc7b473d8c584d0321c6f717'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:19.957639 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-cb1a8a21-8eea-4d51-9c1e-5af9b7f2f960 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d2bb1cbbc7b473d8c584d0321c6f717'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:19.958658 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-cb1a8a21-8eea-4d51-9c1e-5af9b7f2f960 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d2bb1cbbc7b473d8c584d0321c6f717'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:19.968687 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-cb1a8a21-8eea-4d51-9c1e-5af9b7f2f960 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d2bb1cbbc7b473d8c584d0321c6f717'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:19.980681 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-cb1a8a21-8eea-4d51-9c1e-5af9b7f2f960 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d2bb1cbbc7b473d8c584d0321c6f717'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:19.991652 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 984/1945] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:19 2022] DELETE /identity/v3/users/4d2bb1cbbc7b473d8c584d0321c6f717 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:19.996566 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe48e6-63a5-40f2-855b-3a297eecbbc9 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:19.997081 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe48e6-63a5-40f2-855b-3a297eecbbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:19.997510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe48e6-63a5-40f2-855b-3a297eecbbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:20.023986 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-2fbe48e6-63a5-40f2-855b-3a297eecbbc9 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:20.025634 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2fbe48e6-63a5-40f2-855b-3a297eecbbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:20.114120 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 962/1946] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:20.123865 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a8a21-8eea-4d51-9c1e-5af9b7f2f960 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:20.125746 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-cb1a8a21-8eea-4d51-9c1e-5af9b7f2f960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:20.185163 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a8a21-8eea-4d51-9c1e-5af9b7f2f960 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:20.189726 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa62283-9457-4222-8ca9-efd99deb1e6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:20.190361 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa62283-9457-4222-8ca9-efd99deb1e6f service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:20.190640 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa62283-9457-4222-8ca9-efd99deb1e6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:20.190904 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa62283-9457-4222-8ca9-efd99deb1e6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:20.201118 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa62283-9457-4222-8ca9-efd99deb1e6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:20.203050 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa62283-9457-4222-8ca9-efd99deb1e6f service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:20.218965 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 985/1947] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:57:20.795203 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe48e6-63a5-40f2-855b-3a297eecbbc9 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:20.798394 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2fbe48e6-63a5-40f2-855b-3a297eecbbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:20.844739 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe48e6-63a5-40f2-855b-3a297eecbbc9 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:20.856612 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fcb95b-cf93-403f-9602-1aa47c266f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:20.857575 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fcb95b-cf93-403f-9602-1aa47c266f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:20.857858 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fcb95b-cf93-403f-9602-1aa47c266f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:20.858136 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fcb95b-cf93-403f-9602-1aa47c266f13 admin admin] PATH_INFO: `/v3/projects/bb2268167db7442a920268dd6cefa55a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:20.859944 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fcb95b-cf93-403f-9602-1aa47c266f13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb2268167db7442a920268dd6cefa55a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:20.861897 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fcb95b-cf93-403f-9602-1aa47c266f13 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:20.910944 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:20.926095 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e1fcb95b-cf93-403f-9602-1aa47c266f13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb2268167db7442a920268dd6cefa55a', 'request_id': 'req-e1fcb95b-cf93-403f-9602-1aa47c266f13'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:20.936103 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e1fcb95b-cf93-403f-9602-1aa47c266f13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb2268167db7442a920268dd6cefa55a', 'request_id': 'req-e1fcb95b-cf93-403f-9602-1aa47c266f13'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:20.943211 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e1fcb95b-cf93-403f-9602-1aa47c266f13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb2268167db7442a920268dd6cefa55a', 'request_id': 'req-e1fcb95b-cf93-403f-9602-1aa47c266f13'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:20.961457 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e1fcb95b-cf93-403f-9602-1aa47c266f13 admin admin] The token cache is being invalidate because project bb2268167db7442a920268dd6cefa55a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:20.961980 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e1fcb95b-cf93-403f-9602-1aa47c266f13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:20.962810 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e1fcb95b-cf93-403f-9602-1aa47c266f13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:20.968012 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 963/1948] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:20 2022] DELETE /identity/v3/projects/bb2268167db7442a920268dd6cefa55a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:20.969972 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbe25a-0a6d-4535-a12e-330a9c2b3bb2 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:20.970479 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbe25a-0a6d-4535-a12e-330a9c2b3bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:20.970570 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbe25a-0a6d-4535-a12e-330a9c2b3bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:21.015349 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-9cfbe25a-0a6d-4535-a12e-330a9c2b3bb2 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:21.018529 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9cfbe25a-0a6d-4535-a12e-330a9c2b3bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:21.173938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:21.232552 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8419c-2a31-41b1-b588-4c59aee58bbe None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:21.232781 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8419c-2a31-41b1-b588-4c59aee58bbe None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:21.233112 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8419c-2a31-41b1-b588-4c59aee58bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:21.235935 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 986/1949] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:21.268542 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-cfc8419c-2a31-41b1-b588-4c59aee58bbe None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:21.269837 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-cfc8419c-2a31-41b1-b588-4c59aee58bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:21.291030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 964/1950] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:21.295753 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbe25a-0a6d-4535-a12e-330a9c2b3bb2 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:21.317622 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbe25a-0a6d-4535-a12e-330a9c2b3bb2 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:21.328163 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc394d4-684a-4d2b-b8c9-a6abcd6308a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:21.329132 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc394d4-684a-4d2b-b8c9-a6abcd6308a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:21.329547 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc394d4-684a-4d2b-b8c9-a6abcd6308a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:21.329948 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc394d4-684a-4d2b-b8c9-a6abcd6308a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:21.331056 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc394d4-684a-4d2b-b8c9-a6abcd6308a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:57:21.331513 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc394d4-684a-4d2b-b8c9-a6abcd6308a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:21.334839 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc394d4-684a-4d2b-b8c9-a6abcd6308a4 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:21.362092 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 987/1951] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:57:21.363121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8419c-2a31-41b1-b588-4c59aee58bbe None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:21.378819 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8419c-2a31-41b1-b588-4c59aee58bbe None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:21.389548 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3afe2-a481-4191-9d7b-e7a1ac506f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:21.392161 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3afe2-a481-4191-9d7b-e7a1ac506f39 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:21.392934 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3afe2-a481-4191-9d7b-e7a1ac506f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:21.393052 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3afe2-a481-4191-9d7b-e7a1ac506f39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:21.393901 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3afe2-a481-4191-9d7b-e7a1ac506f39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:21.396475 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3afe2-a481-4191-9d7b-e7a1ac506f39 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:21.435188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc394d4-684a-4d2b-b8c9-a6abcd6308a4 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:21.435855 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 965/1952] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:21 2022] POST /identity/v3/projects => generated 361 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:57:21.446904 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc394d4-684a-4d2b-b8c9-a6abcd6308a4 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:21.520273 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d5531-6e6f-4711-930c-bad296d318cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:21.521065 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d5531-6e6f-4711-930c-bad296d318cc admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:21.521402 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d5531-6e6f-4711-930c-bad296d318cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:21.522147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d5531-6e6f-4711-930c-bad296d318cc admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:21.522323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d5531-6e6f-4711-930c-bad296d318cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:21.524279 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d5531-6e6f-4711-930c-bad296d318cc admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:21.545281 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 988/1953] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:21 2022] POST /identity/v3/users => generated 281 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:21.549955 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3afe2-a481-4191-9d7b-e7a1ac506f39 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:21.561239 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3afe2-a481-4191-9d7b-e7a1ac506f39 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:21.566973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10d672-85a4-42f0-a0f0-46bc9f202968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:21.568034 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10d672-85a4-42f0-a0f0-46bc9f202968 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:21.568120 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10d672-85a4-42f0-a0f0-46bc9f202968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:21.568357 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10d672-85a4-42f0-a0f0-46bc9f202968 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:21.569094 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d10d672-85a4-42f0-a0f0-46bc9f202968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:21.570730 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d10d672-85a4-42f0-a0f0-46bc9f202968 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:21.583076 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 966/1954] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:21.587369 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d5531-6e6f-4711-930c-bad296d318cc admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:21.598888 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d5531-6e6f-4711-930c-bad296d318cc admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:21.604323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a222b8-3cda-4257-99ac-bd37663375ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:21.604994 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a222b8-3cda-4257-99ac-bd37663375ac admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:21.605282 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a222b8-3cda-4257-99ac-bd37663375ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:21.605564 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a222b8-3cda-4257-99ac-bd37663375ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:21.606305 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a222b8-3cda-4257-99ac-bd37663375ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:21.608286 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a222b8-3cda-4257-99ac-bd37663375ac admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:21.637711 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 989/1955] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:21.639265 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10d672-85a4-42f0-a0f0-46bc9f202968 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:21.650429 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10d672-85a4-42f0-a0f0-46bc9f202968 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:21.656542 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87c0fe-f42a-4cf8-aba7-95e14d9f2797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:21.657709 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87c0fe-f42a-4cf8-aba7-95e14d9f2797 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:21.658192 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87c0fe-f42a-4cf8-aba7-95e14d9f2797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:21.658686 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87c0fe-f42a-4cf8-aba7-95e14d9f2797 admin admin] PATH_INFO: `/v3/projects/216ac7324f024352ad49b2fe21de43b8/users/bc8066321f604c79848d9671b2f85105/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:21.676575 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87c0fe-f42a-4cf8-aba7-95e14d9f2797 admin admin] RBAC: Authorizing `identity:create_grant(project_id=216ac7324f024352ad49b2fe21de43b8, user_id=bc8066321f604c79848d9671b2f85105, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:21.679225 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87c0fe-f42a-4cf8-aba7-95e14d9f2797 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:21.694820 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 967/1956] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:21 2022] PUT /identity/v3/projects/216ac7324f024352ad49b2fe21de43b8/users/bc8066321f604c79848d9671b2f85105/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:21.708051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c4269-220f-4172-84b1-525fc8c749b9 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:21.708430 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c4269-220f-4172-84b1-525fc8c749b9 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:21.708782 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c4269-220f-4172-84b1-525fc8c749b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:21.738898 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-485c4269-220f-4172-84b1-525fc8c749b9 None None] MFA Rules not processed for user `bc8066321f604c79848d9671b2f85105`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:21.740173 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-485c4269-220f-4172-84b1-525fc8c749b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:21.806792 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 990/1957] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:21 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:57:21.839550 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87c0fe-f42a-4cf8-aba7-95e14d9f2797 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:21.841462 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8e87c0fe-f42a-4cf8-aba7-95e14d9f2797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:21.856101 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c4269-220f-4172-84b1-525fc8c749b9 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:21.857700 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-485c4269-220f-4172-84b1-525fc8c749b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:21.904165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87c0fe-f42a-4cf8-aba7-95e14d9f2797 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:21.908432 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75363d0f-071b-49a2-8d35-cec7757ff5f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:21.909087 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75363d0f-071b-49a2-8d35-cec7757ff5f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:21.909266 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:21.909365 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75363d0f-071b-49a2-8d35-cec7757ff5f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:21.909629 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75363d0f-071b-49a2-8d35-cec7757ff5f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:21.918855 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75363d0f-071b-49a2-8d35-cec7757ff5f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:21.920326 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75363d0f-071b-49a2-8d35-cec7757ff5f6 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:21.930889 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 968/1958] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:21 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:21.931401 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c4269-220f-4172-84b1-525fc8c749b9 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:21.936365 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf553b-4ec0-4416-a72f-24c6cb8ab018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:21.937303 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf553b-4ec0-4416-a72f-24c6cb8ab018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:21.937571 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf553b-4ec0-4416-a72f-24c6cb8ab018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:21.937849 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf553b-4ec0-4416-a72f-24c6cb8ab018 admin admin] PATH_INFO: `/v3/users/31c9b3c964f34aafb2ff237ae40fad83` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:21.939070 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf553b-4ec0-4416-a72f-24c6cb8ab018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31c9b3c964f34aafb2ff237ae40fad83)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:21.941040 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf553b-4ec0-4416-a72f-24c6cb8ab018 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:21.946017 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75363d0f-071b-49a2-8d35-cec7757ff5f6 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:21.958438 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75363d0f-071b-49a2-8d35-cec7757ff5f6 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:21.963382 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a81d3-7775-4669-b83d-3ce53c7fde2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:21.964350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a81d3-7775-4669-b83d-3ce53c7fde2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:21.964664 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a81d3-7775-4669-b83d-3ce53c7fde2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:21.964972 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a81d3-7775-4669-b83d-3ce53c7fde2c admin admin] PATH_INFO: `/v3/users/bc8066321f604c79848d9671b2f85105` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:21.966223 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a81d3-7775-4669-b83d-3ce53c7fde2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc8066321f604c79848d9671b2f85105)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:21.968769 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a81d3-7775-4669-b83d-3ce53c7fde2c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:21.992067 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4ebf553b-4ec0-4416-a72f-24c6cb8ab018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31c9b3c964f34aafb2ff237ae40fad83'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:22.005631 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4ebf553b-4ec0-4416-a72f-24c6cb8ab018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31c9b3c964f34aafb2ff237ae40fad83'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:22.006709 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4ebf553b-4ec0-4416-a72f-24c6cb8ab018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31c9b3c964f34aafb2ff237ae40fad83'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:22.013291 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4ebf553b-4ec0-4416-a72f-24c6cb8ab018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31c9b3c964f34aafb2ff237ae40fad83'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:22.018606 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c92a81d3-7775-4669-b83d-3ce53c7fde2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc8066321f604c79848d9671b2f85105'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:22.021413 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4ebf553b-4ec0-4416-a72f-24c6cb8ab018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31c9b3c964f34aafb2ff237ae40fad83'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:22.026170 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c92a81d3-7775-4669-b83d-3ce53c7fde2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc8066321f604c79848d9671b2f85105'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:22.027858 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:22.028027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 991/1959] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:21 2022] DELETE /identity/v3/users/31c9b3c964f34aafb2ff237ae40fad83 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:22.033599 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27626e53-bcdf-41e2-85c0-ef60e35833ae None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:22.033872 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27626e53-bcdf-41e2-85c0-ef60e35833ae None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:22.034155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27626e53-bcdf-41e2-85c0-ef60e35833ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:22.034415 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c92a81d3-7775-4669-b83d-3ce53c7fde2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc8066321f604c79848d9671b2f85105'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:22.048140 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c92a81d3-7775-4669-b83d-3ce53c7fde2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc8066321f604c79848d9671b2f85105'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:22.048858 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c92a81d3-7775-4669-b83d-3ce53c7fde2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc8066321f604c79848d9671b2f85105'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:22.052424 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-27626e53-bcdf-41e2-85c0-ef60e35833ae None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:22.053632 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-27626e53-bcdf-41e2-85c0-ef60e35833ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:22.055166 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 969/1960] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:21 2022] DELETE /identity/v3/users/bc8066321f604c79848d9671b2f85105 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:22.059511 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f2c2d-5e00-4739-b175-a7d7f7a337ba None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:22.059805 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f2c2d-5e00-4739-b175-a7d7f7a337ba None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:22.060121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f2c2d-5e00-4739-b175-a7d7f7a337ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:22.076768 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-380f2c2d-5e00-4739-b175-a7d7f7a337ba None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:22.078031 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-380f2c2d-5e00-4739-b175-a7d7f7a337ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:22.113906 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 992/1961] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:57:22.123823 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27626e53-bcdf-41e2-85c0-ef60e35833ae None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:22.125815 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-27626e53-bcdf-41e2-85c0-ef60e35833ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:22.140817 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 970/1962] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:57:22.152056 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f2c2d-5e00-4739-b175-a7d7f7a337ba None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:22.153795 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-380f2c2d-5e00-4739-b175-a7d7f7a337ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:22.192690 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27626e53-bcdf-41e2-85c0-ef60e35833ae None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:22.197215 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e3a69-66c1-45ed-af92-664461f0c38a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:22.197868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e3a69-66c1-45ed-af92-664461f0c38a service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:22.198115 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e3a69-66c1-45ed-af92-664461f0c38a service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:22.199053 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e3a69-66c1-45ed-af92-664461f0c38a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:22.210091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e3a69-66c1-45ed-af92-664461f0c38a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:22.211588 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e3a69-66c1-45ed-af92-664461f0c38a service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:22.217236 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f2c2d-5e00-4739-b175-a7d7f7a337ba None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:22.221882 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1436f4f-8c7a-4b10-82cf-2c0da9ab7899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:22.222415 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 993/1963] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:57:22.222609 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1436f4f-8c7a-4b10-82cf-2c0da9ab7899 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:22.222884 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1436f4f-8c7a-4b10-82cf-2c0da9ab7899 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:22.223209 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1436f4f-8c7a-4b10-82cf-2c0da9ab7899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:22.236480 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1436f4f-8c7a-4b10-82cf-2c0da9ab7899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:22.238299 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1436f4f-8c7a-4b10-82cf-2c0da9ab7899 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:22.252281 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 971/1964] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:57:23.395677 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e3a69-66c1-45ed-af92-664461f0c38a service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:23.397289 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9d5e3a69-66c1-45ed-af92-664461f0c38a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:23.412812 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e3a69-66c1-45ed-af92-664461f0c38a service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:23.420115 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4e442-48d2-4cee-9d85-3cba9a17170d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:23.420826 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4e442-48d2-4cee-9d85-3cba9a17170d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:23.421313 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4e442-48d2-4cee-9d85-3cba9a17170d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:23.421747 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4e442-48d2-4cee-9d85-3cba9a17170d admin admin] PATH_INFO: `/v3/projects/216ac7324f024352ad49b2fe21de43b8` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:23.423135 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f4e442-48d2-4cee-9d85-3cba9a17170d admin admin] RBAC: Authorizing `identity:delete_project(project_id=216ac7324f024352ad49b2fe21de43b8)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:23.425409 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f4e442-48d2-4cee-9d85-3cba9a17170d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:23.427378 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:23.491184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1436f4f-8c7a-4b10-82cf-2c0da9ab7899 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:23.492783 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a1436f4f-8c7a-4b10-82cf-2c0da9ab7899 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:23.499459 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-15f4e442-48d2-4cee-9d85-3cba9a17170d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '216ac7324f024352ad49b2fe21de43b8', 'request_id': 'req-15f4e442-48d2-4cee-9d85-3cba9a17170d'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:23.506436 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-15f4e442-48d2-4cee-9d85-3cba9a17170d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '216ac7324f024352ad49b2fe21de43b8', 'request_id': 'req-15f4e442-48d2-4cee-9d85-3cba9a17170d'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:23.506571 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1436f4f-8c7a-4b10-82cf-2c0da9ab7899 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:23.514054 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-15f4e442-48d2-4cee-9d85-3cba9a17170d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '216ac7324f024352ad49b2fe21de43b8', 'request_id': 'req-15f4e442-48d2-4cee-9d85-3cba9a17170d'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:23.533237 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-15f4e442-48d2-4cee-9d85-3cba9a17170d admin admin] The token cache is being invalidate because project 216ac7324f024352ad49b2fe21de43b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:23.533471 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-15f4e442-48d2-4cee-9d85-3cba9a17170d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:23.534125 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-15f4e442-48d2-4cee-9d85-3cba9a17170d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:23.536049 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 994/1965] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:23 2022] DELETE /identity/v3/projects/216ac7324f024352ad49b2fe21de43b8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:23.541469 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca5f22-e686-4b6f-a8fc-4555ceb393b2 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:23.541756 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca5f22-e686-4b6f-a8fc-4555ceb393b2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:23.542203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca5f22-e686-4b6f-a8fc-4555ceb393b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:23.561095 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b5ca5f22-e686-4b6f-a8fc-4555ceb393b2 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:23.562573 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b5ca5f22-e686-4b6f-a8fc-4555ceb393b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:23.575990 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ffa94-3331-4795-88a4-726b0ac8f5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:23.577072 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ffa94-3331-4795-88a4-726b0ac8f5b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:23.577536 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ffa94-3331-4795-88a4-726b0ac8f5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:23.577869 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ffa94-3331-4795-88a4-726b0ac8f5b7 admin admin] PATH_INFO: `/v3/projects/26f9e2a3a6b845bea75eea27f1015e60` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:23.579443 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ffa94-3331-4795-88a4-726b0ac8f5b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26f9e2a3a6b845bea75eea27f1015e60)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:23.581952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ffa94-3331-4795-88a4-726b0ac8f5b7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:23.607242 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:23.632073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 995/1966] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:57:23.642807 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070daa1c-75cf-411c-9c37-d43c3696c85a None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:23.643193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070daa1c-75cf-411c-9c37-d43c3696c85a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:23.643456 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070daa1c-75cf-411c-9c37-d43c3696c85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:23.671992 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-070daa1c-75cf-411c-9c37-d43c3696c85a None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:23.673504 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-070daa1c-75cf-411c-9c37-d43c3696c85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:23.684468 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 996/1967] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:23.689525 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070daa1c-75cf-411c-9c37-d43c3696c85a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:23.701565 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070daa1c-75cf-411c-9c37-d43c3696c85a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:23.707909 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1089a-ecde-40ca-8bac-2266c3d582db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:23.708536 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1089a-ecde-40ca-8bac-2266c3d582db admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:23.708863 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1089a-ecde-40ca-8bac-2266c3d582db admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:23.709218 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1089a-ecde-40ca-8bac-2266c3d582db admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:23.710168 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1089a-ecde-40ca-8bac-2266c3d582db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:57:23.710502 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1089a-ecde-40ca-8bac-2266c3d582db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:23.712661 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1089a-ecde-40ca-8bac-2266c3d582db admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:23.729531 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 997/1968] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:57:23.735217 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1089a-ecde-40ca-8bac-2266c3d582db admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:23.747748 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1089a-ecde-40ca-8bac-2266c3d582db admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:23.753875 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e11c8-96fd-4d67-9c4f-71d617797de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:23.754583 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e11c8-96fd-4d67-9c4f-71d617797de9 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:23.754894 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e11c8-96fd-4d67-9c4f-71d617797de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:23.755239 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e11c8-96fd-4d67-9c4f-71d617797de9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:23.756172 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e11c8-96fd-4d67-9c4f-71d617797de9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:23.758873 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e11c8-96fd-4d67-9c4f-71d617797de9 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:23.804995 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 998/1969] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:23 2022] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:57:23.809407 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7d6ffa94-3331-4795-88a4-726b0ac8f5b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26f9e2a3a6b845bea75eea27f1015e60', 'request_id': 'req-7d6ffa94-3331-4795-88a4-726b0ac8f5b7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:23.812770 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e11c8-96fd-4d67-9c4f-71d617797de9 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:23.821147 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7d6ffa94-3331-4795-88a4-726b0ac8f5b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26f9e2a3a6b845bea75eea27f1015e60', 'request_id': 'req-7d6ffa94-3331-4795-88a4-726b0ac8f5b7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:23.831746 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7d6ffa94-3331-4795-88a4-726b0ac8f5b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26f9e2a3a6b845bea75eea27f1015e60', 'request_id': 'req-7d6ffa94-3331-4795-88a4-726b0ac8f5b7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:23.851209 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7d6ffa94-3331-4795-88a4-726b0ac8f5b7 admin admin] The token cache is being invalidate because project 26f9e2a3a6b845bea75eea27f1015e60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:23.851951 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7d6ffa94-3331-4795-88a4-726b0ac8f5b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:23.853153 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7d6ffa94-3331-4795-88a4-726b0ac8f5b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:23.855547 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 972/1970] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:23 2022] DELETE /identity/v3/projects/26f9e2a3a6b845bea75eea27f1015e60 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:23.860555 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824d8cf-2297-4a83-9297-38470cc8c305 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:23.861161 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824d8cf-2297-4a83-9297-38470cc8c305 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:23.861631 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824d8cf-2297-4a83-9297-38470cc8c305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:23.881657 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-0824d8cf-2297-4a83-9297-38470cc8c305 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:23.882879 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0824d8cf-2297-4a83-9297-38470cc8c305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:23.892915 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:23.914791 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e11c8-96fd-4d67-9c4f-71d617797de9 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:23.920208 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9bd0c-cfe9-4924-bd20-ff468a1c92af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:23.920887 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9bd0c-cfe9-4924-bd20-ff468a1c92af admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:23.921288 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9bd0c-cfe9-4924-bd20-ff468a1c92af admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:23.921699 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9bd0c-cfe9-4924-bd20-ff468a1c92af admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:23.922434 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9bd0c-cfe9-4924-bd20-ff468a1c92af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:23.924381 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9bd0c-cfe9-4924-bd20-ff468a1c92af admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:23.947810 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 999/1971] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:23 2022] POST /identity/v3/users => generated 286 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:23.951674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9bd0c-cfe9-4924-bd20-ff468a1c92af admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:23.953666 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5fd9bd0c-cfe9-4924-bd20-ff468a1c92af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:23.960790 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 973/1972] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:23.965878 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9bd0c-cfe9-4924-bd20-ff468a1c92af admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:23.969065 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18767c-4ba7-4246-8824-f0423e68585c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:23.969379 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18767c-4ba7-4246-8824-f0423e68585c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:23.972122 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18767c-4ba7-4246-8824-f0423e68585c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:23.972227 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334f762-2319-40c7-9261-7de4e513010e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:23.973012 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334f762-2319-40c7-9261-7de4e513010e admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:23.973296 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334f762-2319-40c7-9261-7de4e513010e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:23.973573 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334f762-2319-40c7-9261-7de4e513010e admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:23.974297 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c334f762-2319-40c7-9261-7de4e513010e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:23.975924 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c334f762-2319-40c7-9261-7de4e513010e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:23.990538 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1000/1973] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:57:23.991580 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334f762-2319-40c7-9261-7de4e513010e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:23.991748 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-db18767c-4ba7-4246-8824-f0423e68585c None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:23.993018 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-db18767c-4ba7-4246-8824-f0423e68585c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:24.003022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 974/1974] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:57:24.006553 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334f762-2319-40c7-9261-7de4e513010e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:24.006916 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18767c-4ba7-4246-8824-f0423e68585c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:24.012359 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb33a45-c564-4cdb-9d1e-0d4ea664bf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:24.013134 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb33a45-c564-4cdb-9d1e-0d4ea664bf31 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:24.013518 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb33a45-c564-4cdb-9d1e-0d4ea664bf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:24.013862 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb33a45-c564-4cdb-9d1e-0d4ea664bf31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:24.016275 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb33a45-c564-4cdb-9d1e-0d4ea664bf31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:24.018073 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18767c-4ba7-4246-8824-f0423e68585c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:24.020156 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb33a45-c564-4cdb-9d1e-0d4ea664bf31 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:24.025461 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5efa1-7e08-48f9-b435-0b4f2ff85ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:24.026920 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5efa1-7e08-48f9-b435-0b4f2ff85ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:24.027380 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5efa1-7e08-48f9-b435-0b4f2ff85ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:24.028007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5efa1-7e08-48f9-b435-0b4f2ff85ef0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:24.029931 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae5efa1-7e08-48f9-b435-0b4f2ff85ef0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:57:24.031671 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae5efa1-7e08-48f9-b435-0b4f2ff85ef0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:24.032795 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1001/1975] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:24.033706 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae5efa1-7e08-48f9-b435-0b4f2ff85ef0 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:24.040059 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb33a45-c564-4cdb-9d1e-0d4ea664bf31 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:24.053339 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 975/1976] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:57:24.053736 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5efa1-7e08-48f9-b435-0b4f2ff85ef0 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:24.072772 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb33a45-c564-4cdb-9d1e-0d4ea664bf31 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:24.074031 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5efa1-7e08-48f9-b435-0b4f2ff85ef0 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:24.080560 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1b2ee-0854-4485-acf5-41acfa96a00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:24.082833 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1b2ee-0854-4485-acf5-41acfa96a00a admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:24.083304 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1b2ee-0854-4485-acf5-41acfa96a00a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:24.083738 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1b2ee-0854-4485-acf5-41acfa96a00a admin admin] PATH_INFO: `/v3/projects/475e71531106402e9240feef372b079f/users/a9b2eae2f47d487fb6204503c16a23eb/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:24.094441 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbbf76d-939a-4040-8868-0dc33fdee306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:24.095198 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbf76d-939a-4040-8868-0dc33fdee306 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:24.095443 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbf76d-939a-4040-8868-0dc33fdee306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:24.095708 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbf76d-939a-4040-8868-0dc33fdee306 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:24.096444 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbbf76d-939a-4040-8868-0dc33fdee306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:24.099180 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbbf76d-939a-4040-8868-0dc33fdee306 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:24.114784 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b1b2ee-0854-4485-acf5-41acfa96a00a admin admin] RBAC: Authorizing `identity:create_grant(project_id=475e71531106402e9240feef372b079f, user_id=a9b2eae2f47d487fb6204503c16a23eb, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:24.119635 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b1b2ee-0854-4485-acf5-41acfa96a00a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:24.143441 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1002/1977] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:24 2022] PUT /identity/v3/projects/475e71531106402e9240feef372b079f/users/a9b2eae2f47d487fb6204503c16a23eb/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:24.157946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e27e9-a723-44c9-a3c0-799d295c2d32 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:24.157946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e27e9-a723-44c9-a3c0-799d295c2d32 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:24.158242 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e27e9-a723-44c9-a3c0-799d295c2d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:24.167693 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 976/1978] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:24 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:24.168314 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbbf76d-939a-4040-8868-0dc33fdee306 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:24.240943 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-7d0e27e9-a723-44c9-a3c0-799d295c2d32 None None] MFA Rules not processed for user `a9b2eae2f47d487fb6204503c16a23eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:24.243936 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7d0e27e9-a723-44c9-a3c0-799d295c2d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:24.251516 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbbf76d-939a-4040-8868-0dc33fdee306 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:24.256784 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534f16a-274f-43c4-aab1-538dc0bfe670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:24.257811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534f16a-274f-43c4-aab1-538dc0bfe670 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:24.257811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534f16a-274f-43c4-aab1-538dc0bfe670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:24.258017 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534f16a-274f-43c4-aab1-538dc0bfe670 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:24.258678 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534f16a-274f-43c4-aab1-538dc0bfe670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:24.260647 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534f16a-274f-43c4-aab1-538dc0bfe670 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:24.273507 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:24.289864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 977/1979] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:24 2022] POST /identity/v3/users => generated 286 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:57:24.291095 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534f16a-274f-43c4-aab1-538dc0bfe670 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:24.295837 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b534f16a-274f-43c4-aab1-538dc0bfe670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:24.313655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534f16a-274f-43c4-aab1-538dc0bfe670 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:24.323387 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013b86d-fc40-419a-b76d-fbb98c07d1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:24.324314 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013b86d-fc40-419a-b76d-fbb98c07d1e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:24.324595 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013b86d-fc40-419a-b76d-fbb98c07d1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:24.325188 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013b86d-fc40-419a-b76d-fbb98c07d1e2 admin admin] PATH_INFO: `/v3/users/35bdf517819b418ead0a35553ad6249f` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:24.327346 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013b86d-fc40-419a-b76d-fbb98c07d1e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35bdf517819b418ead0a35553ad6249f)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:24.329518 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013b86d-fc40-419a-b76d-fbb98c07d1e2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:24.367857 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1003/1980] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:24.369067 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e27e9-a723-44c9-a3c0-799d295c2d32 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:24.384187 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e27e9-a723-44c9-a3c0-799d295c2d32 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:24.400066 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4876c-c834-4969-8887-a89ec1db958c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:24.400775 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4876c-c834-4969-8887-a89ec1db958c admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:24.401099 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4876c-c834-4969-8887-a89ec1db958c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:24.401334 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4876c-c834-4969-8887-a89ec1db958c admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:24.402116 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4876c-c834-4969-8887-a89ec1db958c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:24.402841 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9013b86d-fc40-419a-b76d-fbb98c07d1e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35bdf517819b418ead0a35553ad6249f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:24.403837 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4876c-c834-4969-8887-a89ec1db958c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:24.414789 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9013b86d-fc40-419a-b76d-fbb98c07d1e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35bdf517819b418ead0a35553ad6249f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:24.424513 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1004/1981] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:24.425595 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4876c-c834-4969-8887-a89ec1db958c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:24.426230 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9013b86d-fc40-419a-b76d-fbb98c07d1e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35bdf517819b418ead0a35553ad6249f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:24.427529 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b7f4876c-c834-4969-8887-a89ec1db958c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:24.444200 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9013b86d-fc40-419a-b76d-fbb98c07d1e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35bdf517819b418ead0a35553ad6249f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:24.445092 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9013b86d-fc40-419a-b76d-fbb98c07d1e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35bdf517819b418ead0a35553ad6249f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:24.451935 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 978/1982] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:24 2022] DELETE /identity/v3/users/35bdf517819b418ead0a35553ad6249f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:24.452949 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013b86d-fc40-419a-b76d-fbb98c07d1e2 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:24.454637 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9013b86d-fc40-419a-b76d-fbb98c07d1e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:24.506192 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4876c-c834-4969-8887-a89ec1db958c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:24.546260 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:24.570218 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013b86d-fc40-419a-b76d-fbb98c07d1e2 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:24.574814 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be0022-8282-44b4-984e-4c341d1c22db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:24.575629 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be0022-8282-44b4-984e-4c341d1c22db service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:24.576011 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be0022-8282-44b4-984e-4c341d1c22db service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:24.576364 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be0022-8282-44b4-984e-4c341d1c22db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:24.576464 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa1abc-0d53-4e71-a734-7bfb83d4e626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:24.577470 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa1abc-0d53-4e71-a734-7bfb83d4e626 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:24.578038 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa1abc-0d53-4e71-a734-7bfb83d4e626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:24.578038 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa1abc-0d53-4e71-a734-7bfb83d4e626 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:24.578674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-28be0022-8282-44b4-984e-4c341d1c22db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:24.579159 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa1abc-0d53-4e71-a734-7bfb83d4e626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:24.581517 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa1abc-0d53-4e71-a734-7bfb83d4e626 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:24.601285 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 979/1983] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:24.602797 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27108d-5ee3-40f0-9d46-1d4dd522ab10 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:24.603094 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27108d-5ee3-40f0-9d46-1d4dd522ab10 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:24.603375 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27108d-5ee3-40f0-9d46-1d4dd522ab10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:24.633339 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5a27108d-5ee3-40f0-9d46-1d4dd522ab10 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:24.635220 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5a27108d-5ee3-40f0-9d46-1d4dd522ab10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:24.650826 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 980/1984] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:24.652606 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27108d-5ee3-40f0-9d46-1d4dd522ab10 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:24.662773 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be0022-8282-44b4-984e-4c341d1c22db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:24.665461 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be0022-8282-44b4-984e-4c341d1c22db service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:24.668382 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27108d-5ee3-40f0-9d46-1d4dd522ab10 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:24.674885 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b4d50-1caf-45d7-8b79-b75ac13fc052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:24.675964 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b4d50-1caf-45d7-8b79-b75ac13fc052 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:24.676231 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b4d50-1caf-45d7-8b79-b75ac13fc052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:24.676864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b4d50-1caf-45d7-8b79-b75ac13fc052 admin admin] PATH_INFO: `/v3/projects/8032cca97f264817b6868c08def9651c/users/f95939bda4bf420796ed9eb312227620/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:24.679300 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1005/1985] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:24.680415 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be0022-8282-44b4-984e-4c341d1c22db service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:24.684178 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-28be0022-8282-44b4-984e-4c341d1c22db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:24.697703 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b4d50-1caf-45d7-8b79-b75ac13fc052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8032cca97f264817b6868c08def9651c, user_id=f95939bda4bf420796ed9eb312227620, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:24.702612 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b4d50-1caf-45d7-8b79-b75ac13fc052 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:24.732683 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 981/1986] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:24 2022] PUT /identity/v3/projects/8032cca97f264817b6868c08def9651c/users/f95939bda4bf420796ed9eb312227620/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:24.732683 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b4d50-1caf-45d7-8b79-b75ac13fc052 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:24.732683 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b45b4d50-1caf-45d7-8b79-b75ac13fc052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:24.781327 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be0022-8282-44b4-984e-4c341d1c22db service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:24.782638 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:24.819548 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b4d50-1caf-45d7-8b79-b75ac13fc052 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:24.825097 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafd8bf-9bf5-4e50-b149-486cfb613c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:24.826056 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafd8bf-9bf5-4e50-b149-486cfb613c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:24.826390 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafd8bf-9bf5-4e50-b149-486cfb613c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:24.826720 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafd8bf-9bf5-4e50-b149-486cfb613c03 admin admin] PATH_INFO: `/v3/users/a9b2eae2f47d487fb6204503c16a23eb` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:24.828263 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfafd8bf-9bf5-4e50-b149-486cfb613c03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9b2eae2f47d487fb6204503c16a23eb)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:24.831103 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfafd8bf-9bf5-4e50-b149-486cfb613c03 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:24.834553 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74a751-d806-473e-9bd5-635f8f55a6f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:24.835270 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74a751-d806-473e-9bd5-635f8f55a6f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:24.835545 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74a751-d806-473e-9bd5-635f8f55a6f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:24.835815 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74a751-d806-473e-9bd5-635f8f55a6f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:24.846856 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db74a751-d806-473e-9bd5-635f8f55a6f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:24.848522 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db74a751-d806-473e-9bd5-635f8f55a6f9 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:24.859303 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1006/1987] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:24.860861 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e152294-1d2e-4841-818b-58ee15a8cd35 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:24.861301 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e152294-1d2e-4841-818b-58ee15a8cd35 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:24.861642 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e152294-1d2e-4841-818b-58ee15a8cd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:24.888473 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cfafd8bf-9bf5-4e50-b149-486cfb613c03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9b2eae2f47d487fb6204503c16a23eb'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:24.892661 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-0e152294-1d2e-4841-818b-58ee15a8cd35 None None] MFA Rules not processed for user `f95939bda4bf420796ed9eb312227620`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:24.894565 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-0e152294-1d2e-4841-818b-58ee15a8cd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:24.896715 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cfafd8bf-9bf5-4e50-b149-486cfb613c03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9b2eae2f47d487fb6204503c16a23eb'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:24.906859 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cfafd8bf-9bf5-4e50-b149-486cfb613c03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9b2eae2f47d487fb6204503c16a23eb'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:24.934972 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:24.937407 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cfafd8bf-9bf5-4e50-b149-486cfb613c03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9b2eae2f47d487fb6204503c16a23eb'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:24.938133 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cfafd8bf-9bf5-4e50-b149-486cfb613c03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9b2eae2f47d487fb6204503c16a23eb'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:24.946292 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 982/1988] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:24 2022] DELETE /identity/v3/users/a9b2eae2f47d487fb6204503c16a23eb => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:24.951165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa867f42-e2cb-4cc2-a85b-036831808642 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:24.951501 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa867f42-e2cb-4cc2-a85b-036831808642 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:24.951999 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa867f42-e2cb-4cc2-a85b-036831808642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:24.972861 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-aa867f42-e2cb-4cc2-a85b-036831808642 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:24.974248 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-aa867f42-e2cb-4cc2-a85b-036831808642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:24.981218 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1007/1989] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:24.994023 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e152294-1d2e-4841-818b-58ee15a8cd35 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:24.995745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-0e152294-1d2e-4841-818b-58ee15a8cd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:25.067560 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 983/1990] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:25.070899 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e152294-1d2e-4841-818b-58ee15a8cd35 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:25.078444 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa867f42-e2cb-4cc2-a85b-036831808642 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:25.079899 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-aa867f42-e2cb-4cc2-a85b-036831808642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:25.134114 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aaf4c7-c571-4058-8e07-f15f2766ea0f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819a7d47f644bc18e6d07a125826d76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:25.135250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaf4c7-c571-4058-8e07-f15f2766ea0f service glance] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:25.135742 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaf4c7-c571-4058-8e07-f15f2766ea0f service glance] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:25.136241 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaf4c7-c571-4058-8e07-f15f2766ea0f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:25.153573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa867f42-e2cb-4cc2-a85b-036831808642 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:25.160072 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0fb73-6405-4ca1-86e8-bd32af832be6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:25.161199 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0fb73-6405-4ca1-86e8-bd32af832be6 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:25.161496 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0fb73-6405-4ca1-86e8-bd32af832be6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:25.161775 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0fb73-6405-4ca1-86e8-bd32af832be6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:25.173942 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:25.178233 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0fb73-6405-4ca1-86e8-bd32af832be6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:25.180143 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0fb73-6405-4ca1-86e8-bd32af832be6 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:25.208875 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 984/1991] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:57:25.211084 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0fb73-6405-4ca1-86e8-bd32af832be6 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:25.217089 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2ce0fb73-6405-4ca1-86e8-bd32af832be6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:25.248005 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aaf4c7-c571-4058-8e07-f15f2766ea0f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:25.248228 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0fb73-6405-4ca1-86e8-bd32af832be6 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:25.249903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aaf4c7-c571-4058-8e07-f15f2766ea0f service glance] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:25.257097 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d678b-e6c1-47d4-aec3-27b55a26a389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:25.259678 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d678b-e6c1-47d4-aec3-27b55a26a389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:25.260188 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d678b-e6c1-47d4-aec3-27b55a26a389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:25.262314 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d678b-e6c1-47d4-aec3-27b55a26a389 admin admin] PATH_INFO: `/v3/projects/8e0f80cc47464c2f88be55def5d9cf49` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:25.265379 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d678b-e6c1-47d4-aec3-27b55a26a389 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e0f80cc47464c2f88be55def5d9cf49)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:25.268950 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d678b-e6c1-47d4-aec3-27b55a26a389 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:25.271019 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1008/1992] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:25.346308 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-503d678b-e6c1-47d4-aec3-27b55a26a389 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e0f80cc47464c2f88be55def5d9cf49', 'request_id': 'req-503d678b-e6c1-47d4-aec3-27b55a26a389'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:25.367746 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-503d678b-e6c1-47d4-aec3-27b55a26a389 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e0f80cc47464c2f88be55def5d9cf49', 'request_id': 'req-503d678b-e6c1-47d4-aec3-27b55a26a389'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:25.379299 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-503d678b-e6c1-47d4-aec3-27b55a26a389 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e0f80cc47464c2f88be55def5d9cf49', 'request_id': 'req-503d678b-e6c1-47d4-aec3-27b55a26a389'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:25.419525 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-503d678b-e6c1-47d4-aec3-27b55a26a389 admin admin] The token cache is being invalidate because project 8e0f80cc47464c2f88be55def5d9cf49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:25.420123 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-503d678b-e6c1-47d4-aec3-27b55a26a389 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:25.432805 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-503d678b-e6c1-47d4-aec3-27b55a26a389 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:25.435058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 985/1993] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:25 2022] DELETE /identity/v3/projects/8e0f80cc47464c2f88be55def5d9cf49 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:25.439383 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aaf4c7-c571-4058-8e07-f15f2766ea0f service glance] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:25.454490 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aaf4c7-c571-4058-8e07-f15f2766ea0f service glance] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:25.540987 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:25.582538 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1875df-0ea6-4306-8833-732009f6cfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:25.583826 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1875df-0ea6-4306-8833-732009f6cfbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:25.584789 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1875df-0ea6-4306-8833-732009f6cfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:25.585396 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1875df-0ea6-4306-8833-732009f6cfbe admin admin] PATH_INFO: `/v3/users/758a107bb6a4431cbbd139a5e5e03f2f` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:25.587077 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1875df-0ea6-4306-8833-732009f6cfbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=758a107bb6a4431cbbd139a5e5e03f2f)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:25.589899 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1875df-0ea6-4306-8833-732009f6cfbe admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:25.671195 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-af1875df-0ea6-4306-8833-732009f6cfbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '758a107bb6a4431cbbd139a5e5e03f2f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:25.691541 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-af1875df-0ea6-4306-8833-732009f6cfbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '758a107bb6a4431cbbd139a5e5e03f2f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:25.692395 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-af1875df-0ea6-4306-8833-732009f6cfbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '758a107bb6a4431cbbd139a5e5e03f2f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:25.704428 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-af1875df-0ea6-4306-8833-732009f6cfbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '758a107bb6a4431cbbd139a5e5e03f2f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:25.716220 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-af1875df-0ea6-4306-8833-732009f6cfbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '758a107bb6a4431cbbd139a5e5e03f2f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:25.726754 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1009/1994] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:25 2022] DELETE /identity/v3/users/758a107bb6a4431cbbd139a5e5e03f2f => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:25.883581 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d678b-e6c1-47d4-aec3-27b55a26a389 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:25.885055 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-503d678b-e6c1-47d4-aec3-27b55a26a389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:25.906931 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d678b-e6c1-47d4-aec3-27b55a26a389 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:25.919191 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1875df-0ea6-4306-8833-732009f6cfbe admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:25.920732 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-af1875df-0ea6-4306-8833-732009f6cfbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:26.054876 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1875df-0ea6-4306-8833-732009f6cfbe admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:26.056248 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4dd447-2f76-4855-a09f-b5e012f68826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:26.057136 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4dd447-2f76-4855-a09f-b5e012f68826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:26.057410 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4dd447-2f76-4855-a09f-b5e012f68826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:26.057677 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4dd447-2f76-4855-a09f-b5e012f68826 admin admin] PATH_INFO: `/v3/projects/475e71531106402e9240feef372b079f` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:26.063689 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4dd447-2f76-4855-a09f-b5e012f68826 admin admin] RBAC: Authorizing `identity:delete_project(project_id=475e71531106402e9240feef372b079f)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:26.069853 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4dd447-2f76-4855-a09f-b5e012f68826 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:26.074064 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f90302-bc44-4b18-a438-e9d8e75f7333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:26.079019 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f90302-bc44-4b18-a438-e9d8e75f7333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:26.079321 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f90302-bc44-4b18-a438-e9d8e75f7333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:26.079598 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f90302-bc44-4b18-a438-e9d8e75f7333 admin admin] PATH_INFO: `/v3/users/54809c17447b4657b39447d485403f0c` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:26.082846 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f90302-bc44-4b18-a438-e9d8e75f7333 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54809c17447b4657b39447d485403f0c)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:26.084853 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f90302-bc44-4b18-a438-e9d8e75f7333 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:26.218233 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-36f90302-bc44-4b18-a438-e9d8e75f7333 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54809c17447b4657b39447d485403f0c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:26.221085 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-da4dd447-2f76-4855-a09f-b5e012f68826 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '475e71531106402e9240feef372b079f', 'request_id': 'req-da4dd447-2f76-4855-a09f-b5e012f68826'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:26.232854 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-da4dd447-2f76-4855-a09f-b5e012f68826 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '475e71531106402e9240feef372b079f', 'request_id': 'req-da4dd447-2f76-4855-a09f-b5e012f68826'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:26.254114 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:26.255316 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-da4dd447-2f76-4855-a09f-b5e012f68826 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '475e71531106402e9240feef372b079f', 'request_id': 'req-da4dd447-2f76-4855-a09f-b5e012f68826'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:26.257663 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-36f90302-bc44-4b18-a438-e9d8e75f7333 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54809c17447b4657b39447d485403f0c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:26.259444 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-36f90302-bc44-4b18-a438-e9d8e75f7333 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54809c17447b4657b39447d485403f0c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:26.269260 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-36f90302-bc44-4b18-a438-e9d8e75f7333 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54809c17447b4657b39447d485403f0c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:26.271133 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-da4dd447-2f76-4855-a09f-b5e012f68826 admin admin] The token cache is being invalidate because project 475e71531106402e9240feef372b079f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:26.271418 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-da4dd447-2f76-4855-a09f-b5e012f68826 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:26.272087 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-da4dd447-2f76-4855-a09f-b5e012f68826 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:26.273682 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 986/1995] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:25 2022] DELETE /identity/v3/projects/475e71531106402e9240feef372b079f => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:26.274751 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4dd447-2f76-4855-a09f-b5e012f68826 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:26.276168 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-da4dd447-2f76-4855-a09f-b5e012f68826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:26.282435 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-36f90302-bc44-4b18-a438-e9d8e75f7333 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54809c17447b4657b39447d485403f0c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:26.289248 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:26.289902 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1010/1996] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:25 2022] DELETE /identity/v3/users/54809c17447b4657b39447d485403f0c => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:26.291666 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639dd7da-c5c4-4c67-ab55-b68949a12b0a None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:26.292159 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639dd7da-c5c4-4c67-ab55-b68949a12b0a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:26.292573 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639dd7da-c5c4-4c67-ab55-b68949a12b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:26.314321 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-639dd7da-c5c4-4c67-ab55-b68949a12b0a None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:26.315542 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-639dd7da-c5c4-4c67-ab55-b68949a12b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:26.353505 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4dd447-2f76-4855-a09f-b5e012f68826 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:26.380960 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1011/1997] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:26.382393 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386beff5-d03a-4c0e-a03e-fb5b63d8af1f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:26.382682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386beff5-d03a-4c0e-a03e-fb5b63d8af1f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:26.382957 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386beff5-d03a-4c0e-a03e-fb5b63d8af1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:26.402483 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-386beff5-d03a-4c0e-a03e-fb5b63d8af1f None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:26.403747 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-386beff5-d03a-4c0e-a03e-fb5b63d8af1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:26.413290 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1012/1998] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:26.414739 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53574a29-59dd-4192-ba8d-4c5420a598bf None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:26.415026 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53574a29-59dd-4192-ba8d-4c5420a598bf None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:26.415302 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53574a29-59dd-4192-ba8d-4c5420a598bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:26.426458 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90dea5-67d0-49b7-9009-fe16be83e4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:26.427440 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90dea5-67d0-49b7-9009-fe16be83e4df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:26.427779 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90dea5-67d0-49b7-9009-fe16be83e4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:26.428140 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90dea5-67d0-49b7-9009-fe16be83e4df admin admin] PATH_INFO: `/v3/projects/6a060528d94040b196fd505dfa588ded` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:26.429861 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c90dea5-67d0-49b7-9009-fe16be83e4df admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a060528d94040b196fd505dfa588ded)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:26.432083 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c90dea5-67d0-49b7-9009-fe16be83e4df admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:26.434873 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-53574a29-59dd-4192-ba8d-4c5420a598bf None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:26.436114 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-53574a29-59dd-4192-ba8d-4c5420a598bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:26.445680 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1013/1999] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:26.447328 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53574a29-59dd-4192-ba8d-4c5420a598bf None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:26.448919 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-53574a29-59dd-4192-ba8d-4c5420a598bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:26.483718 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6c90dea5-67d0-49b7-9009-fe16be83e4df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a060528d94040b196fd505dfa588ded', 'request_id': 'req-6c90dea5-67d0-49b7-9009-fe16be83e4df'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:26.490247 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6c90dea5-67d0-49b7-9009-fe16be83e4df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a060528d94040b196fd505dfa588ded', 'request_id': 'req-6c90dea5-67d0-49b7-9009-fe16be83e4df'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:26.496901 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6c90dea5-67d0-49b7-9009-fe16be83e4df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a060528d94040b196fd505dfa588ded', 'request_id': 'req-6c90dea5-67d0-49b7-9009-fe16be83e4df'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:26.510423 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6c90dea5-67d0-49b7-9009-fe16be83e4df admin admin] The token cache is being invalidate because project 6a060528d94040b196fd505dfa588ded was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:26.510763 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6c90dea5-67d0-49b7-9009-fe16be83e4df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:26.511409 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6c90dea5-67d0-49b7-9009-fe16be83e4df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:26.511788 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53574a29-59dd-4192-ba8d-4c5420a598bf None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:26.513033 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 987/2000] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:26 2022] DELETE /identity/v3/projects/6a060528d94040b196fd505dfa588ded => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:26.517014 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90dea5-67d0-49b7-9009-fe16be83e4df admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:26.517014 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6c90dea5-67d0-49b7-9009-fe16be83e4df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:26.575124 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6ce09-058d-469f-a502-12fa1cbf4bb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:26.575828 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6ce09-058d-469f-a502-12fa1cbf4bb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:26.576177 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6ce09-058d-469f-a502-12fa1cbf4bb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:26.576474 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6ce09-058d-469f-a502-12fa1cbf4bb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:26.578711 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d9e6ce09-058d-469f-a502-12fa1cbf4bb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:26.578845 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:26.598880 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90dea5-67d0-49b7-9009-fe16be83e4df admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:26.603982 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2148e2-9ffd-4c8c-8f33-51a8e274f5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:26.604657 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2148e2-9ffd-4c8c-8f33-51a8e274f5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:26.604992 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2148e2-9ffd-4c8c-8f33-51a8e274f5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:26.605276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2148e2-9ffd-4c8c-8f33-51a8e274f5c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:26.606068 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2148e2-9ffd-4c8c-8f33-51a8e274f5c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:57:26.606378 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2148e2-9ffd-4c8c-8f33-51a8e274f5c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:26.608022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2148e2-9ffd-4c8c-8f33-51a8e274f5c7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:26.617935 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:26.621704 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 988/2001] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:57:26.623326 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d23065-a7e4-42a7-a179-43681d620500 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:26.623710 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d23065-a7e4-42a7-a179-43681d620500 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:26.624431 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d23065-a7e4-42a7-a179-43681d620500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:26.646205 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c1d23065-a7e4-42a7-a179-43681d620500 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:26.647613 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c1d23065-a7e4-42a7-a179-43681d620500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:26.659905 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 989/2002] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:26.660813 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d23065-a7e4-42a7-a179-43681d620500 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:26.671726 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d23065-a7e4-42a7-a179-43681d620500 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:26.676566 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6ce09-058d-469f-a502-12fa1cbf4bb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:26.676764 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ed196-c606-4be3-be8e-fb2387c58af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:26.677429 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ed196-c606-4be3-be8e-fb2387c58af1 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:26.677708 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ed196-c606-4be3-be8e-fb2387c58af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:26.677980 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ed196-c606-4be3-be8e-fb2387c58af1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:26.678146 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6ce09-058d-469f-a502-12fa1cbf4bb6 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:26.678667 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ed196-c606-4be3-be8e-fb2387c58af1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:26.680838 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ed196-c606-4be3-be8e-fb2387c58af1 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:26.690619 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1014/2003] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:26.692157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9117be-8b57-44f5-92db-4ed109d31359 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:26.692449 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9117be-8b57-44f5-92db-4ed109d31359 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:26.692732 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9117be-8b57-44f5-92db-4ed109d31359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:26.714015 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 990/2004] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:26 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:26.714731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-1d9117be-8b57-44f5-92db-4ed109d31359 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:26.716124 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1d9117be-8b57-44f5-92db-4ed109d31359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:26.718357 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ed196-c606-4be3-be8e-fb2387c58af1 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:26.845893 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ed196-c606-4be3-be8e-fb2387c58af1 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:26.860332 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a158c-3c3e-4c9f-9227-31933794b46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:26.861495 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a158c-3c3e-4c9f-9227-31933794b46c admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:26.862251 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a158c-3c3e-4c9f-9227-31933794b46c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:26.862251 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a158c-3c3e-4c9f-9227-31933794b46c admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:26.863183 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a158c-3c3e-4c9f-9227-31933794b46c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:26.866258 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a158c-3c3e-4c9f-9227-31933794b46c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:26.882226 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1015/2005] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:26.890915 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9117be-8b57-44f5-92db-4ed109d31359 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:26.902012 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 991/2006] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:26 2022] POST /identity/v3/users => generated 292 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:26.906450 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a158c-3c3e-4c9f-9227-31933794b46c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:26.913170 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9117be-8b57-44f5-92db-4ed109d31359 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:26.928328 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff70f8-9b25-47d8-ac78-ffba2df0f83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:26.929133 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff70f8-9b25-47d8-ac78-ffba2df0f83c admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:26.929522 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff70f8-9b25-47d8-ac78-ffba2df0f83c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:26.929949 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff70f8-9b25-47d8-ac78-ffba2df0f83c admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:26.931116 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff70f8-9b25-47d8-ac78-ffba2df0f83c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:57:26.931717 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff70f8-9b25-47d8-ac78-ffba2df0f83c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:26.933411 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff70f8-9b25-47d8-ac78-ffba2df0f83c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:26.953778 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a158c-3c3e-4c9f-9227-31933794b46c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:26.954403 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1016/2007] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:57:26.959302 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff70f8-9b25-47d8-ac78-ffba2df0f83c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:26.963117 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebd26a-cba4-4fbf-8a6c-6d36799cb762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:26.963915 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebd26a-cba4-4fbf-8a6c-6d36799cb762 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:26.964274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebd26a-cba4-4fbf-8a6c-6d36799cb762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:26.964617 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebd26a-cba4-4fbf-8a6c-6d36799cb762 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:26.965417 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ebd26a-cba4-4fbf-8a6c-6d36799cb762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:26.967115 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ebd26a-cba4-4fbf-8a6c-6d36799cb762 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:26.970110 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff70f8-9b25-47d8-ac78-ffba2df0f83c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:26.977119 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41963038-c126-415c-b5a4-17bb25c3371b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:26.977938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41963038-c126-415c-b5a4-17bb25c3371b admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:26.978257 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41963038-c126-415c-b5a4-17bb25c3371b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:26.978545 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41963038-c126-415c-b5a4-17bb25c3371b admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:26.978994 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 992/2008] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:26.980547 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41963038-c126-415c-b5a4-17bb25c3371b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:26.982670 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebd26a-cba4-4fbf-8a6c-6d36799cb762 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:26.982990 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41963038-c126-415c-b5a4-17bb25c3371b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:26.994744 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebd26a-cba4-4fbf-8a6c-6d36799cb762 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:26.999800 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ff33e-b67e-4b88-94ff-3d2099b4a0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:27.000656 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ff33e-b67e-4b88-94ff-3d2099b4a0dd admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:27.000948 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ff33e-b67e-4b88-94ff-3d2099b4a0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:27.001232 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ff33e-b67e-4b88-94ff-3d2099b4a0dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:27.001971 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ff33e-b67e-4b88-94ff-3d2099b4a0dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:27.003692 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ff33e-b67e-4b88-94ff-3d2099b4a0dd admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:27.016357 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 993/2009] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:57:27.022588 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1017/2010] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:26 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:27.022732 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ff33e-b67e-4b88-94ff-3d2099b4a0dd admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:27.023856 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41963038-c126-415c-b5a4-17bb25c3371b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:27.032491 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ff33e-b67e-4b88-94ff-3d2099b4a0dd admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:27.123488 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf53e93-780f-4079-aaed-18c2510f9440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:27.125432 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf53e93-780f-4079-aaed-18c2510f9440 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:27.125776 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf53e93-780f-4079-aaed-18c2510f9440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:27.126371 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf53e93-780f-4079-aaed-18c2510f9440 admin admin] PATH_INFO: `/v3/projects/8156c04aa1314508a840ba350e2a1a13/users/acad8c96446549e3b82b0e719ac92440/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:27.145541 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41963038-c126-415c-b5a4-17bb25c3371b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:27.161732 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df5f19-475b-40f0-99ed-69374ab0235c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:27.163460 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df5f19-475b-40f0-99ed-69374ab0235c admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:27.164236 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df5f19-475b-40f0-99ed-69374ab0235c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:27.164728 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df5f19-475b-40f0-99ed-69374ab0235c admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:27.165526 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df5f19-475b-40f0-99ed-69374ab0235c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:27.169225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df5f19-475b-40f0-99ed-69374ab0235c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:27.175626 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf53e93-780f-4079-aaed-18c2510f9440 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8156c04aa1314508a840ba350e2a1a13, user_id=acad8c96446549e3b82b0e719ac92440, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:27.178513 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf53e93-780f-4079-aaed-18c2510f9440 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:27.209891 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 994/2011] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:27 2022] PUT /identity/v3/projects/8156c04aa1314508a840ba350e2a1a13/users/acad8c96446549e3b82b0e719ac92440/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:27.210112 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1018/2012] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:27 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:57:27.211586 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c4be3-328a-4026-ad34-9a2012950c9b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:27.213203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df5f19-475b-40f0-99ed-69374ab0235c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:27.213800 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c4be3-328a-4026-ad34-9a2012950c9b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:27.214536 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c4be3-328a-4026-ad34-9a2012950c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:27.236588 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:27.236709 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df5f19-475b-40f0-99ed-69374ab0235c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:27.245470 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-6a1c4be3-328a-4026-ad34-9a2012950c9b None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:27.246878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6a1c4be3-328a-4026-ad34-9a2012950c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:27.285128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:27.368879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4d9be-a2d8-4bcd-9d5c-ed2ed8884284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:27.368879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4d9be-a2d8-4bcd-9d5c-ed2ed8884284 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:27.368879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4d9be-a2d8-4bcd-9d5c-ed2ed8884284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:27.368879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4d9be-a2d8-4bcd-9d5c-ed2ed8884284 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:27.369312 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4d9be-a2d8-4bcd-9d5c-ed2ed8884284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:27.370718 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4d9be-a2d8-4bcd-9d5c-ed2ed8884284 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:27.381812 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1019/2013] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:27.382817 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4d9be-a2d8-4bcd-9d5c-ed2ed8884284 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:27.384746 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-33e4d9be-a2d8-4bcd-9d5c-ed2ed8884284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:27.400523 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4d9be-a2d8-4bcd-9d5c-ed2ed8884284 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:27.405215 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30946419-a5e4-4a46-bc90-b243a8c332e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:27.406209 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30946419-a5e4-4a46-bc90-b243a8c332e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:27.406584 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30946419-a5e4-4a46-bc90-b243a8c332e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:27.406874 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30946419-a5e4-4a46-bc90-b243a8c332e5 admin admin] PATH_INFO: `/v3/projects/703d6cd6f06644dd86e12338085b8c34` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:27.408146 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30946419-a5e4-4a46-bc90-b243a8c332e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=703d6cd6f06644dd86e12338085b8c34)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:27.410084 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30946419-a5e4-4a46-bc90-b243a8c332e5 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:27.413319 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 995/2014] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:27.414000 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c4be3-328a-4026-ad34-9a2012950c9b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:27.428956 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c4be3-328a-4026-ad34-9a2012950c9b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:27.434684 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57d1aa-dfa9-48ea-97b2-5f68e6c20387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:27.436712 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57d1aa-dfa9-48ea-97b2-5f68e6c20387 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:27.436712 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57d1aa-dfa9-48ea-97b2-5f68e6c20387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:27.436712 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57d1aa-dfa9-48ea-97b2-5f68e6c20387 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:27.436712 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57d1aa-dfa9-48ea-97b2-5f68e6c20387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:27.438630 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57d1aa-dfa9-48ea-97b2-5f68e6c20387 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:27.467060 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 996/2015] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:27.468003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57d1aa-dfa9-48ea-97b2-5f68e6c20387 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:27.471820 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2f57d1aa-dfa9-48ea-97b2-5f68e6c20387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:27.499105 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-30946419-a5e4-4a46-bc90-b243a8c332e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '703d6cd6f06644dd86e12338085b8c34', 'request_id': 'req-30946419-a5e4-4a46-bc90-b243a8c332e5'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:27.506566 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-30946419-a5e4-4a46-bc90-b243a8c332e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '703d6cd6f06644dd86e12338085b8c34', 'request_id': 'req-30946419-a5e4-4a46-bc90-b243a8c332e5'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:27.516035 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-30946419-a5e4-4a46-bc90-b243a8c332e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '703d6cd6f06644dd86e12338085b8c34', 'request_id': 'req-30946419-a5e4-4a46-bc90-b243a8c332e5'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:27.534312 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-30946419-a5e4-4a46-bc90-b243a8c332e5 admin admin] The token cache is being invalidate because project 703d6cd6f06644dd86e12338085b8c34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:27.534503 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-30946419-a5e4-4a46-bc90-b243a8c332e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:27.535197 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-30946419-a5e4-4a46-bc90-b243a8c332e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:27.537342 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1020/2016] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:27 2022] DELETE /identity/v3/projects/703d6cd6f06644dd86e12338085b8c34 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:27.538085 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30946419-a5e4-4a46-bc90-b243a8c332e5 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:27.539799 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-30946419-a5e4-4a46-bc90-b243a8c332e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:27.580103 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57d1aa-dfa9-48ea-97b2-5f68e6c20387 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:27.628255 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30946419-a5e4-4a46-bc90-b243a8c332e5 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:27.633859 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa9ccd-7e0c-4f4a-a79f-19994089d52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:27.634754 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa9ccd-7e0c-4f4a-a79f-19994089d52b admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:27.635027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa9ccd-7e0c-4f4a-a79f-19994089d52b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:27.635295 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa9ccd-7e0c-4f4a-a79f-19994089d52b admin admin] PATH_INFO: `/v3/projects/ee2b1d60c50f4f709104417ee275ef78/users/2d22f8f4d79043cf88b792a1ac9dd2cc/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:27.641100 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d0fc9-0dfe-4a1b-8159-2137db5089c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:27.641763 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d0fc9-0dfe-4a1b-8159-2137db5089c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:27.642049 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d0fc9-0dfe-4a1b-8159-2137db5089c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:27.642327 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d0fc9-0dfe-4a1b-8159-2137db5089c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:27.644184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ce4d0fc9-0dfe-4a1b-8159-2137db5089c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:27.652207 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa9ccd-7e0c-4f4a-a79f-19994089d52b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee2b1d60c50f4f709104417ee275ef78, user_id=2d22f8f4d79043cf88b792a1ac9dd2cc, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:27.655136 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa9ccd-7e0c-4f4a-a79f-19994089d52b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:27.657111 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d0fc9-0dfe-4a1b-8159-2137db5089c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:27.658542 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d0fc9-0dfe-4a1b-8159-2137db5089c3 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:27.669603 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 997/2017] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:27.670372 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d0fc9-0dfe-4a1b-8159-2137db5089c3 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:27.672663 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1021/2018] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:27 2022] PUT /identity/v3/projects/ee2b1d60c50f4f709104417ee275ef78/users/2d22f8f4d79043cf88b792a1ac9dd2cc/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:27.672797 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ce4d0fc9-0dfe-4a1b-8159-2137db5089c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:27.682099 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4d3ab-3375-4542-8bda-b28104542a20 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:27.682518 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4d3ab-3375-4542-8bda-b28104542a20 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:27.682670 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4d3ab-3375-4542-8bda-b28104542a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:27.689018 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d0fc9-0dfe-4a1b-8159-2137db5089c3 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:27.716922 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-67c4d3ab-3375-4542-8bda-b28104542a20 None None] MFA Rules not processed for user `2d22f8f4d79043cf88b792a1ac9dd2cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:27.719836 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-67c4d3ab-3375-4542-8bda-b28104542a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:27.741420 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:27.748163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:27.767596 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad8759-a87f-419b-889f-d27653292014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:27.768531 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad8759-a87f-419b-889f-d27653292014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:27.768806 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad8759-a87f-419b-889f-d27653292014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:27.769077 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad8759-a87f-419b-889f-d27653292014 admin admin] PATH_INFO: `/v3/users/feb7286dccdd4520886e4bd1be55bb5c` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:27.770310 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad8759-a87f-419b-889f-d27653292014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=feb7286dccdd4520886e4bd1be55bb5c)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:27.772285 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad8759-a87f-419b-889f-d27653292014 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:27.805552 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1022/2019] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:57:27.810038 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4d3ab-3375-4542-8bda-b28104542a20 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:27.821590 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4d3ab-3375-4542-8bda-b28104542a20 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:27.827140 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b34426-4091-46d6-8565-6065df0d95e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:27.827831 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b34426-4091-46d6-8565-6065df0d95e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:27.828238 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b34426-4091-46d6-8565-6065df0d95e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:27.828415 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b34426-4091-46d6-8565-6065df0d95e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:27.829116 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b34426-4091-46d6-8565-6065df0d95e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:27.831032 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b34426-4091-46d6-8565-6065df0d95e2 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:27.842250 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0bad8759-a87f-419b-889f-d27653292014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feb7286dccdd4520886e4bd1be55bb5c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:27.852831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0bad8759-a87f-419b-889f-d27653292014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feb7286dccdd4520886e4bd1be55bb5c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:27.862846 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0bad8759-a87f-419b-889f-d27653292014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feb7286dccdd4520886e4bd1be55bb5c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:27.874636 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1023/2020] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:27 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:27.878797 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b34426-4091-46d6-8565-6065df0d95e2 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:27.881532 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0bad8759-a87f-419b-889f-d27653292014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feb7286dccdd4520886e4bd1be55bb5c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:27.882251 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0bad8759-a87f-419b-889f-d27653292014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feb7286dccdd4520886e4bd1be55bb5c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:27.891891 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 998/2021] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:27 2022] DELETE /identity/v3/users/feb7286dccdd4520886e4bd1be55bb5c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:27.976037 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b34426-4091-46d6-8565-6065df0d95e2 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:28.060487 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a6e8c-5de3-4214-ad88-0b39367b8caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:28.061187 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a6e8c-5de3-4214-ad88-0b39367b8caf admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:28.061547 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a6e8c-5de3-4214-ad88-0b39367b8caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:28.061930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a6e8c-5de3-4214-ad88-0b39367b8caf admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:28.063122 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a6e8c-5de3-4214-ad88-0b39367b8caf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:28.065305 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a6e8c-5de3-4214-ad88-0b39367b8caf admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:28.093586 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1024/2022] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:27 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:57:28.095197 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad8759-a87f-419b-889f-d27653292014 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:28.097676 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0bad8759-a87f-419b-889f-d27653292014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:28.114432 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad8759-a87f-419b-889f-d27653292014 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:28.121146 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b7edb-5f83-4d6b-951c-27758432da76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:28.122636 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b7edb-5f83-4d6b-951c-27758432da76 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:28.123155 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b7edb-5f83-4d6b-951c-27758432da76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:28.125324 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b7edb-5f83-4d6b-951c-27758432da76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:28.127324 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627b7edb-5f83-4d6b-951c-27758432da76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:28.129501 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627b7edb-5f83-4d6b-951c-27758432da76 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:28.148136 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 999/2023] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:28.151112 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a6e8c-5de3-4214-ad88-0b39367b8caf admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:28.166160 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a6e8c-5de3-4214-ad88-0b39367b8caf admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:28.195362 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e467c-2822-41d1-8604-d0b48e87d68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:28.196682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e467c-2822-41d1-8604-d0b48e87d68b admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:28.197768 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e467c-2822-41d1-8604-d0b48e87d68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:28.199420 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e467c-2822-41d1-8604-d0b48e87d68b admin admin] PATH_INFO: `/v3/projects/f49056467f6d442e81bd52aa8533ce0b/users/6dfb02efcc654bf38b7ab768db3f83cc/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:28.252037 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e467c-2822-41d1-8604-d0b48e87d68b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f49056467f6d442e81bd52aa8533ce0b, user_id=6dfb02efcc654bf38b7ab768db3f83cc, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:28.255426 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e467c-2822-41d1-8604-d0b48e87d68b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:28.256102 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b7edb-5f83-4d6b-951c-27758432da76 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:28.257887 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-627b7edb-5f83-4d6b-951c-27758432da76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:28.286705 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1025/2024] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:28 2022] PUT /identity/v3/projects/f49056467f6d442e81bd52aa8533ce0b/users/6dfb02efcc654bf38b7ab768db3f83cc/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:28.289859 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e467c-2822-41d1-8604-d0b48e87d68b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:28.291640 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b7edb-5f83-4d6b-951c-27758432da76 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:28.306604 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:28.412976 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e467c-2822-41d1-8604-d0b48e87d68b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:28.427859 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03ff7b-18f3-474f-84cd-1bec4551ba36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:28.428588 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03ff7b-18f3-474f-84cd-1bec4551ba36 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:28.428868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03ff7b-18f3-474f-84cd-1bec4551ba36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:28.429140 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03ff7b-18f3-474f-84cd-1bec4551ba36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:28.429870 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b03ff7b-18f3-474f-84cd-1bec4551ba36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:28.431482 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b03ff7b-18f3-474f-84cd-1bec4551ba36 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:28.439780 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad618dd-3aad-44ff-8333-f6db5ab3a19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:28.440673 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad618dd-3aad-44ff-8333-f6db5ab3a19c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:28.441960 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad618dd-3aad-44ff-8333-f6db5ab3a19c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:28.441960 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad618dd-3aad-44ff-8333-f6db5ab3a19c admin admin] PATH_INFO: `/v3/projects/40e7177dbfa94c50bbf71b99fd711d25` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:28.443145 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad618dd-3aad-44ff-8333-f6db5ab3a19c admin admin] RBAC: Authorizing `identity:delete_project(project_id=40e7177dbfa94c50bbf71b99fd711d25)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:28.445582 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad618dd-3aad-44ff-8333-f6db5ab3a19c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:28.450773 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1026/2025] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:28.455312 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03ff7b-18f3-474f-84cd-1bec4551ba36 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:28.469526 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03ff7b-18f3-474f-84cd-1bec4551ba36 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:28.474981 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc23047-d2a4-4beb-a810-57c2dc36d72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:28.475925 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc23047-d2a4-4beb-a810-57c2dc36d72f admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:28.476238 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc23047-d2a4-4beb-a810-57c2dc36d72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:28.476456 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc23047-d2a4-4beb-a810-57c2dc36d72f admin admin] PATH_INFO: `/v3/projects/f49056467f6d442e81bd52aa8533ce0b/users/6dfb02efcc654bf38b7ab768db3f83cc/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:28.479581 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc23047-d2a4-4beb-a810-57c2dc36d72f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f49056467f6d442e81bd52aa8533ce0b, user_id=6dfb02efcc654bf38b7ab768db3f83cc, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:28.482348 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc23047-d2a4-4beb-a810-57c2dc36d72f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:28.500054 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1027/2026] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:28 2022] PUT /identity/v3/projects/f49056467f6d442e81bd52aa8533ce0b/users/6dfb02efcc654bf38b7ab768db3f83cc/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:28.539086 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12084ea3-3469-4ace-89d8-97a4ccc5ffca None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:28.539086 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12084ea3-3469-4ace-89d8-97a4ccc5ffca None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:28.539086 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12084ea3-3469-4ace-89d8-97a4ccc5ffca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:28.539473 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4ad618dd-3aad-44ff-8333-f6db5ab3a19c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40e7177dbfa94c50bbf71b99fd711d25', 'request_id': 'req-4ad618dd-3aad-44ff-8333-f6db5ab3a19c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:28.546559 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4ad618dd-3aad-44ff-8333-f6db5ab3a19c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40e7177dbfa94c50bbf71b99fd711d25', 'request_id': 'req-4ad618dd-3aad-44ff-8333-f6db5ab3a19c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:28.561545 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4ad618dd-3aad-44ff-8333-f6db5ab3a19c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40e7177dbfa94c50bbf71b99fd711d25', 'request_id': 'req-4ad618dd-3aad-44ff-8333-f6db5ab3a19c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:28.571267 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:28.600814 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4ad618dd-3aad-44ff-8333-f6db5ab3a19c admin admin] The token cache is being invalidate because project 40e7177dbfa94c50bbf71b99fd711d25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:28.601147 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4ad618dd-3aad-44ff-8333-f6db5ab3a19c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:28.601934 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4ad618dd-3aad-44ff-8333-f6db5ab3a19c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:28.605528 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1000/2027] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:28 2022] DELETE /identity/v3/projects/40e7177dbfa94c50bbf71b99fd711d25 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:28.614942 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de61720-e8f6-40d1-a87b-e188733882e3 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:28.615414 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de61720-e8f6-40d1-a87b-e188733882e3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:28.615793 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de61720-e8f6-40d1-a87b-e188733882e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:28.624412 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-12084ea3-3469-4ace-89d8-97a4ccc5ffca None None] MFA Rules not processed for user `6dfb02efcc654bf38b7ab768db3f83cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:28.626437 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-12084ea3-3469-4ace-89d8-97a4ccc5ffca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:28.650151 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-7de61720-e8f6-40d1-a87b-e188733882e3 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:28.653612 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7de61720-e8f6-40d1-a87b-e188733882e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:28.794900 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1028/2028] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:28 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:28.797159 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d554b-9a2c-4f83-b75d-d70483ba86dc None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:28.800106 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d554b-9a2c-4f83-b75d-d70483ba86dc None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:28.800739 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d554b-9a2c-4f83-b75d-d70483ba86dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:28.801363 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1001/2029] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:28.808423 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de61720-e8f6-40d1-a87b-e188733882e3 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:28.817959 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7de61720-e8f6-40d1-a87b-e188733882e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:28.873840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-414d554b-9a2c-4f83-b75d-d70483ba86dc None None] MFA Rules not processed for user `acad8c96446549e3b82b0e719ac92440`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:28.875764 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-414d554b-9a2c-4f83-b75d-d70483ba86dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:28.906505 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de61720-e8f6-40d1-a87b-e188733882e3 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:28.913371 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc8837-efba-4383-bee8-ff9983dc0d66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:28.930105 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc8837-efba-4383-bee8-ff9983dc0d66 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:28.930639 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc8837-efba-4383-bee8-ff9983dc0d66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:28.931115 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc8837-efba-4383-bee8-ff9983dc0d66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:28.947448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc8837-efba-4383-bee8-ff9983dc0d66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:28.949064 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc8837-efba-4383-bee8-ff9983dc0d66 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:28.964618 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1002/2030] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:28 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:28.966668 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8ff17-5c9c-4144-adc6-9b87651106e2 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:28.966959 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8ff17-5c9c-4144-adc6-9b87651106e2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:28.967234 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8ff17-5c9c-4144-adc6-9b87651106e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:28.995058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-12c8ff17-5c9c-4144-adc6-9b87651106e2 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:28.997507 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-12c8ff17-5c9c-4144-adc6-9b87651106e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:28.999272 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1029/2031] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:29.009404 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1003/2032] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:29.015804 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8ff17-5c9c-4144-adc6-9b87651106e2 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:29.016135 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d554b-9a2c-4f83-b75d-d70483ba86dc None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:29.017659 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-414d554b-9a2c-4f83-b75d-d70483ba86dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:29.037629 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8ff17-5c9c-4144-adc6-9b87651106e2 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:29.050388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d554b-9a2c-4f83-b75d-d70483ba86dc None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:29.053248 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc4bd3-3acb-488a-a537-79ec1823b83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:29.053747 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb29f1b-057a-44ec-b4ca-18d9a091235f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:29.053859 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc4bd3-3acb-488a-a537-79ec1823b83f admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:29.054174 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc4bd3-3acb-488a-a537-79ec1823b83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:29.054457 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc4bd3-3acb-488a-a537-79ec1823b83f admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:29.055384 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc4bd3-3acb-488a-a537-79ec1823b83f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:57:29.055927 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc4bd3-3acb-488a-a537-79ec1823b83f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:29.056420 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb29f1b-057a-44ec-b4ca-18d9a091235f service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:29.056717 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb29f1b-057a-44ec-b4ca-18d9a091235f service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:29.056996 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb29f1b-057a-44ec-b4ca-18d9a091235f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:29.058196 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc4bd3-3acb-488a-a537-79ec1823b83f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:29.076972 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:29.088376 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb29f1b-057a-44ec-b4ca-18d9a091235f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:29.090207 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb29f1b-057a-44ec-b4ca-18d9a091235f service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:29.103715 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1004/2033] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:57:29.105480 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc4bd3-3acb-488a-a537-79ec1823b83f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:29.105602 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1030/2034] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:29.125292 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc4bd3-3acb-488a-a537-79ec1823b83f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:29.129018 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4741be-2681-4652-87ab-17ed02e5108a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:29.130743 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4741be-2681-4652-87ab-17ed02e5108a admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:29.131088 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4741be-2681-4652-87ab-17ed02e5108a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:29.131385 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4741be-2681-4652-87ab-17ed02e5108a admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:29.132227 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4741be-2681-4652-87ab-17ed02e5108a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:29.134342 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4741be-2681-4652-87ab-17ed02e5108a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:29.178276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1005/2035] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:29 2022] POST /identity/v3/projects => generated 367 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:29.182465 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb29f1b-057a-44ec-b4ca-18d9a091235f service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:29.195806 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb29f1b-057a-44ec-b4ca-18d9a091235f service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:29.274645 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099927c-20fc-451d-8773-8f0eb570c423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:29.276542 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099927c-20fc-451d-8773-8f0eb570c423 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:29.277830 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099927c-20fc-451d-8773-8f0eb570c423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:29.278452 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099927c-20fc-451d-8773-8f0eb570c423 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:29.279448 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099927c-20fc-451d-8773-8f0eb570c423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:29.282592 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099927c-20fc-451d-8773-8f0eb570c423 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:29.313567 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1031/2036] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:29 2022] POST /identity/v3/users => generated 284 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:29.318046 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4741be-2681-4652-87ab-17ed02e5108a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:29.336104 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4741be-2681-4652-87ab-17ed02e5108a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:29.341487 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a5601-5571-45bc-9365-23473159e648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:29.342146 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a5601-5571-45bc-9365-23473159e648 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:29.342604 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a5601-5571-45bc-9365-23473159e648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:29.342932 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a5601-5571-45bc-9365-23473159e648 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:29.343695 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a5601-5571-45bc-9365-23473159e648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:29.345502 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a5601-5571-45bc-9365-23473159e648 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:29.357712 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1006/2037] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:29.363418 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099927c-20fc-451d-8773-8f0eb570c423 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:29.377477 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099927c-20fc-451d-8773-8f0eb570c423 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:29.383748 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068fc89-253d-4f80-80ce-94fa4619b37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:29.384498 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068fc89-253d-4f80-80ce-94fa4619b37b admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:29.384835 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068fc89-253d-4f80-80ce-94fa4619b37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:29.385112 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068fc89-253d-4f80-80ce-94fa4619b37b admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:29.385891 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068fc89-253d-4f80-80ce-94fa4619b37b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:29.388050 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068fc89-253d-4f80-80ce-94fa4619b37b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:29.403911 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1032/2038] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:29.406787 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a5601-5571-45bc-9365-23473159e648 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:29.421159 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a5601-5571-45bc-9365-23473159e648 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:29.428169 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2414b0-73bb-4e2f-b000-9abc113bba3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:29.429089 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2414b0-73bb-4e2f-b000-9abc113bba3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:29.429375 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2414b0-73bb-4e2f-b000-9abc113bba3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:29.429656 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2414b0-73bb-4e2f-b000-9abc113bba3c admin admin] PATH_INFO: `/v3/projects/9ccc17728ab949849fbcb09fc2917e34/users/23a2ca7697574c1abed88818c03df518/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:29.458007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2414b0-73bb-4e2f-b000-9abc113bba3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ccc17728ab949849fbcb09fc2917e34, user_id=23a2ca7697574c1abed88818c03df518, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:29.480469 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2414b0-73bb-4e2f-b000-9abc113bba3c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:29.502998 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1007/2039] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:29 2022] PUT /identity/v3/projects/9ccc17728ab949849fbcb09fc2917e34/users/23a2ca7697574c1abed88818c03df518/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:29.514813 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cea62-d86e-4029-93e7-829ace7006ea None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:29.515480 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cea62-d86e-4029-93e7-829ace7006ea None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:29.515480 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cea62-d86e-4029-93e7-829ace7006ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:29.536142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2414b0-73bb-4e2f-b000-9abc113bba3c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:29.538276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8d2414b0-73bb-4e2f-b000-9abc113bba3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:29.578677 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:29.605628 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-da8cea62-d86e-4029-93e7-829ace7006ea None None] MFA Rules not processed for user `23a2ca7697574c1abed88818c03df518`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:29.608644 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-da8cea62-d86e-4029-93e7-829ace7006ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:29.709949 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2414b0-73bb-4e2f-b000-9abc113bba3c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:29.716053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901f106-4399-4e66-80d2-ccbf0d01e8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:29.716954 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901f106-4399-4e66-80d2-ccbf0d01e8a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:29.717232 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901f106-4399-4e66-80d2-ccbf0d01e8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:29.717501 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901f106-4399-4e66-80d2-ccbf0d01e8a2 admin admin] PATH_INFO: `/v3/users/2d22f8f4d79043cf88b792a1ac9dd2cc` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:29.718787 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e901f106-4399-4e66-80d2-ccbf0d01e8a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d22f8f4d79043cf88b792a1ac9dd2cc)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:29.720910 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e901f106-4399-4e66-80d2-ccbf0d01e8a2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:29.749749 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1033/2040] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:29 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:29.754975 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8cea62-d86e-4029-93e7-829ace7006ea None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:29.771145 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8cea62-d86e-4029-93e7-829ace7006ea None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:29.777306 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd949e-ca55-42a2-90f4-87cb52bbfab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:29.778602 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd949e-ca55-42a2-90f4-87cb52bbfab4 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:29.779008 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd949e-ca55-42a2-90f4-87cb52bbfab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:29.779287 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd949e-ca55-42a2-90f4-87cb52bbfab4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:29.780079 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd949e-ca55-42a2-90f4-87cb52bbfab4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:29.782485 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd949e-ca55-42a2-90f4-87cb52bbfab4 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:29.783230 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e901f106-4399-4e66-80d2-ccbf0d01e8a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d22f8f4d79043cf88b792a1ac9dd2cc'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:29.793276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e901f106-4399-4e66-80d2-ccbf0d01e8a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d22f8f4d79043cf88b792a1ac9dd2cc'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:29.805146 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e901f106-4399-4e66-80d2-ccbf0d01e8a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d22f8f4d79043cf88b792a1ac9dd2cc'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:29.821167 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e901f106-4399-4e66-80d2-ccbf0d01e8a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d22f8f4d79043cf88b792a1ac9dd2cc'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:29.821520 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1034/2041] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:29 2022] POST /identity/v3/projects => generated 367 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:57:29.822195 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e901f106-4399-4e66-80d2-ccbf0d01e8a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d22f8f4d79043cf88b792a1ac9dd2cc'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:29.825923 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd949e-ca55-42a2-90f4-87cb52bbfab4 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:29.828463 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-bdbd949e-ca55-42a2-90f4-87cb52bbfab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:29.838859 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1008/2042] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:29 2022] DELETE /identity/v3/users/2d22f8f4d79043cf88b792a1ac9dd2cc => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:29.841477 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9a243-ba31-42b6-aede-2dadcc8f07d2 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:29.842399 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9a243-ba31-42b6-aede-2dadcc8f07d2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:29.842652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9a243-ba31-42b6-aede-2dadcc8f07d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:29.866383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f4d9a243-ba31-42b6-aede-2dadcc8f07d2 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:29.867623 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f4d9a243-ba31-42b6-aede-2dadcc8f07d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:29.895129 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:29.931045 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd949e-ca55-42a2-90f4-87cb52bbfab4 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:29.952782 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1009/2043] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:29.964427 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9a243-ba31-42b6-aede-2dadcc8f07d2 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:29.966761 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f4d9a243-ba31-42b6-aede-2dadcc8f07d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:29.999423 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58afb49-22ed-4cfc-b2a8-90a369535847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:30.000144 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58afb49-22ed-4cfc-b2a8-90a369535847 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:30.001192 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58afb49-22ed-4cfc-b2a8-90a369535847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:30.001479 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58afb49-22ed-4cfc-b2a8-90a369535847 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:30.002949 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58afb49-22ed-4cfc-b2a8-90a369535847 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:30.005202 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58afb49-22ed-4cfc-b2a8-90a369535847 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:30.021755 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:30.028901 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1035/2044] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:29 2022] POST /identity/v3/users => generated 290 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:57:30.033003 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58afb49-22ed-4cfc-b2a8-90a369535847 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:30.043953 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58afb49-22ed-4cfc-b2a8-90a369535847 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:30.049167 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9a243-ba31-42b6-aede-2dadcc8f07d2 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:30.049537 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a8965-c4cb-40b6-a1af-b306d0c5bbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:30.050208 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a8965-c4cb-40b6-a1af-b306d0c5bbe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:30.050495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a8965-c4cb-40b6-a1af-b306d0c5bbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:30.050871 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a8965-c4cb-40b6-a1af-b306d0c5bbe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:30.051597 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a8965-c4cb-40b6-a1af-b306d0c5bbe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:30.053237 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a8965-c4cb-40b6-a1af-b306d0c5bbe6 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:30.055138 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618b893-9625-4c02-99bf-4d3c33c5679a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:30.055919 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618b893-9625-4c02-99bf-4d3c33c5679a service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:30.065844 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1036/2045] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:57:30.067663 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618b893-9625-4c02-99bf-4d3c33c5679a service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:30.068006 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618b893-9625-4c02-99bf-4d3c33c5679a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:30.070271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a8965-c4cb-40b6-a1af-b306d0c5bbe6 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:30.085218 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a8965-c4cb-40b6-a1af-b306d0c5bbe6 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:30.090958 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315775d-ffb8-44a0-a954-c44683ee43d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:30.096775 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315775d-ffb8-44a0-a954-c44683ee43d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:30.096775 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315775d-ffb8-44a0-a954-c44683ee43d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:30.096775 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315775d-ffb8-44a0-a954-c44683ee43d5 admin admin] PATH_INFO: `/v3/projects/8f124996b0804b75b333c96f6a97b496/users/1be9972623684679a2635f3c1347d9e1/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:30.099102 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618b893-9625-4c02-99bf-4d3c33c5679a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:30.100418 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618b893-9625-4c02-99bf-4d3c33c5679a service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:30.120005 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1010/2046] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:57:30.151351 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c315775d-ffb8-44a0-a954-c44683ee43d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f124996b0804b75b333c96f6a97b496, user_id=1be9972623684679a2635f3c1347d9e1, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:30.159049 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c315775d-ffb8-44a0-a954-c44683ee43d5 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:30.192844 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1037/2047] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:30 2022] PUT /identity/v3/projects/8f124996b0804b75b333c96f6a97b496/users/1be9972623684679a2635f3c1347d9e1/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:30.193767 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618b893-9625-4c02-99bf-4d3c33c5679a service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:30.208513 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618b893-9625-4c02-99bf-4d3c33c5679a service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:30.334077 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d75294-34c3-4fc1-8015-7167c47139f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:30.334947 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d75294-34c3-4fc1-8015-7167c47139f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:30.335242 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d75294-34c3-4fc1-8015-7167c47139f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:30.335522 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d75294-34c3-4fc1-8015-7167c47139f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:30.337557 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d75294-34c3-4fc1-8015-7167c47139f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:30.342440 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d75294-34c3-4fc1-8015-7167c47139f5 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:30.370855 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1011/2048] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:57:30.373277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315775d-ffb8-44a0-a954-c44683ee43d5 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:30.386684 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315775d-ffb8-44a0-a954-c44683ee43d5 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:30.392888 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f703b-6c41-4db1-8acd-b79a481788a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:30.394238 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f703b-6c41-4db1-8acd-b79a481788a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:30.394718 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f703b-6c41-4db1-8acd-b79a481788a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:30.395176 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f703b-6c41-4db1-8acd-b79a481788a6 admin admin] PATH_INFO: `/v3/projects/8f124996b0804b75b333c96f6a97b496/users/1be9972623684679a2635f3c1347d9e1/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:30.397963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f703b-6c41-4db1-8acd-b79a481788a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f124996b0804b75b333c96f6a97b496, user_id=1be9972623684679a2635f3c1347d9e1, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:30.401582 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f703b-6c41-4db1-8acd-b79a481788a6 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:30.431535 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1038/2049] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:30 2022] PUT /identity/v3/projects/8f124996b0804b75b333c96f6a97b496/users/1be9972623684679a2635f3c1347d9e1/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:30.444661 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c74608-c445-4f9f-9e1f-a89e095117fe None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:30.445027 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c74608-c445-4f9f-9e1f-a89e095117fe None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:30.445398 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c74608-c445-4f9f-9e1f-a89e095117fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:30.483077 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e3c74608-c445-4f9f-9e1f-a89e095117fe None None] MFA Rules not processed for user `1be9972623684679a2635f3c1347d9e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:30.484699 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e3c74608-c445-4f9f-9e1f-a89e095117fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:30.577894 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1012/2050] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:30 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:30.581251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f703b-6c41-4db1-8acd-b79a481788a6 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:30.583105 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6e5f703b-6c41-4db1-8acd-b79a481788a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:30.591754 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c74608-c445-4f9f-9e1f-a89e095117fe None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:30.593552 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e3c74608-c445-4f9f-9e1f-a89e095117fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:30.687275 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c74608-c445-4f9f-9e1f-a89e095117fe None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:30.692101 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a43b2f-f9e8-4dac-ac7a-26089f3b5e94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:30.692922 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a43b2f-f9e8-4dac-ac7a-26089f3b5e94 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:30.693228 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a43b2f-f9e8-4dac-ac7a-26089f3b5e94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:30.693507 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a43b2f-f9e8-4dac-ac7a-26089f3b5e94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:30.698473 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f703b-6c41-4db1-8acd-b79a481788a6 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:30.703523 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b4396-3f1a-46b4-83cf-1e79d561b508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:30.704612 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b4396-3f1a-46b4-83cf-1e79d561b508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:30.704904 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a43b2f-f9e8-4dac-ac7a-26089f3b5e94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:30.705014 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b4396-3f1a-46b4-83cf-1e79d561b508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:30.705446 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b4396-3f1a-46b4-83cf-1e79d561b508 admin admin] PATH_INFO: `/v3/projects/ee2b1d60c50f4f709104417ee275ef78` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:30.706383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a43b2f-f9e8-4dac-ac7a-26089f3b5e94 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:30.706803 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b4396-3f1a-46b4-83cf-1e79d561b508 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee2b1d60c50f4f709104417ee275ef78)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:30.708970 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b4396-3f1a-46b4-83cf-1e79d561b508 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:30.718113 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1013/2051] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:30 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:30.730686 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a10c6d-9768-4e2a-8966-be1a42335621 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:30.730986 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a10c6d-9768-4e2a-8966-be1a42335621 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:30.731268 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a10c6d-9768-4e2a-8966-be1a42335621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:30.743800 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:30.758290 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:30.770323 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-32a10c6d-9768-4e2a-8966-be1a42335621 None None] MFA Rules not processed for user `acad8c96446549e3b82b0e719ac92440`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:30.771820 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-32a10c6d-9768-4e2a-8966-be1a42335621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:30.781027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-f02b4396-3f1a-46b4-83cf-1e79d561b508 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee2b1d60c50f4f709104417ee275ef78', 'request_id': 'req-f02b4396-3f1a-46b4-83cf-1e79d561b508'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:30.789839 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-f02b4396-3f1a-46b4-83cf-1e79d561b508 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee2b1d60c50f4f709104417ee275ef78', 'request_id': 'req-f02b4396-3f1a-46b4-83cf-1e79d561b508'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:30.798420 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-f02b4396-3f1a-46b4-83cf-1e79d561b508 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee2b1d60c50f4f709104417ee275ef78', 'request_id': 'req-f02b4396-3f1a-46b4-83cf-1e79d561b508'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:30.817090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-f02b4396-3f1a-46b4-83cf-1e79d561b508 admin admin] The token cache is being invalidate because project ee2b1d60c50f4f709104417ee275ef78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:30.818013 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-f02b4396-3f1a-46b4-83cf-1e79d561b508 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:30.818619 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-f02b4396-3f1a-46b4-83cf-1e79d561b508 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:30.823934 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1039/2052] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:30 2022] DELETE /identity/v3/projects/ee2b1d60c50f4f709104417ee275ef78 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:30.824124 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b4396-3f1a-46b4-83cf-1e79d561b508 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:30.826914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f02b4396-3f1a-46b4-83cf-1e79d561b508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:30.856500 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1014/2053] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:30.857784 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a10c6d-9768-4e2a-8966-be1a42335621 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:30.859953 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-32a10c6d-9768-4e2a-8966-be1a42335621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:30.915827 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b4396-3f1a-46b4-83cf-1e79d561b508 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:30.929444 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daed1eb-973f-406a-bdf5-129a82aa0f04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:30.930910 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daed1eb-973f-406a-bdf5-129a82aa0f04 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:30.930910 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daed1eb-973f-406a-bdf5-129a82aa0f04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:30.931174 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daed1eb-973f-406a-bdf5-129a82aa0f04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:30.933391 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2daed1eb-973f-406a-bdf5-129a82aa0f04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:30.966840 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a10c6d-9768-4e2a-8966-be1a42335621 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:30.973007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed24d9-2966-4a48-ae47-a269394e649d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:30.974497 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed24d9-2966-4a48-ae47-a269394e649d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:30.974925 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed24d9-2966-4a48-ae47-a269394e649d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:30.975700 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed24d9-2966-4a48-ae47-a269394e649d admin admin] PATH_INFO: `/v3/users/6dfb02efcc654bf38b7ab768db3f83cc` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:30.977242 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed24d9-2966-4a48-ae47-a269394e649d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dfb02efcc654bf38b7ab768db3f83cc)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:30.979191 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed24d9-2966-4a48-ae47-a269394e649d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:31.031317 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daed1eb-973f-406a-bdf5-129a82aa0f04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:31.033554 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daed1eb-973f-406a-bdf5-129a82aa0f04 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:31.043492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f6ed24d9-2966-4a48-ae47-a269394e649d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dfb02efcc654bf38b7ab768db3f83cc'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:31.052292 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1040/2054] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:30 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:31.057348 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f6ed24d9-2966-4a48-ae47-a269394e649d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dfb02efcc654bf38b7ab768db3f83cc'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:31.067648 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f6ed24d9-2966-4a48-ae47-a269394e649d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dfb02efcc654bf38b7ab768db3f83cc'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:31.087135 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f6ed24d9-2966-4a48-ae47-a269394e649d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dfb02efcc654bf38b7ab768db3f83cc'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:31.087998 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f6ed24d9-2966-4a48-ae47-a269394e649d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dfb02efcc654bf38b7ab768db3f83cc'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:31.096505 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1015/2055] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:30 2022] DELETE /identity/v3/users/6dfb02efcc654bf38b7ab768db3f83cc => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:31.865237 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daed1eb-973f-406a-bdf5-129a82aa0f04 service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:31.897235 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daed1eb-973f-406a-bdf5-129a82aa0f04 service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:32.022026 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9922b-850f-4a29-a291-cfa8a565d1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:32.023016 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9922b-850f-4a29-a291-cfa8a565d1c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:32.023742 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9922b-850f-4a29-a291-cfa8a565d1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:32.023742 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9922b-850f-4a29-a291-cfa8a565d1c4 admin admin] PATH_INFO: `/v3/projects/f49056467f6d442e81bd52aa8533ce0b` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:32.025687 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9922b-850f-4a29-a291-cfa8a565d1c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f49056467f6d442e81bd52aa8533ce0b)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:32.027628 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9922b-850f-4a29-a291-cfa8a565d1c4 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:32.052401 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:32.096019 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-91e9922b-850f-4a29-a291-cfa8a565d1c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f49056467f6d442e81bd52aa8533ce0b', 'request_id': 'req-91e9922b-850f-4a29-a291-cfa8a565d1c4'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:32.104718 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-91e9922b-850f-4a29-a291-cfa8a565d1c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f49056467f6d442e81bd52aa8533ce0b', 'request_id': 'req-91e9922b-850f-4a29-a291-cfa8a565d1c4'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:32.113131 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-91e9922b-850f-4a29-a291-cfa8a565d1c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f49056467f6d442e81bd52aa8533ce0b', 'request_id': 'req-91e9922b-850f-4a29-a291-cfa8a565d1c4'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:32.138703 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-91e9922b-850f-4a29-a291-cfa8a565d1c4 admin admin] The token cache is being invalidate because project f49056467f6d442e81bd52aa8533ce0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:32.139003 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-91e9922b-850f-4a29-a291-cfa8a565d1c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:32.140052 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-91e9922b-850f-4a29-a291-cfa8a565d1c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:32.142857 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1041/2056] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:31 2022] DELETE /identity/v3/projects/f49056467f6d442e81bd52aa8533ce0b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:32.149145 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a37ad-fbd0-48a8-8e1d-9549470f9c9e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:32.149831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a37ad-fbd0-48a8-8e1d-9549470f9c9e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:32.150632 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a37ad-fbd0-48a8-8e1d-9549470f9c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:32.182490 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a96a37ad-fbd0-48a8-8e1d-9549470f9c9e None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:32.184115 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a96a37ad-fbd0-48a8-8e1d-9549470f9c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:32.224397 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:32.308110 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1016/2057] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:32.318665 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc30eef-1db5-4b57-bc64-29d419dc377f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:32.319503 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc30eef-1db5-4b57-bc64-29d419dc377f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:32.319842 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc30eef-1db5-4b57-bc64-29d419dc377f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:32.345419 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-ecc30eef-1db5-4b57-bc64-29d419dc377f None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:32.347909 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ecc30eef-1db5-4b57-bc64-29d419dc377f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:32.358043 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1042/2058] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:32.363293 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a37ad-fbd0-48a8-8e1d-9549470f9c9e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:32.387954 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a37ad-fbd0-48a8-8e1d-9549470f9c9e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:32.396432 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e65226-3212-49f7-9043-68a0d669e82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:32.397305 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e65226-3212-49f7-9043-68a0d669e82e admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:32.397736 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e65226-3212-49f7-9043-68a0d669e82e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:32.398163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e65226-3212-49f7-9043-68a0d669e82e admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:32.400146 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e65226-3212-49f7-9043-68a0d669e82e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:57:32.400552 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e65226-3212-49f7-9043-68a0d669e82e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:32.403252 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e65226-3212-49f7-9043-68a0d669e82e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:32.419927 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1017/2059] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:57:32.423436 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc30eef-1db5-4b57-bc64-29d419dc377f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:32.433867 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc30eef-1db5-4b57-bc64-29d419dc377f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:32.440180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d7bad-7c67-43a3-b147-978935e1ca27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:32.441363 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d7bad-7c67-43a3-b147-978935e1ca27 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:32.441596 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d7bad-7c67-43a3-b147-978935e1ca27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:32.441967 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d7bad-7c67-43a3-b147-978935e1ca27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:32.442787 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d7bad-7c67-43a3-b147-978935e1ca27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:32.445179 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d7bad-7c67-43a3-b147-978935e1ca27 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:32.484539 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1043/2060] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:32 2022] POST /identity/v3/projects => generated 365 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:32.490241 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e65226-3212-49f7-9043-68a0d669e82e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:32.502259 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e65226-3212-49f7-9043-68a0d669e82e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:32.660868 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccf013-7079-48bb-a34c-5c7bdea73c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:32.661720 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccf013-7079-48bb-a34c-5c7bdea73c4d admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:32.662462 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccf013-7079-48bb-a34c-5c7bdea73c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:32.662808 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccf013-7079-48bb-a34c-5c7bdea73c4d admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:32.663763 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ccf013-7079-48bb-a34c-5c7bdea73c4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:32.674858 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ccf013-7079-48bb-a34c-5c7bdea73c4d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:32.715433 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1018/2061] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:32 2022] POST /identity/v3/users => generated 283 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:32.716755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d7bad-7c67-43a3-b147-978935e1ca27 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:32.728427 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d7bad-7c67-43a3-b147-978935e1ca27 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:32.733239 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d10272-6be4-4f46-bd55-da5a1cc35c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:32.733910 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d10272-6be4-4f46-bd55-da5a1cc35c55 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:32.734445 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d10272-6be4-4f46-bd55-da5a1cc35c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:32.734642 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d10272-6be4-4f46-bd55-da5a1cc35c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:32.735367 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d10272-6be4-4f46-bd55-da5a1cc35c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:32.737118 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d10272-6be4-4f46-bd55-da5a1cc35c55 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:32.752245 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1044/2062] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:32.756488 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccf013-7079-48bb-a34c-5c7bdea73c4d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:32.768657 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccf013-7079-48bb-a34c-5c7bdea73c4d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:32.777993 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872187d-abff-493b-a529-0f1d57b8ee73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:32.787365 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872187d-abff-493b-a529-0f1d57b8ee73 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:32.787656 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872187d-abff-493b-a529-0f1d57b8ee73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:32.787966 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872187d-abff-493b-a529-0f1d57b8ee73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:32.788712 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872187d-abff-493b-a529-0f1d57b8ee73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:32.790874 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872187d-abff-493b-a529-0f1d57b8ee73 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:32.807829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d10272-6be4-4f46-bd55-da5a1cc35c55 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:32.815088 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1019/2063] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:32.818583 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d10272-6be4-4f46-bd55-da5a1cc35c55 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:32.826138 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e7441-c76d-48c0-b9c6-0b05ec55ef26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:32.827589 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e7441-c76d-48c0-b9c6-0b05ec55ef26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:32.827916 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e7441-c76d-48c0-b9c6-0b05ec55ef26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:32.828294 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e7441-c76d-48c0-b9c6-0b05ec55ef26 admin admin] PATH_INFO: `/v3/projects/33af1fe8a057445b8ce324868954688a/users/a5d73f9ee0bb453282987be121d5f163/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:32.853206 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e7441-c76d-48c0-b9c6-0b05ec55ef26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33af1fe8a057445b8ce324868954688a, user_id=a5d73f9ee0bb453282987be121d5f163, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:32.858593 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e7441-c76d-48c0-b9c6-0b05ec55ef26 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:32.879548 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1045/2064] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:32 2022] PUT /identity/v3/projects/33af1fe8a057445b8ce324868954688a/users/a5d73f9ee0bb453282987be121d5f163/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:32.889872 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004054c9-443e-4e43-a288-b173f326fd0f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:32.890224 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004054c9-443e-4e43-a288-b173f326fd0f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:32.890724 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004054c9-443e-4e43-a288-b173f326fd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:32.926412 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-004054c9-443e-4e43-a288-b173f326fd0f None None] MFA Rules not processed for user `a5d73f9ee0bb453282987be121d5f163`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:32.927262 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-004054c9-443e-4e43-a288-b173f326fd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:33.032772 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1020/2065] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:33.037560 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e7441-c76d-48c0-b9c6-0b05ec55ef26 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:33.144578 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e7441-c76d-48c0-b9c6-0b05ec55ef26 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:33.149736 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a7054-5b0a-468e-ad4d-95d0e3a1eda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:33.150465 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a7054-5b0a-468e-ad4d-95d0e3a1eda4 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:33.150807 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a7054-5b0a-468e-ad4d-95d0e3a1eda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:33.151150 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a7054-5b0a-468e-ad4d-95d0e3a1eda4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:33.151928 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a7054-5b0a-468e-ad4d-95d0e3a1eda4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:33.154072 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a7054-5b0a-468e-ad4d-95d0e3a1eda4 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:33.183652 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1046/2066] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:33 2022] POST /identity/v3/projects => generated 363 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:33.188175 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004054c9-443e-4e43-a288-b173f326fd0f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:33.200307 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004054c9-443e-4e43-a288-b173f326fd0f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:33.226508 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:33.276731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f02ac1-9d13-43e6-80bc-95865d5876a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:33.277376 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f02ac1-9d13-43e6-80bc-95865d5876a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:33.277667 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f02ac1-9d13-43e6-80bc-95865d5876a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:33.277943 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f02ac1-9d13-43e6-80bc-95865d5876a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:33.279192 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f02ac1-9d13-43e6-80bc-95865d5876a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:33.284004 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f02ac1-9d13-43e6-80bc-95865d5876a8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:33.310159 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1021/2067] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:33 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:33.315364 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a7054-5b0a-468e-ad4d-95d0e3a1eda4 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:33.328582 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a7054-5b0a-468e-ad4d-95d0e3a1eda4 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:33.334385 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e6ee0-8843-470d-8e9f-585ed2e06877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:33.335529 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e6ee0-8843-470d-8e9f-585ed2e06877 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:33.335929 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e6ee0-8843-470d-8e9f-585ed2e06877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:33.336210 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e6ee0-8843-470d-8e9f-585ed2e06877 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:33.336940 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e6ee0-8843-470d-8e9f-585ed2e06877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:33.338538 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e6ee0-8843-470d-8e9f-585ed2e06877 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:33.350787 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1047/2068] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:57:33.355028 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f02ac1-9d13-43e6-80bc-95865d5876a8 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:33.366584 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f02ac1-9d13-43e6-80bc-95865d5876a8 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:33.371512 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa1a97-f44c-4b82-9872-45012e141eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:33.372547 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa1a97-f44c-4b82-9872-45012e141eb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:33.372829 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa1a97-f44c-4b82-9872-45012e141eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:33.373097 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa1a97-f44c-4b82-9872-45012e141eb4 admin admin] PATH_INFO: `/v3/projects/7a6fd57575204fb793b7d3bc487af613/users/e9964fba04ea4319a04447491bd7ac82/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:33.400874 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa1a97-f44c-4b82-9872-45012e141eb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a6fd57575204fb793b7d3bc487af613, user_id=e9964fba04ea4319a04447491bd7ac82, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:33.404235 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa1a97-f44c-4b82-9872-45012e141eb4 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:33.432173 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1022/2069] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:33 2022] PUT /identity/v3/projects/7a6fd57575204fb793b7d3bc487af613/users/e9964fba04ea4319a04447491bd7ac82/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:33.434942 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e6ee0-8843-470d-8e9f-585ed2e06877 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:33.446128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e6ee0-8843-470d-8e9f-585ed2e06877 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:33.459526 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:33.546177 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea130960-db6a-488c-9301-9c31e7dbc822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:33.547062 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea130960-db6a-488c-9301-9c31e7dbc822 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:33.547454 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea130960-db6a-488c-9301-9c31e7dbc822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:33.548634 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea130960-db6a-488c-9301-9c31e7dbc822 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:33.549455 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea130960-db6a-488c-9301-9c31e7dbc822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:33.551774 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea130960-db6a-488c-9301-9c31e7dbc822 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:33.576064 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1048/2070] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:33.577230 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa1a97-f44c-4b82-9872-45012e141eb4 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:33.588421 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa1a97-f44c-4b82-9872-45012e141eb4 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:33.593123 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfd4c2-1c5e-4882-91e3-8c27a954fe0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:33.594016 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfd4c2-1c5e-4882-91e3-8c27a954fe0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:33.594293 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfd4c2-1c5e-4882-91e3-8c27a954fe0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:33.594685 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfd4c2-1c5e-4882-91e3-8c27a954fe0d admin admin] PATH_INFO: `/v3/projects/7a6fd57575204fb793b7d3bc487af613/users/e9964fba04ea4319a04447491bd7ac82/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:33.596852 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfd4c2-1c5e-4882-91e3-8c27a954fe0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a6fd57575204fb793b7d3bc487af613, user_id=e9964fba04ea4319a04447491bd7ac82, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:33.599581 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfd4c2-1c5e-4882-91e3-8c27a954fe0d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:33.624325 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1023/2071] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:33 2022] PUT /identity/v3/projects/7a6fd57575204fb793b7d3bc487af613/users/e9964fba04ea4319a04447491bd7ac82/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:33.635839 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe39a6-caea-4ce4-a855-1b389c2c38c1 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:33.636187 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe39a6-caea-4ce4-a855-1b389c2c38c1 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:33.636543 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe39a6-caea-4ce4-a855-1b389c2c38c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:33.665292 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d8fe39a6-caea-4ce4-a855-1b389c2c38c1 None None] MFA Rules not processed for user `e9964fba04ea4319a04447491bd7ac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:33.667216 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d8fe39a6-caea-4ce4-a855-1b389c2c38c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:33.778777 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1049/2072] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:33 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:33.791427 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfd4c2-1c5e-4882-91e3-8c27a954fe0d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:33.793908 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a1dfd4c2-1c5e-4882-91e3-8c27a954fe0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:33.868491 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfd4c2-1c5e-4882-91e3-8c27a954fe0d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:33.872823 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6955f5f-ad81-481e-bfb3-602084ea2325 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:33.873599 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6955f5f-ad81-481e-bfb3-602084ea2325 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:33.873973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6955f5f-ad81-481e-bfb3-602084ea2325 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:33.874360 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6955f5f-ad81-481e-bfb3-602084ea2325 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:33.891205 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6955f5f-ad81-481e-bfb3-602084ea2325 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:33.893077 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6955f5f-ad81-481e-bfb3-602084ea2325 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:33.904757 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1024/2073] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:33 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:33.998089 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe39a6-caea-4ce4-a855-1b389c2c38c1 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:34.017217 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe39a6-caea-4ce4-a855-1b389c2c38c1 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:34.025396 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470bd513-4252-4806-a45e-71b10d0d1b4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:34.026386 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bd513-4252-4806-a45e-71b10d0d1b4d service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:34.026874 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bd513-4252-4806-a45e-71b10d0d1b4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:34.027333 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bd513-4252-4806-a45e-71b10d0d1b4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:34.107991 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470bd513-4252-4806-a45e-71b10d0d1b4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:34.109630 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470bd513-4252-4806-a45e-71b10d0d1b4d service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:34.120521 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1050/2074] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:33 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:34.971476 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6955f5f-ad81-481e-bfb3-602084ea2325 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:34.973326 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c6955f5f-ad81-481e-bfb3-602084ea2325 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:35.050037 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6955f5f-ad81-481e-bfb3-602084ea2325 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:35.055603 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35290b-0c09-40ec-9d32-a57360b320ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:35.056765 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35290b-0c09-40ec-9d32-a57360b320ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:35.057046 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35290b-0c09-40ec-9d32-a57360b320ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:35.057320 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35290b-0c09-40ec-9d32-a57360b320ee admin admin] PATH_INFO: `/v3/users/23a2ca7697574c1abed88818c03df518` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:35.058791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35290b-0c09-40ec-9d32-a57360b320ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=23a2ca7697574c1abed88818c03df518)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:35.060741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35290b-0c09-40ec-9d32-a57360b320ee admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:35.090786 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:35.132006 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ea35290b-0c09-40ec-9d32-a57360b320ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23a2ca7697574c1abed88818c03df518'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:35.139820 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ea35290b-0c09-40ec-9d32-a57360b320ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23a2ca7697574c1abed88818c03df518'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:35.149889 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ea35290b-0c09-40ec-9d32-a57360b320ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23a2ca7697574c1abed88818c03df518'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:35.165571 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ea35290b-0c09-40ec-9d32-a57360b320ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23a2ca7697574c1abed88818c03df518'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:35.166430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ea35290b-0c09-40ec-9d32-a57360b320ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23a2ca7697574c1abed88818c03df518'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:35.179059 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1025/2075] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:34 2022] DELETE /identity/v3/users/23a2ca7697574c1abed88818c03df518 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:35.183864 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2966ec-1120-4eac-ad05-8b95c90559a6 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:35.184410 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2966ec-1120-4eac-ad05-8b95c90559a6 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:35.184410 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2966ec-1120-4eac-ad05-8b95c90559a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:35.204402 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-fe2966ec-1120-4eac-ad05-8b95c90559a6 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:35.206157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-fe2966ec-1120-4eac-ad05-8b95c90559a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:35.240992 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:35.274709 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1051/2076] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:35.285386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35290b-0c09-40ec-9d32-a57360b320ee admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:35.287244 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ea35290b-0c09-40ec-9d32-a57360b320ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:35.357711 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35290b-0c09-40ec-9d32-a57360b320ee admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:35.363271 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4415ccc-bb8f-4e91-97c3-10e4c558e04c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:35.363973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4415ccc-bb8f-4e91-97c3-10e4c558e04c service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:35.364256 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4415ccc-bb8f-4e91-97c3-10e4c558e04c service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:35.364527 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4415ccc-bb8f-4e91-97c3-10e4c558e04c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:35.377013 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4415ccc-bb8f-4e91-97c3-10e4c558e04c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:35.380248 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4415ccc-bb8f-4e91-97c3-10e4c558e04c service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:35.399589 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1026/2077] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:36.100746 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2966ec-1120-4eac-ad05-8b95c90559a6 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:36.102230 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-fe2966ec-1120-4eac-ad05-8b95c90559a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:36.121745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2966ec-1120-4eac-ad05-8b95c90559a6 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:36.128196 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00adcc5d-f61d-411c-b9f7-fd0cc0087509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:36.141715 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00adcc5d-f61d-411c-b9f7-fd0cc0087509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:36.142210 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00adcc5d-f61d-411c-b9f7-fd0cc0087509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:36.142470 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00adcc5d-f61d-411c-b9f7-fd0cc0087509 admin admin] PATH_INFO: `/v3/projects/9ccc17728ab949849fbcb09fc2917e34` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:36.145163 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00adcc5d-f61d-411c-b9f7-fd0cc0087509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ccc17728ab949849fbcb09fc2917e34)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:36.149188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00adcc5d-f61d-411c-b9f7-fd0cc0087509 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:36.213550 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-00adcc5d-f61d-411c-b9f7-fd0cc0087509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ccc17728ab949849fbcb09fc2917e34', 'request_id': 'req-00adcc5d-f61d-411c-b9f7-fd0cc0087509'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:36.220449 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-00adcc5d-f61d-411c-b9f7-fd0cc0087509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ccc17728ab949849fbcb09fc2917e34', 'request_id': 'req-00adcc5d-f61d-411c-b9f7-fd0cc0087509'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:36.228881 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-00adcc5d-f61d-411c-b9f7-fd0cc0087509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ccc17728ab949849fbcb09fc2917e34', 'request_id': 'req-00adcc5d-f61d-411c-b9f7-fd0cc0087509'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:36.243728 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-00adcc5d-f61d-411c-b9f7-fd0cc0087509 admin admin] The token cache is being invalidate because project 9ccc17728ab949849fbcb09fc2917e34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:36.244051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-00adcc5d-f61d-411c-b9f7-fd0cc0087509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:36.244779 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-00adcc5d-f61d-411c-b9f7-fd0cc0087509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:36.246675 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1052/2078] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:36 2022] DELETE /identity/v3/projects/9ccc17728ab949849fbcb09fc2917e34 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:36.250975 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4415ccc-bb8f-4e91-97c3-10e4c558e04c service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:36.269304 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4415ccc-bb8f-4e91-97c3-10e4c558e04c service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:36.349289 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c4204-d2de-4d14-a648-d0cd19c2a77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:36.350407 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c4204-d2de-4d14-a648-d0cd19c2a77a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:36.351210 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c4204-d2de-4d14-a648-d0cd19c2a77a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:36.351557 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c4204-d2de-4d14-a648-d0cd19c2a77a admin admin] PATH_INFO: `/v3/users/1be9972623684679a2635f3c1347d9e1` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:36.354310 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c4204-d2de-4d14-a648-d0cd19c2a77a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1be9972623684679a2635f3c1347d9e1)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:36.357131 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c4204-d2de-4d14-a648-d0cd19c2a77a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:36.431913 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:36.438896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-aa7c4204-d2de-4d14-a648-d0cd19c2a77a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1be9972623684679a2635f3c1347d9e1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:36.455169 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-aa7c4204-d2de-4d14-a648-d0cd19c2a77a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1be9972623684679a2635f3c1347d9e1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:36.464604 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-aa7c4204-d2de-4d14-a648-d0cd19c2a77a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1be9972623684679a2635f3c1347d9e1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:36.484818 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-aa7c4204-d2de-4d14-a648-d0cd19c2a77a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1be9972623684679a2635f3c1347d9e1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:36.485698 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-aa7c4204-d2de-4d14-a648-d0cd19c2a77a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1be9972623684679a2635f3c1347d9e1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:36.495850 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1027/2079] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:36 2022] DELETE /identity/v3/users/1be9972623684679a2635f3c1347d9e1 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:37.141750 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00adcc5d-f61d-411c-b9f7-fd0cc0087509 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:37.143610 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-00adcc5d-f61d-411c-b9f7-fd0cc0087509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:37.182045 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c4204-d2de-4d14-a648-d0cd19c2a77a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:37.184450 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-aa7c4204-d2de-4d14-a648-d0cd19c2a77a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:37.184568 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00adcc5d-f61d-411c-b9f7-fd0cc0087509 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:37.310681 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c4204-d2de-4d14-a648-d0cd19c2a77a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:37.316686 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f944ec-491a-4585-8d0a-8a9c52096001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:37.317468 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87de7a0-2454-4fca-961f-0bb1e4362701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:37.317968 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f944ec-491a-4585-8d0a-8a9c52096001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:37.317968 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f944ec-491a-4585-8d0a-8a9c52096001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:37.318135 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f944ec-491a-4585-8d0a-8a9c52096001 admin admin] PATH_INFO: `/v3/users/a5d73f9ee0bb453282987be121d5f163` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:37.319258 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87de7a0-2454-4fca-961f-0bb1e4362701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:37.319405 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f944ec-491a-4585-8d0a-8a9c52096001 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5d73f9ee0bb453282987be121d5f163)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:37.319961 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87de7a0-2454-4fca-961f-0bb1e4362701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:37.320318 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87de7a0-2454-4fca-961f-0bb1e4362701 admin admin] PATH_INFO: `/v3/projects/8f124996b0804b75b333c96f6a97b496` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:37.321383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f944ec-491a-4585-8d0a-8a9c52096001 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:37.321690 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87de7a0-2454-4fca-961f-0bb1e4362701 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f124996b0804b75b333c96f6a97b496)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:37.324764 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87de7a0-2454-4fca-961f-0bb1e4362701 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:37.380186 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-77f944ec-491a-4585-8d0a-8a9c52096001 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5d73f9ee0bb453282987be121d5f163'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:37.384587 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c87de7a0-2454-4fca-961f-0bb1e4362701 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f124996b0804b75b333c96f6a97b496', 'request_id': 'req-c87de7a0-2454-4fca-961f-0bb1e4362701'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:37.388103 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-77f944ec-491a-4585-8d0a-8a9c52096001 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5d73f9ee0bb453282987be121d5f163'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:37.391862 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c87de7a0-2454-4fca-961f-0bb1e4362701 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f124996b0804b75b333c96f6a97b496', 'request_id': 'req-c87de7a0-2454-4fca-961f-0bb1e4362701'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:37.393279 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:37.397538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-77f944ec-491a-4585-8d0a-8a9c52096001 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5d73f9ee0bb453282987be121d5f163'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:37.399517 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c87de7a0-2454-4fca-961f-0bb1e4362701 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f124996b0804b75b333c96f6a97b496', 'request_id': 'req-c87de7a0-2454-4fca-961f-0bb1e4362701'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:37.422705 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-77f944ec-491a-4585-8d0a-8a9c52096001 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5d73f9ee0bb453282987be121d5f163'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:37.423151 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c87de7a0-2454-4fca-961f-0bb1e4362701 admin admin] The token cache is being invalidate because project 8f124996b0804b75b333c96f6a97b496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:37.423451 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c87de7a0-2454-4fca-961f-0bb1e4362701 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:37.424197 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c87de7a0-2454-4fca-961f-0bb1e4362701 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:37.424483 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-77f944ec-491a-4585-8d0a-8a9c52096001 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5d73f9ee0bb453282987be121d5f163'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:37.426042 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1053/2080] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:37 2022] DELETE /identity/v3/projects/8f124996b0804b75b333c96f6a97b496 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:37.431194 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbb2b0-c5f3-4ebc-822f-cf582f89f259 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:37.431467 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbb2b0-c5f3-4ebc-822f-cf582f89f259 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:37.431665 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1028/2081] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:37 2022] DELETE /identity/v3/users/a5d73f9ee0bb453282987be121d5f163 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:37.431767 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbb2b0-c5f3-4ebc-822f-cf582f89f259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:37.437616 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4f07b-f91f-4e34-adcf-14ca8d4d6c86 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:37.438503 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4f07b-f91f-4e34-adcf-14ca8d4d6c86 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:37.438914 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4f07b-f91f-4e34-adcf-14ca8d4d6c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:37.453316 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-64cbb2b0-c5f3-4ebc-822f-cf582f89f259 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:37.454845 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-64cbb2b0-c5f3-4ebc-822f-cf582f89f259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:37.459888 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-57e4f07b-f91f-4e34-adcf-14ca8d4d6c86 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:37.461205 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-57e4f07b-f91f-4e34-adcf-14ca8d4d6c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:37.501948 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:37.532987 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1029/2082] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:37.535937 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1054/2083] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:37.546086 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a7db6-0ac3-48e0-907c-46b98b678bab None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:37.546375 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a7db6-0ac3-48e0-907c-46b98b678bab None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:37.546659 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a7db6-0ac3-48e0-907c-46b98b678bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:37.546955 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4f07b-f91f-4e34-adcf-14ca8d4d6c86 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:37.548529 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-57e4f07b-f91f-4e34-adcf-14ca8d4d6c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:37.566095 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-4c4a7db6-0ac3-48e0-907c-46b98b678bab None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:37.567332 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4c4a7db6-0ac3-48e0-907c-46b98b678bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:37.576246 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1055/2084] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:37.580488 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a7db6-0ac3-48e0-907c-46b98b678bab None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:37.589957 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a7db6-0ac3-48e0-907c-46b98b678bab None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:37.595629 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d199445-02a8-4745-91d8-fa1c2086efeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:37.596414 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d199445-02a8-4745-91d8-fa1c2086efeb admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:37.596767 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d199445-02a8-4745-91d8-fa1c2086efeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:37.597121 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d199445-02a8-4745-91d8-fa1c2086efeb admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:37.597882 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d199445-02a8-4745-91d8-fa1c2086efeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:57:37.598169 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d199445-02a8-4745-91d8-fa1c2086efeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:37.599801 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d199445-02a8-4745-91d8-fa1c2086efeb admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:37.612223 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1056/2085] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:57:37.616592 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d199445-02a8-4745-91d8-fa1c2086efeb admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:37.627832 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d199445-02a8-4745-91d8-fa1c2086efeb admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:37.628315 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4f07b-f91f-4e34-adcf-14ca8d4d6c86 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:37.632580 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee0d53-ce69-4dad-8950-1e3183d2e2c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:37.633310 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee0d53-ce69-4dad-8950-1e3183d2e2c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:37.633628 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee0d53-ce69-4dad-8950-1e3183d2e2c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:37.634008 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee0d53-ce69-4dad-8950-1e3183d2e2c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:37.636949 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e91fd-0de4-44fa-a82c-26304cebfe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:37.637636 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e91fd-0de4-44fa-a82c-26304cebfe72 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:37.637918 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e91fd-0de4-44fa-a82c-26304cebfe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:37.638190 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e91fd-0de4-44fa-a82c-26304cebfe72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:37.638899 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e91fd-0de4-44fa-a82c-26304cebfe72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:37.641123 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e91fd-0de4-44fa-a82c-26304cebfe72 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:37.650817 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee0d53-ce69-4dad-8950-1e3183d2e2c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:37.652586 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee0d53-ce69-4dad-8950-1e3183d2e2c7 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:37.672661 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1030/2086] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:37.681034 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1057/2087] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:37 2022] POST /identity/v3/projects => generated 379 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:37.685235 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee0d53-ce69-4dad-8950-1e3183d2e2c7 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:37.697096 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee0d53-ce69-4dad-8950-1e3183d2e2c7 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:37.836347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1385cce-5403-48ec-a834-0e3f2708e626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:37.839067 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1385cce-5403-48ec-a834-0e3f2708e626 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:37.839067 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1385cce-5403-48ec-a834-0e3f2708e626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:37.839262 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1385cce-5403-48ec-a834-0e3f2708e626 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:37.840063 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1385cce-5403-48ec-a834-0e3f2708e626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:37.842102 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1385cce-5403-48ec-a834-0e3f2708e626 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:37.866107 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1031/2088] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:37 2022] POST /identity/v3/users => generated 290 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:37.870472 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e91fd-0de4-44fa-a82c-26304cebfe72 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:37.884856 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e91fd-0de4-44fa-a82c-26304cebfe72 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:37.890741 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0574777-78c0-451f-bee8-b3581c01bda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:37.891577 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0574777-78c0-451f-bee8-b3581c01bda4 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:37.891895 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0574777-78c0-451f-bee8-b3581c01bda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:37.892167 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0574777-78c0-451f-bee8-b3581c01bda4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:37.892915 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0574777-78c0-451f-bee8-b3581c01bda4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:37.894546 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0574777-78c0-451f-bee8-b3581c01bda4 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:37.905794 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1058/2089] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:57:37.910360 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1385cce-5403-48ec-a834-0e3f2708e626 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:37.922743 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1385cce-5403-48ec-a834-0e3f2708e626 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:37.927550 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b82834-e939-4995-93ed-93805b95c1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:37.928278 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b82834-e939-4995-93ed-93805b95c1cb admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:37.928562 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b82834-e939-4995-93ed-93805b95c1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:37.928844 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b82834-e939-4995-93ed-93805b95c1cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:37.929571 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b82834-e939-4995-93ed-93805b95c1cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:37.931178 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b82834-e939-4995-93ed-93805b95c1cb admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:37.944767 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1032/2090] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:37.949742 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0574777-78c0-451f-bee8-b3581c01bda4 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:37.960723 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0574777-78c0-451f-bee8-b3581c01bda4 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:37.965716 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a6ad8-5c9e-40ad-a011-d0c4147c1e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:37.966595 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a6ad8-5c9e-40ad-a011-d0c4147c1e36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:37.966875 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a6ad8-5c9e-40ad-a011-d0c4147c1e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:37.967152 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a6ad8-5c9e-40ad-a011-d0c4147c1e36 admin admin] PATH_INFO: `/v3/projects/1494ca05f77140bd9a8a7d63fce613e3/users/747e3a6f7f0c4912a1f1f9eca90c3b1c/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:37.990143 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a6ad8-5c9e-40ad-a011-d0c4147c1e36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1494ca05f77140bd9a8a7d63fce613e3, user_id=747e3a6f7f0c4912a1f1f9eca90c3b1c, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:37.993012 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a6ad8-5c9e-40ad-a011-d0c4147c1e36 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:38.020561 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1059/2091] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:37 2022] PUT /identity/v3/projects/1494ca05f77140bd9a8a7d63fce613e3/users/747e3a6f7f0c4912a1f1f9eca90c3b1c/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:38.022619 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5acc8a-a307-4790-9974-09d6d55287f0 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:38.023076 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5acc8a-a307-4790-9974-09d6d55287f0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:38.023708 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5acc8a-a307-4790-9974-09d6d55287f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:38.063889 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-eb5acc8a-a307-4790-9974-09d6d55287f0 None None] MFA Rules not processed for user `747e3a6f7f0c4912a1f1f9eca90c3b1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:38.065209 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-eb5acc8a-a307-4790-9974-09d6d55287f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:38.133256 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:38.170778 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1033/2092] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:38.175473 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a6ad8-5c9e-40ad-a011-d0c4147c1e36 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:38.253776 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a6ad8-5c9e-40ad-a011-d0c4147c1e36 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:38.260275 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6e514-6d03-48f9-b7c7-44b9ed39657e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:38.261416 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6e514-6d03-48f9-b7c7-44b9ed39657e admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:38.262036 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6e514-6d03-48f9-b7c7-44b9ed39657e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:38.262490 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6e514-6d03-48f9-b7c7-44b9ed39657e admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:38.263342 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f6e514-6d03-48f9-b7c7-44b9ed39657e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:38.266330 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f6e514-6d03-48f9-b7c7-44b9ed39657e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:38.290367 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:38.310354 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1060/2093] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:38 2022] POST /identity/v3/projects => generated 379 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:38.314796 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5acc8a-a307-4790-9974-09d6d55287f0 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:38.339598 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5acc8a-a307-4790-9974-09d6d55287f0 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:38.449144 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6e514-6d03-48f9-b7c7-44b9ed39657e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:38.452110 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-49f6e514-6d03-48f9-b7c7-44b9ed39657e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:38.455083 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448b9db-bc73-4633-827f-1ba3c90df696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:38.455993 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448b9db-bc73-4633-827f-1ba3c90df696 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:38.456342 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448b9db-bc73-4633-827f-1ba3c90df696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:38.456624 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448b9db-bc73-4633-827f-1ba3c90df696 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:38.457468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d448b9db-bc73-4633-827f-1ba3c90df696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:38.459824 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d448b9db-bc73-4633-827f-1ba3c90df696 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:38.468769 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6e514-6d03-48f9-b7c7-44b9ed39657e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:38.478623 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566114df-e173-4718-bf98-b659c0cc4892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:38.483852 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566114df-e173-4718-bf98-b659c0cc4892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:38.484344 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566114df-e173-4718-bf98-b659c0cc4892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:38.484750 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566114df-e173-4718-bf98-b659c0cc4892 admin admin] PATH_INFO: `/v3/projects/33af1fe8a057445b8ce324868954688a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:38.486636 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566114df-e173-4718-bf98-b659c0cc4892 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33af1fe8a057445b8ce324868954688a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:38.488591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566114df-e173-4718-bf98-b659c0cc4892 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:38.492723 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1034/2094] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:38 2022] POST /identity/v3/users => generated 296 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:38.496915 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448b9db-bc73-4633-827f-1ba3c90df696 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:38.522024 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448b9db-bc73-4633-827f-1ba3c90df696 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:38.534157 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7734ab7-ab3f-44f6-9492-5fb7ea61492b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:38.534792 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7734ab7-ab3f-44f6-9492-5fb7ea61492b admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:38.535145 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7734ab7-ab3f-44f6-9492-5fb7ea61492b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:38.535425 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7734ab7-ab3f-44f6-9492-5fb7ea61492b admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:38.536240 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7734ab7-ab3f-44f6-9492-5fb7ea61492b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:38.538290 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7734ab7-ab3f-44f6-9492-5fb7ea61492b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:38.551901 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1035/2095] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:38.553515 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7734ab7-ab3f-44f6-9492-5fb7ea61492b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:38.562667 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-566114df-e173-4718-bf98-b659c0cc4892 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33af1fe8a057445b8ce324868954688a', 'request_id': 'req-566114df-e173-4718-bf98-b659c0cc4892'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:38.564272 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7734ab7-ab3f-44f6-9492-5fb7ea61492b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:38.570438 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-566114df-e173-4718-bf98-b659c0cc4892 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33af1fe8a057445b8ce324868954688a', 'request_id': 'req-566114df-e173-4718-bf98-b659c0cc4892'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:38.578945 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-566114df-e173-4718-bf98-b659c0cc4892 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33af1fe8a057445b8ce324868954688a', 'request_id': 'req-566114df-e173-4718-bf98-b659c0cc4892'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:38.599327 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-566114df-e173-4718-bf98-b659c0cc4892 admin admin] The token cache is being invalidate because project 33af1fe8a057445b8ce324868954688a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:38.600021 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-566114df-e173-4718-bf98-b659c0cc4892 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:38.600667 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-566114df-e173-4718-bf98-b659c0cc4892 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:38.602772 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1061/2096] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:38 2022] DELETE /identity/v3/projects/33af1fe8a057445b8ce324868954688a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:38.606792 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566114df-e173-4718-bf98-b659c0cc4892 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:38.608607 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-566114df-e173-4718-bf98-b659c0cc4892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:38.645593 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7b854-8a7e-4382-871e-9e66092d9339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:38.646649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7b854-8a7e-4382-871e-9e66092d9339 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:38.647016 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7b854-8a7e-4382-871e-9e66092d9339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:38.647353 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7b854-8a7e-4382-871e-9e66092d9339 admin admin] PATH_INFO: `/v3/projects/bc3a5a7df87f4f6c907cecd984e41851/users/d593b5b515394bc094396ede160ced52/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:38.675163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7b854-8a7e-4382-871e-9e66092d9339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc3a5a7df87f4f6c907cecd984e41851, user_id=d593b5b515394bc094396ede160ced52, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:38.679829 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7b854-8a7e-4382-871e-9e66092d9339 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:38.702736 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1036/2097] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:38 2022] PUT /identity/v3/projects/bc3a5a7df87f4f6c907cecd984e41851/users/d593b5b515394bc094396ede160ced52/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:38.704878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7b854-8a7e-4382-871e-9e66092d9339 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:38.707850 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f4d7b854-8a7e-4382-871e-9e66092d9339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:38.772852 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566114df-e173-4718-bf98-b659c0cc4892 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:38.790629 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:38.820048 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7b854-8a7e-4382-871e-9e66092d9339 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:38.825854 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c12b53-1248-498f-8761-e18904f1b2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:38.826558 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c12b53-1248-498f-8761-e18904f1b2e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:38.826847 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c12b53-1248-498f-8761-e18904f1b2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:38.827385 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c12b53-1248-498f-8761-e18904f1b2e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:38.828610 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c12b53-1248-498f-8761-e18904f1b2e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:38.830669 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c12b53-1248-498f-8761-e18904f1b2e3 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:38.847916 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1037/2098] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:57:38.849433 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c12b53-1248-498f-8761-e18904f1b2e3 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:38.869312 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db407b6-2f93-4fad-bdc8-ed7e0926b9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:38.870440 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db407b6-2f93-4fad-bdc8-ed7e0926b9a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:38.870994 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db407b6-2f93-4fad-bdc8-ed7e0926b9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:38.871376 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db407b6-2f93-4fad-bdc8-ed7e0926b9a7 admin admin] PATH_INFO: `/v3/users/e9964fba04ea4319a04447491bd7ac82` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:38.872843 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db407b6-2f93-4fad-bdc8-ed7e0926b9a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9964fba04ea4319a04447491bd7ac82)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:38.875256 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db407b6-2f93-4fad-bdc8-ed7e0926b9a7 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:38.875567 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c12b53-1248-498f-8761-e18904f1b2e3 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:38.883463 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d48d9af-70a5-41cd-8d51-92ee57198a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:38.884441 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48d9af-70a5-41cd-8d51-92ee57198a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:38.885016 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48d9af-70a5-41cd-8d51-92ee57198a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:38.885016 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48d9af-70a5-41cd-8d51-92ee57198a2c admin admin] PATH_INFO: `/v3/projects/bc3a5a7df87f4f6c907cecd984e41851/users/d593b5b515394bc094396ede160ced52/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:38.887524 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d48d9af-70a5-41cd-8d51-92ee57198a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc3a5a7df87f4f6c907cecd984e41851, user_id=d593b5b515394bc094396ede160ced52, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:38.890442 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d48d9af-70a5-41cd-8d51-92ee57198a2c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:38.909131 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1038/2099] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:38 2022] PUT /identity/v3/projects/bc3a5a7df87f4f6c907cecd984e41851/users/d593b5b515394bc094396ede160ced52/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:38.916609 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12be518-dfbb-443f-9a95-9aeba14f1ffa None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:38.917414 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12be518-dfbb-443f-9a95-9aeba14f1ffa None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:38.919439 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12be518-dfbb-443f-9a95-9aeba14f1ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:38.924240 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:38.980446 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7db407b6-2f93-4fad-bdc8-ed7e0926b9a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9964fba04ea4319a04447491bd7ac82'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:38.988892 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f12be518-dfbb-443f-9a95-9aeba14f1ffa None None] MFA Rules not processed for user `d593b5b515394bc094396ede160ced52`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:38.990564 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f12be518-dfbb-443f-9a95-9aeba14f1ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:39.017538 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7db407b6-2f93-4fad-bdc8-ed7e0926b9a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9964fba04ea4319a04447491bd7ac82'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:39.020314 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7db407b6-2f93-4fad-bdc8-ed7e0926b9a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9964fba04ea4319a04447491bd7ac82'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:39.033595 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7db407b6-2f93-4fad-bdc8-ed7e0926b9a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9964fba04ea4319a04447491bd7ac82'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:39.051051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7db407b6-2f93-4fad-bdc8-ed7e0926b9a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9964fba04ea4319a04447491bd7ac82'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:39.068124 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1062/2100] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:38 2022] DELETE /identity/v3/users/e9964fba04ea4319a04447491bd7ac82 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:39.091263 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1039/2101] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:38 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:39.103520 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db407b6-2f93-4fad-bdc8-ed7e0926b9a7 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:39.109692 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7db407b6-2f93-4fad-bdc8-ed7e0926b9a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:39.193434 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db407b6-2f93-4fad-bdc8-ed7e0926b9a7 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:39.198709 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f69621-cac0-43a7-a137-03d179e3cc83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:39.199342 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f69621-cac0-43a7-a137-03d179e3cc83 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:39.199641 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f69621-cac0-43a7-a137-03d179e3cc83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:39.199976 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f69621-cac0-43a7-a137-03d179e3cc83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:39.202860 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a6f69621-cac0-43a7-a137-03d179e3cc83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:39.311170 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f69621-cac0-43a7-a137-03d179e3cc83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:39.313248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f69621-cac0-43a7-a137-03d179e3cc83 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:39.338341 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1063/2102] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:39.501565 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12be518-dfbb-443f-9a95-9aeba14f1ffa None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:39.503020 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f12be518-dfbb-443f-9a95-9aeba14f1ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:39.618544 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12be518-dfbb-443f-9a95-9aeba14f1ffa None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:39.698567 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74f729-9445-4d00-a7e6-e1a7d50cf713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:39.699464 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74f729-9445-4d00-a7e6-e1a7d50cf713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:39.699908 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74f729-9445-4d00-a7e6-e1a7d50cf713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:39.700283 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74f729-9445-4d00-a7e6-e1a7d50cf713 admin admin] PATH_INFO: `/v3/projects/7a6fd57575204fb793b7d3bc487af613` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:39.701582 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74f729-9445-4d00-a7e6-e1a7d50cf713 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a6fd57575204fb793b7d3bc487af613)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:39.704140 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74f729-9445-4d00-a7e6-e1a7d50cf713 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:39.712971 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:39.760094 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9f74f729-9445-4d00-a7e6-e1a7d50cf713 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a6fd57575204fb793b7d3bc487af613', 'request_id': 'req-9f74f729-9445-4d00-a7e6-e1a7d50cf713'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:39.767373 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9f74f729-9445-4d00-a7e6-e1a7d50cf713 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a6fd57575204fb793b7d3bc487af613', 'request_id': 'req-9f74f729-9445-4d00-a7e6-e1a7d50cf713'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:39.774595 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9f74f729-9445-4d00-a7e6-e1a7d50cf713 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a6fd57575204fb793b7d3bc487af613', 'request_id': 'req-9f74f729-9445-4d00-a7e6-e1a7d50cf713'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:39.800312 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9f74f729-9445-4d00-a7e6-e1a7d50cf713 admin admin] The token cache is being invalidate because project 7a6fd57575204fb793b7d3bc487af613 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:39.800934 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9f74f729-9445-4d00-a7e6-e1a7d50cf713 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:39.801737 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9f74f729-9445-4d00-a7e6-e1a7d50cf713 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:39.803944 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1040/2103] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:39 2022] DELETE /identity/v3/projects/7a6fd57575204fb793b7d3bc487af613 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:39.808695 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc73c9-a0aa-4b22-a6ec-13372667e2dd None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:39.809201 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc73c9-a0aa-4b22-a6ec-13372667e2dd None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:39.809449 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc73c9-a0aa-4b22-a6ec-13372667e2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:39.845293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-76bc73c9-a0aa-4b22-a6ec-13372667e2dd None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:39.846932 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-76bc73c9-a0aa-4b22-a6ec-13372667e2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:39.918028 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:39.931981 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1064/2104] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:39.939583 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ac9a9-c631-4564-968a-afddeb0dd632 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:39.940188 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ac9a9-c631-4564-968a-afddeb0dd632 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:39.940610 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ac9a9-c631-4564-968a-afddeb0dd632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:39.970383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ce0ac9a9-c631-4564-968a-afddeb0dd632 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:39.972317 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ce0ac9a9-c631-4564-968a-afddeb0dd632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:39.984829 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1041/2105] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:57:39.986228 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc73c9-a0aa-4b22-a6ec-13372667e2dd None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:40.003589 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc73c9-a0aa-4b22-a6ec-13372667e2dd None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:40.015131 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf182415-8d34-425e-9a26-7fb514ff6370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:40.016014 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf182415-8d34-425e-9a26-7fb514ff6370 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:40.016298 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf182415-8d34-425e-9a26-7fb514ff6370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:40.016569 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf182415-8d34-425e-9a26-7fb514ff6370 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:40.017304 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf182415-8d34-425e-9a26-7fb514ff6370 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:57:40.017608 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf182415-8d34-425e-9a26-7fb514ff6370 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:40.019208 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf182415-8d34-425e-9a26-7fb514ff6370 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:40.031525 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1065/2106] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:57:40.036048 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ac9a9-c631-4564-968a-afddeb0dd632 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:40.045979 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ac9a9-c631-4564-968a-afddeb0dd632 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:40.051065 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81625d92-4997-45eb-9d18-3e2b7f396b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:40.051741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81625d92-4997-45eb-9d18-3e2b7f396b6a admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:40.052055 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81625d92-4997-45eb-9d18-3e2b7f396b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:40.052336 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81625d92-4997-45eb-9d18-3e2b7f396b6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:40.053085 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81625d92-4997-45eb-9d18-3e2b7f396b6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:40.055021 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81625d92-4997-45eb-9d18-3e2b7f396b6a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:40.083297 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1042/2107] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:40 2022] POST /identity/v3/projects => generated 393 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:57:40.088004 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf182415-8d34-425e-9a26-7fb514ff6370 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:40.099048 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf182415-8d34-425e-9a26-7fb514ff6370 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:40.166483 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c88b49-f45d-4e3f-aaf6-346d2090c5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:40.167539 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c88b49-f45d-4e3f-aaf6-346d2090c5fb admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:40.167826 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c88b49-f45d-4e3f-aaf6-346d2090c5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:40.168139 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c88b49-f45d-4e3f-aaf6-346d2090c5fb admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:40.168863 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c88b49-f45d-4e3f-aaf6-346d2090c5fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:40.170886 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c88b49-f45d-4e3f-aaf6-346d2090c5fb admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:40.196767 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1066/2108] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:40 2022] POST /identity/v3/users => generated 297 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:40.198066 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81625d92-4997-45eb-9d18-3e2b7f396b6a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:40.210675 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81625d92-4997-45eb-9d18-3e2b7f396b6a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:40.225480 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35fed0b-b8e1-46f2-ba3a-68f9e641d4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:40.226170 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fed0b-b8e1-46f2-ba3a-68f9e641d4cf admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:40.226478 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fed0b-b8e1-46f2-ba3a-68f9e641d4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:40.226751 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fed0b-b8e1-46f2-ba3a-68f9e641d4cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:40.227506 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35fed0b-b8e1-46f2-ba3a-68f9e641d4cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:40.229188 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35fed0b-b8e1-46f2-ba3a-68f9e641d4cf admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:40.241422 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1043/2109] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:40.245331 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c88b49-f45d-4e3f-aaf6-346d2090c5fb admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:40.257008 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c88b49-f45d-4e3f-aaf6-346d2090c5fb admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:40.262362 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f95f8-5e27-4155-af92-ae9ef4024760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:40.263039 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f95f8-5e27-4155-af92-ae9ef4024760 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:40.263356 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f95f8-5e27-4155-af92-ae9ef4024760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:40.263643 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f95f8-5e27-4155-af92-ae9ef4024760 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:40.264480 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f95f8-5e27-4155-af92-ae9ef4024760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:40.266460 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f95f8-5e27-4155-af92-ae9ef4024760 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:40.276779 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1067/2110] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:40.283398 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35fed0b-b8e1-46f2-ba3a-68f9e641d4cf admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:40.298102 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35fed0b-b8e1-46f2-ba3a-68f9e641d4cf admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:40.303974 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b1d2d-070c-416b-9436-3f20c7afa51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:40.304868 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b1d2d-070c-416b-9436-3f20c7afa51f admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:40.305283 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b1d2d-070c-416b-9436-3f20c7afa51f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:40.305565 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b1d2d-070c-416b-9436-3f20c7afa51f admin admin] PATH_INFO: `/v3/projects/b5211f18e327467082ff16313866782d/users/6bf53c1f6f4b491d9f57d3a57465043d/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:40.321477 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b1d2d-070c-416b-9436-3f20c7afa51f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5211f18e327467082ff16313866782d, user_id=6bf53c1f6f4b491d9f57d3a57465043d, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:40.324132 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b1d2d-070c-416b-9436-3f20c7afa51f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:40.341748 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1044/2111] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:40 2022] PUT /identity/v3/projects/b5211f18e327467082ff16313866782d/users/6bf53c1f6f4b491d9f57d3a57465043d/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:40.352984 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a1dde-41a6-4376-84c5-cb869d8e6334 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:40.353271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a1dde-41a6-4376-84c5-cb869d8e6334 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:40.353571 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a1dde-41a6-4376-84c5-cb869d8e6334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:40.382438 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-283a1dde-41a6-4376-84c5-cb869d8e6334 None None] MFA Rules not processed for user `6bf53c1f6f4b491d9f57d3a57465043d`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:40.383736 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-283a1dde-41a6-4376-84c5-cb869d8e6334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:40.454681 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1068/2112] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:40.459439 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b1d2d-070c-416b-9436-3f20c7afa51f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:40.525666 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b1d2d-070c-416b-9436-3f20c7afa51f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:40.532450 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc21a7a5-8802-4876-b212-d42e54a73c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:40.533118 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21a7a5-8802-4876-b212-d42e54a73c95 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:40.533404 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21a7a5-8802-4876-b212-d42e54a73c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:40.533677 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21a7a5-8802-4876-b212-d42e54a73c95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:40.534406 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc21a7a5-8802-4876-b212-d42e54a73c95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:40.536430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc21a7a5-8802-4876-b212-d42e54a73c95 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:40.566710 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1045/2113] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:40 2022] POST /identity/v3/projects => generated 391 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:40.570893 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a1dde-41a6-4376-84c5-cb869d8e6334 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:40.582962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a1dde-41a6-4376-84c5-cb869d8e6334 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:40.633978 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:40.642577 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd898dda-92b5-4346-b1a3-c4a5ed8b9902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:40.643246 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd898dda-92b5-4346-b1a3-c4a5ed8b9902 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:40.643529 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd898dda-92b5-4346-b1a3-c4a5ed8b9902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:40.643804 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd898dda-92b5-4346-b1a3-c4a5ed8b9902 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:40.644528 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd898dda-92b5-4346-b1a3-c4a5ed8b9902 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:40.646486 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd898dda-92b5-4346-b1a3-c4a5ed8b9902 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:40.668632 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1069/2114] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:40 2022] POST /identity/v3/users => generated 302 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:40.673007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc21a7a5-8802-4876-b212-d42e54a73c95 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:40.684415 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc21a7a5-8802-4876-b212-d42e54a73c95 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:40.689975 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce550a68-c8b2-4180-9bb4-a35e66794765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:40.690636 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce550a68-c8b2-4180-9bb4-a35e66794765 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:40.690915 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce550a68-c8b2-4180-9bb4-a35e66794765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:40.691187 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce550a68-c8b2-4180-9bb4-a35e66794765 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:40.691940 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce550a68-c8b2-4180-9bb4-a35e66794765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:40.693580 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce550a68-c8b2-4180-9bb4-a35e66794765 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:40.704973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1046/2115] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:40.709503 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd898dda-92b5-4346-b1a3-c4a5ed8b9902 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:40.724400 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd898dda-92b5-4346-b1a3-c4a5ed8b9902 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:40.732407 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785297e9-5b29-4747-b905-fd86e2a89119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:40.733697 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785297e9-5b29-4747-b905-fd86e2a89119 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:40.733977 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785297e9-5b29-4747-b905-fd86e2a89119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:40.734272 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785297e9-5b29-4747-b905-fd86e2a89119 admin admin] PATH_INFO: `/v3/projects/29c09cf294264d0ea05a4ec7f8182084/users/06363831253f46fcb8a1bba49cd5dec6/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:40.751140 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785297e9-5b29-4747-b905-fd86e2a89119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29c09cf294264d0ea05a4ec7f8182084, user_id=06363831253f46fcb8a1bba49cd5dec6, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:40.753919 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785297e9-5b29-4747-b905-fd86e2a89119 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:40.771240 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1070/2116] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:40 2022] PUT /identity/v3/projects/29c09cf294264d0ea05a4ec7f8182084/users/06363831253f46fcb8a1bba49cd5dec6/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:40.776018 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce550a68-c8b2-4180-9bb4-a35e66794765 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:40.786364 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce550a68-c8b2-4180-9bb4-a35e66794765 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:40.790928 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:40.849967 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36a72a-ba52-4ac3-9939-68d3cf254f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:40.850721 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36a72a-ba52-4ac3-9939-68d3cf254f5c admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:40.851068 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36a72a-ba52-4ac3-9939-68d3cf254f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:40.851568 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36a72a-ba52-4ac3-9939-68d3cf254f5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:40.853690 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d36a72a-ba52-4ac3-9939-68d3cf254f5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:40.855382 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d36a72a-ba52-4ac3-9939-68d3cf254f5c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:40.870483 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1047/2117] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:40.875374 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785297e9-5b29-4747-b905-fd86e2a89119 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:40.888081 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785297e9-5b29-4747-b905-fd86e2a89119 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:40.894351 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bc125-5e24-430b-add9-a75a17a7037b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:40.895246 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bc125-5e24-430b-add9-a75a17a7037b admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:40.895529 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bc125-5e24-430b-add9-a75a17a7037b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:40.895808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bc125-5e24-430b-add9-a75a17a7037b admin admin] PATH_INFO: `/v3/projects/29c09cf294264d0ea05a4ec7f8182084/users/06363831253f46fcb8a1bba49cd5dec6/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:40.898359 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bc125-5e24-430b-add9-a75a17a7037b admin admin] RBAC: Authorizing `identity:create_grant(project_id=29c09cf294264d0ea05a4ec7f8182084, user_id=06363831253f46fcb8a1bba49cd5dec6, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:40.901150 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bc125-5e24-430b-add9-a75a17a7037b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:40.904563 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36a72a-ba52-4ac3-9939-68d3cf254f5c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:40.906449 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9d36a72a-ba52-4ac3-9939-68d3cf254f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:40.912646 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1071/2118] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:40 2022] PUT /identity/v3/projects/29c09cf294264d0ea05a4ec7f8182084/users/06363831253f46fcb8a1bba49cd5dec6/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:40.923893 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef08ef-8425-4c26-837c-3acbf00db39a None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:40.925193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef08ef-8425-4c26-837c-3acbf00db39a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:40.925486 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef08ef-8425-4c26-837c-3acbf00db39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:40.952264 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-6bef08ef-8425-4c26-837c-3acbf00db39a None None] MFA Rules not processed for user `06363831253f46fcb8a1bba49cd5dec6`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:40.953572 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6bef08ef-8425-4c26-837c-3acbf00db39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:40.973617 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36a72a-ba52-4ac3-9939-68d3cf254f5c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:41.029692 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2f455-57f5-4bcf-a8b1-c3d8881bb62e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:41.030547 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2f455-57f5-4bcf-a8b1-c3d8881bb62e service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:41.030833 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2f455-57f5-4bcf-a8b1-c3d8881bb62e service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:41.031110 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2f455-57f5-4bcf-a8b1-c3d8881bb62e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:41.033581 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-39d2f455-57f5-4bcf-a8b1-c3d8881bb62e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:41.056865 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1072/2119] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:40 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:57:41.063760 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef08ef-8425-4c26-837c-3acbf00db39a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:41.065302 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6bef08ef-8425-4c26-837c-3acbf00db39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:41.082408 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef08ef-8425-4c26-837c-3acbf00db39a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:41.087640 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a77890-0cba-4857-ae55-ce1cfa29251c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:41.088448 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a77890-0cba-4857-ae55-ce1cfa29251c service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:41.088826 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a77890-0cba-4857-ae55-ce1cfa29251c service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:41.089202 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a77890-0cba-4857-ae55-ce1cfa29251c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:41.099891 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a77890-0cba-4857-ae55-ce1cfa29251c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:41.101443 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a77890-0cba-4857-ae55-ce1cfa29251c service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:41.114058 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2f455-57f5-4bcf-a8b1-c3d8881bb62e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:41.115831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2f455-57f5-4bcf-a8b1-c3d8881bb62e service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:41.122691 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1073/2120] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:41 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:57:41.133841 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1048/2121] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:40 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:41.204271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a77890-0cba-4857-ae55-ce1cfa29251c service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:41.216705 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a77890-0cba-4857-ae55-ce1cfa29251c service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:41.223493 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa18467-2de1-42c6-976d-84dd579024c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:41.224250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa18467-2de1-42c6-976d-84dd579024c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:41.225125 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa18467-2de1-42c6-976d-84dd579024c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:41.225409 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa18467-2de1-42c6-976d-84dd579024c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:41.294388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa18467-2de1-42c6-976d-84dd579024c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:41.295921 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa18467-2de1-42c6-976d-84dd579024c6 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:41.306278 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1074/2122] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:45.011822 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2f455-57f5-4bcf-a8b1-c3d8881bb62e service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:45.013325 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-39d2f455-57f5-4bcf-a8b1-c3d8881bb62e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:45.024683 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:45.093394 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2f455-57f5-4bcf-a8b1-c3d8881bb62e service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:45.093394 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca77cae-14eb-4192-9124-79a4e903fad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:45.093394 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca77cae-14eb-4192-9124-79a4e903fad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:45.093394 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca77cae-14eb-4192-9124-79a4e903fad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:45.093871 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca77cae-14eb-4192-9124-79a4e903fad2 admin admin] PATH_INFO: `/v3/users/747e3a6f7f0c4912a1f1f9eca90c3b1c` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:45.093871 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca77cae-14eb-4192-9124-79a4e903fad2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=747e3a6f7f0c4912a1f1f9eca90c3b1c)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:45.093871 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca77cae-14eb-4192-9124-79a4e903fad2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:45.142061 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7ca77cae-14eb-4192-9124-79a4e903fad2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '747e3a6f7f0c4912a1f1f9eca90c3b1c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:45.150463 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7ca77cae-14eb-4192-9124-79a4e903fad2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '747e3a6f7f0c4912a1f1f9eca90c3b1c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:45.158509 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7ca77cae-14eb-4192-9124-79a4e903fad2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '747e3a6f7f0c4912a1f1f9eca90c3b1c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:45.170888 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7ca77cae-14eb-4192-9124-79a4e903fad2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '747e3a6f7f0c4912a1f1f9eca90c3b1c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:45.171967 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7ca77cae-14eb-4192-9124-79a4e903fad2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '747e3a6f7f0c4912a1f1f9eca90c3b1c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:45.179946 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1049/2123] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:45 2022] DELETE /identity/v3/users/747e3a6f7f0c4912a1f1f9eca90c3b1c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:45.184868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be4537-6a2c-4077-81b2-77cf4b8d1f93 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:45.185383 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be4537-6a2c-4077-81b2-77cf4b8d1f93 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:45.185464 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be4537-6a2c-4077-81b2-77cf4b8d1f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:45.203237 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-87be4537-6a2c-4077-81b2-77cf4b8d1f93 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:45.204799 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-87be4537-6a2c-4077-81b2-77cf4b8d1f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:45.217557 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:45.278541 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1075/2124] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:57:45.289000 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca77cae-14eb-4192-9124-79a4e903fad2 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:45.290592 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7ca77cae-14eb-4192-9124-79a4e903fad2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:45.354854 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca77cae-14eb-4192-9124-79a4e903fad2 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:45.359621 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e98d74-5691-40c3-9231-51e41899a98b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:45.360328 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e98d74-5691-40c3-9231-51e41899a98b service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:45.360611 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e98d74-5691-40c3-9231-51e41899a98b service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:45.360870 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e98d74-5691-40c3-9231-51e41899a98b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:45.371497 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e98d74-5691-40c3-9231-51e41899a98b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:45.372970 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e98d74-5691-40c3-9231-51e41899a98b service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:45.382793 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1050/2125] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:45.664407 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be4537-6a2c-4077-81b2-77cf4b8d1f93 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:45.665852 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-87be4537-6a2c-4077-81b2-77cf4b8d1f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:45.683546 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be4537-6a2c-4077-81b2-77cf4b8d1f93 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:45.689853 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1240968-575a-4985-8197-90bfcc0a80fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:45.691030 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1240968-575a-4985-8197-90bfcc0a80fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:45.691456 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1240968-575a-4985-8197-90bfcc0a80fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:45.691828 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1240968-575a-4985-8197-90bfcc0a80fa admin admin] PATH_INFO: `/v3/projects/1494ca05f77140bd9a8a7d63fce613e3` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:45.693690 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1240968-575a-4985-8197-90bfcc0a80fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=1494ca05f77140bd9a8a7d63fce613e3)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:45.697327 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1240968-575a-4985-8197-90bfcc0a80fa admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:45.737684 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e98d74-5691-40c3-9231-51e41899a98b service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:45.739270 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a4e98d74-5691-40c3-9231-51e41899a98b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:45.753474 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e98d74-5691-40c3-9231-51e41899a98b service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:45.757424 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c1240968-575a-4985-8197-90bfcc0a80fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1494ca05f77140bd9a8a7d63fce613e3', 'request_id': 'req-c1240968-575a-4985-8197-90bfcc0a80fa'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:45.763185 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c1240968-575a-4985-8197-90bfcc0a80fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1494ca05f77140bd9a8a7d63fce613e3', 'request_id': 'req-c1240968-575a-4985-8197-90bfcc0a80fa'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:45.769655 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c1240968-575a-4985-8197-90bfcc0a80fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1494ca05f77140bd9a8a7d63fce613e3', 'request_id': 'req-c1240968-575a-4985-8197-90bfcc0a80fa'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:45.785540 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c1240968-575a-4985-8197-90bfcc0a80fa admin admin] The token cache is being invalidate because project 1494ca05f77140bd9a8a7d63fce613e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:45.785830 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c1240968-575a-4985-8197-90bfcc0a80fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:45.786861 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c1240968-575a-4985-8197-90bfcc0a80fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:45.787392 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:45.788773 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1076/2126] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:45 2022] DELETE /identity/v3/projects/1494ca05f77140bd9a8a7d63fce613e3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:45.792442 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1240968-575a-4985-8197-90bfcc0a80fa admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:45.794006 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c1240968-575a-4985-8197-90bfcc0a80fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:45.819771 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed5b5c-eecf-4ba9-a104-a45d1add486f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:45.820790 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed5b5c-eecf-4ba9-a104-a45d1add486f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:45.821073 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed5b5c-eecf-4ba9-a104-a45d1add486f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:45.821347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed5b5c-eecf-4ba9-a104-a45d1add486f admin admin] PATH_INFO: `/v3/users/6bf53c1f6f4b491d9f57d3a57465043d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:45.822551 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed5b5c-eecf-4ba9-a104-a45d1add486f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bf53c1f6f4b491d9f57d3a57465043d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:45.824588 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed5b5c-eecf-4ba9-a104-a45d1add486f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:45.858696 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1240968-575a-4985-8197-90bfcc0a80fa admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:45.864339 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443749b2-ff14-4c46-a66d-6eebbd8737b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:45.865405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443749b2-ff14-4c46-a66d-6eebbd8737b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:45.865562 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443749b2-ff14-4c46-a66d-6eebbd8737b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:45.865836 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443749b2-ff14-4c46-a66d-6eebbd8737b6 admin admin] PATH_INFO: `/v3/users/d593b5b515394bc094396ede160ced52` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:45.867130 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443749b2-ff14-4c46-a66d-6eebbd8737b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d593b5b515394bc094396ede160ced52)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:45.869099 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443749b2-ff14-4c46-a66d-6eebbd8737b6 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:45.874943 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b3ed5b5c-eecf-4ba9-a104-a45d1add486f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bf53c1f6f4b491d9f57d3a57465043d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:45.883321 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b3ed5b5c-eecf-4ba9-a104-a45d1add486f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bf53c1f6f4b491d9f57d3a57465043d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:45.893454 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b3ed5b5c-eecf-4ba9-a104-a45d1add486f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bf53c1f6f4b491d9f57d3a57465043d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:45.908275 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b3ed5b5c-eecf-4ba9-a104-a45d1add486f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bf53c1f6f4b491d9f57d3a57465043d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:45.908949 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b3ed5b5c-eecf-4ba9-a104-a45d1add486f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bf53c1f6f4b491d9f57d3a57465043d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:45.915479 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1051/2127] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:45 2022] DELETE /identity/v3/users/6bf53c1f6f4b491d9f57d3a57465043d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:45.918788 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:45.920114 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582afdb-5353-474e-9002-7d2d7d8b9d1b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:45.920400 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582afdb-5353-474e-9002-7d2d7d8b9d1b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:45.920799 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582afdb-5353-474e-9002-7d2d7d8b9d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:45.921850 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-443749b2-ff14-4c46-a66d-6eebbd8737b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd593b5b515394bc094396ede160ced52'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:45.937025 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-443749b2-ff14-4c46-a66d-6eebbd8737b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd593b5b515394bc094396ede160ced52'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:45.937830 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-443749b2-ff14-4c46-a66d-6eebbd8737b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd593b5b515394bc094396ede160ced52'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:45.938623 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c582afdb-5353-474e-9002-7d2d7d8b9d1b None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:45.939860 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c582afdb-5353-474e-9002-7d2d7d8b9d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:45.946912 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-443749b2-ff14-4c46-a66d-6eebbd8737b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd593b5b515394bc094396ede160ced52'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:45.955506 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-443749b2-ff14-4c46-a66d-6eebbd8737b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd593b5b515394bc094396ede160ced52'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:45.962355 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1077/2128] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:45 2022] DELETE /identity/v3/users/d593b5b515394bc094396ede160ced52 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:46.004124 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1052/2129] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:57:46.013754 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443749b2-ff14-4c46-a66d-6eebbd8737b6 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:46.016078 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-443749b2-ff14-4c46-a66d-6eebbd8737b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:46.078712 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443749b2-ff14-4c46-a66d-6eebbd8737b6 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:46.082807 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d85523-df44-4e5b-aea4-5dbd0ca25f04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:46.083463 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d85523-df44-4e5b-aea4-5dbd0ca25f04 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:46.083739 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d85523-df44-4e5b-aea4-5dbd0ca25f04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:46.084055 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d85523-df44-4e5b-aea4-5dbd0ca25f04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:46.165929 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d85523-df44-4e5b-aea4-5dbd0ca25f04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:46.167549 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d85523-df44-4e5b-aea4-5dbd0ca25f04 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:46.178482 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1078/2130] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:46.713491 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582afdb-5353-474e-9002-7d2d7d8b9d1b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:46.715184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c582afdb-5353-474e-9002-7d2d7d8b9d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:46.728596 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582afdb-5353-474e-9002-7d2d7d8b9d1b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:46.733264 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc88a0-5c03-4471-b365-5013e5a6db69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:46.734155 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc88a0-5c03-4471-b365-5013e5a6db69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:46.734445 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc88a0-5c03-4471-b365-5013e5a6db69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:46.734727 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc88a0-5c03-4471-b365-5013e5a6db69 admin admin] PATH_INFO: `/v3/projects/bc3a5a7df87f4f6c907cecd984e41851` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:46.736055 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc88a0-5c03-4471-b365-5013e5a6db69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc3a5a7df87f4f6c907cecd984e41851)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:46.738280 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc88a0-5c03-4471-b365-5013e5a6db69 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:46.795030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:46.799597 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d7cc88a0-5c03-4471-b365-5013e5a6db69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc3a5a7df87f4f6c907cecd984e41851', 'request_id': 'req-d7cc88a0-5c03-4471-b365-5013e5a6db69'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:46.807942 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d7cc88a0-5c03-4471-b365-5013e5a6db69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc3a5a7df87f4f6c907cecd984e41851', 'request_id': 'req-d7cc88a0-5c03-4471-b365-5013e5a6db69'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:46.815691 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d7cc88a0-5c03-4471-b365-5013e5a6db69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc3a5a7df87f4f6c907cecd984e41851', 'request_id': 'req-d7cc88a0-5c03-4471-b365-5013e5a6db69'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:46.834393 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d7cc88a0-5c03-4471-b365-5013e5a6db69 admin admin] The token cache is being invalidate because project bc3a5a7df87f4f6c907cecd984e41851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:46.835097 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d7cc88a0-5c03-4471-b365-5013e5a6db69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:46.835978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d7cc88a0-5c03-4471-b365-5013e5a6db69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:46.837727 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1053/2131] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:46 2022] DELETE /identity/v3/projects/bc3a5a7df87f4f6c907cecd984e41851 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:46.844468 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbc064-9504-4ade-ae0e-5c9b65d09cfb None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:46.845016 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbc064-9504-4ade-ae0e-5c9b65d09cfb None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:46.845016 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbc064-9504-4ade-ae0e-5c9b65d09cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:46.863010 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-53dbc064-9504-4ade-ae0e-5c9b65d09cfb None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:46.864265 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-53dbc064-9504-4ade-ae0e-5c9b65d09cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:46.912983 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc88a0-5c03-4471-b365-5013e5a6db69 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:46.914976 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d7cc88a0-5c03-4471-b365-5013e5a6db69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:46.940375 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1079/2132] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:57:46.948543 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c1d1d-2aa7-4d68-a0c8-adb430076397 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:46.949173 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c1d1d-2aa7-4d68-a0c8-adb430076397 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:46.949606 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c1d1d-2aa7-4d68-a0c8-adb430076397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:46.970400 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-af5c1d1d-2aa7-4d68-a0c8-adb430076397 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:46.971596 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-af5c1d1d-2aa7-4d68-a0c8-adb430076397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:46.983716 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1080/2133] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:57:46.985273 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c1d1d-2aa7-4d68-a0c8-adb430076397 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:46.992430 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:46.996786 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c1d1d-2aa7-4d68-a0c8-adb430076397 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:47.003355 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb7c1c-1d3c-4d94-ac33-336593ae4774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:47.003548 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc88a0-5c03-4471-b365-5013e5a6db69 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:47.004179 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb7c1c-1d3c-4d94-ac33-336593ae4774 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:47.004758 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb7c1c-1d3c-4d94-ac33-336593ae4774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:47.005283 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb7c1c-1d3c-4d94-ac33-336593ae4774 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:47.006094 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb7c1c-1d3c-4d94-ac33-336593ae4774 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:57:47.006470 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb7c1c-1d3c-4d94-ac33-336593ae4774 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:47.008433 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb7c1c-1d3c-4d94-ac33-336593ae4774 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:47.008791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae97bef-6cd0-4cc0-92a0-e246034c0844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:47.009713 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae97bef-6cd0-4cc0-92a0-e246034c0844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:47.010187 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae97bef-6cd0-4cc0-92a0-e246034c0844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:47.010466 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae97bef-6cd0-4cc0-92a0-e246034c0844 admin admin] PATH_INFO: `/v3/projects/b5211f18e327467082ff16313866782d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:47.012190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae97bef-6cd0-4cc0-92a0-e246034c0844 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5211f18e327467082ff16313866782d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:47.014145 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae97bef-6cd0-4cc0-92a0-e246034c0844 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:47.020756 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1081/2134] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:57:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:57:47.024944 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb7c1c-1d3c-4d94-ac33-336593ae4774 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:47.034763 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb7c1c-1d3c-4d94-ac33-336593ae4774 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:47.039954 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18714db-f868-47ea-b7ae-08d0522f0de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:47.040666 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18714db-f868-47ea-b7ae-08d0522f0de1 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:47.040902 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18714db-f868-47ea-b7ae-08d0522f0de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:47.041180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18714db-f868-47ea-b7ae-08d0522f0de1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:47.041858 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18714db-f868-47ea-b7ae-08d0522f0de1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:47.043762 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18714db-f868-47ea-b7ae-08d0522f0de1 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:47.069425 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1ae97bef-6cd0-4cc0-92a0-e246034c0844 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5211f18e327467082ff16313866782d', 'request_id': 'req-1ae97bef-6cd0-4cc0-92a0-e246034c0844'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:47.076075 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1ae97bef-6cd0-4cc0-92a0-e246034c0844 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5211f18e327467082ff16313866782d', 'request_id': 'req-1ae97bef-6cd0-4cc0-92a0-e246034c0844'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:47.079900 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1082/2135] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:47 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:57:47.080743 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18714db-f868-47ea-b7ae-08d0522f0de1 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:47.086601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1ae97bef-6cd0-4cc0-92a0-e246034c0844 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5211f18e327467082ff16313866782d', 'request_id': 'req-1ae97bef-6cd0-4cc0-92a0-e246034c0844'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:47.104210 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1ae97bef-6cd0-4cc0-92a0-e246034c0844 admin admin] The token cache is being invalidate because project b5211f18e327467082ff16313866782d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:47.104573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1ae97bef-6cd0-4cc0-92a0-e246034c0844 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:47.105651 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1ae97bef-6cd0-4cc0-92a0-e246034c0844 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:47.107627 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1054/2136] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:46 2022] DELETE /identity/v3/projects/b5211f18e327467082ff16313866782d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:47.111458 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae97bef-6cd0-4cc0-92a0-e246034c0844 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:47.113424 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1ae97bef-6cd0-4cc0-92a0-e246034c0844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:47.154052 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18714db-f868-47ea-b7ae-08d0522f0de1 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:47.159080 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d66733-a05c-44c9-8862-e426651004d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:47.159729 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d66733-a05c-44c9-8862-e426651004d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:47.160045 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d66733-a05c-44c9-8862-e426651004d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:47.160444 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d66733-a05c-44c9-8862-e426651004d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:47.161156 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d66733-a05c-44c9-8862-e426651004d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:47.163416 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d66733-a05c-44c9-8862-e426651004d0 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:47.181087 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae97bef-6cd0-4cc0-92a0-e246034c0844 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:47.186043 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622a3a3-050e-4c94-8902-113b11d58e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:47.189817 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1083/2137] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:47 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:57:47.189919 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622a3a3-050e-4c94-8902-113b11d58e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:47.189919 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622a3a3-050e-4c94-8902-113b11d58e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:47.189919 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622a3a3-050e-4c94-8902-113b11d58e9b admin admin] PATH_INFO: `/v3/users/06363831253f46fcb8a1bba49cd5dec6` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:47.189919 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6622a3a3-050e-4c94-8902-113b11d58e9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=06363831253f46fcb8a1bba49cd5dec6)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:47.190765 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d66733-a05c-44c9-8862-e426651004d0 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:47.191727 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6622a3a3-050e-4c94-8902-113b11d58e9b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:47.193229 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-52d66733-a05c-44c9-8862-e426651004d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:47.196744 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:47.207643 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d66733-a05c-44c9-8862-e426651004d0 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:47.213324 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd6c80-395b-4ad0-95f2-f80ac60db41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:47.214111 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd6c80-395b-4ad0-95f2-f80ac60db41c admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:47.214472 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd6c80-395b-4ad0-95f2-f80ac60db41c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:47.214816 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd6c80-395b-4ad0-95f2-f80ac60db41c admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:47.215615 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd6c80-395b-4ad0-95f2-f80ac60db41c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:47.217772 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd6c80-395b-4ad0-95f2-f80ac60db41c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:47.229050 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1084/2138] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:47.233161 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd6c80-395b-4ad0-95f2-f80ac60db41c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:47.243098 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6622a3a3-050e-4c94-8902-113b11d58e9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06363831253f46fcb8a1bba49cd5dec6'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:47.243710 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd6c80-395b-4ad0-95f2-f80ac60db41c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:47.248300 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857072a-0db2-4833-9be6-6879ffb0b308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:47.249117 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857072a-0db2-4833-9be6-6879ffb0b308 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:47.249398 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857072a-0db2-4833-9be6-6879ffb0b308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:47.249671 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857072a-0db2-4833-9be6-6879ffb0b308 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:47.250397 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857072a-0db2-4833-9be6-6879ffb0b308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:47.252011 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857072a-0db2-4833-9be6-6879ffb0b308 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:47.253549 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6622a3a3-050e-4c94-8902-113b11d58e9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06363831253f46fcb8a1bba49cd5dec6'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:47.263469 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6622a3a3-050e-4c94-8902-113b11d58e9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06363831253f46fcb8a1bba49cd5dec6'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:47.267248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1085/2139] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:57:47.268444 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857072a-0db2-4833-9be6-6879ffb0b308 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:47.277420 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6622a3a3-050e-4c94-8902-113b11d58e9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06363831253f46fcb8a1bba49cd5dec6'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:47.278163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6622a3a3-050e-4c94-8902-113b11d58e9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06363831253f46fcb8a1bba49cd5dec6'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:47.278858 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857072a-0db2-4833-9be6-6879ffb0b308 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:47.284554 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1055/2140] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:47 2022] DELETE /identity/v3/users/06363831253f46fcb8a1bba49cd5dec6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:47.288142 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1915202-197d-43af-9629-4167f8f2631b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:47.288142 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1915202-197d-43af-9629-4167f8f2631b admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:47.288142 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1915202-197d-43af-9629-4167f8f2631b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:47.288142 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1915202-197d-43af-9629-4167f8f2631b admin admin] PATH_INFO: `/v3/projects/5116abd27ade49aba0820e73c50ede05/users/f0c519bb4a79403f93612414b6db66ee/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:47.304108 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1915202-197d-43af-9629-4167f8f2631b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5116abd27ade49aba0820e73c50ede05, user_id=f0c519bb4a79403f93612414b6db66ee, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:47.306791 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1915202-197d-43af-9629-4167f8f2631b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:47.322650 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1086/2141] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:47 2022] PUT /identity/v3/projects/5116abd27ade49aba0820e73c50ede05/users/f0c519bb4a79403f93612414b6db66ee/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:47.334478 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f5eaf-dc7a-4c47-98b1-68abfad47ad4 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:47.334860 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f5eaf-dc7a-4c47-98b1-68abfad47ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:47.335146 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f5eaf-dc7a-4c47-98b1-68abfad47ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:47.367579 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1c3f5eaf-dc7a-4c47-98b1-68abfad47ad4 None None] MFA Rules not processed for user `f0c519bb4a79403f93612414b6db66ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:47.369054 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1c3f5eaf-dc7a-4c47-98b1-68abfad47ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:47.440533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1056/2142] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:57:47.445839 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1915202-197d-43af-9629-4167f8f2631b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:47.447941 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d1915202-197d-43af-9629-4167f8f2631b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:47.525153 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1915202-197d-43af-9629-4167f8f2631b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:47.531108 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9f0cb-3639-49e7-b2e9-d9b906b55851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:47.532045 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9f0cb-3639-49e7-b2e9-d9b906b55851 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:47.532422 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9f0cb-3639-49e7-b2e9-d9b906b55851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:47.532791 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9f0cb-3639-49e7-b2e9-d9b906b55851 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:47.533585 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9f0cb-3639-49e7-b2e9-d9b906b55851 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:47.535591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9f0cb-3639-49e7-b2e9-d9b906b55851 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:47.567860 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:47.580682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1087/2143] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:47 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:47.586987 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f5eaf-dc7a-4c47-98b1-68abfad47ad4 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:47.588734 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1c3f5eaf-dc7a-4c47-98b1-68abfad47ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:47.594045 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9f0cb-3639-49e7-b2e9-d9b906b55851 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:47.605586 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f5eaf-dc7a-4c47-98b1-68abfad47ad4 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:47.678229 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0440e5-edeb-4f88-ace1-441a1c63c26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:47.679204 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0440e5-edeb-4f88-ace1-441a1c63c26f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:47.679491 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0440e5-edeb-4f88-ace1-441a1c63c26f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:47.679810 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0440e5-edeb-4f88-ace1-441a1c63c26f admin admin] PATH_INFO: `/v3/projects/29c09cf294264d0ea05a4ec7f8182084` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:47.681221 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0440e5-edeb-4f88-ace1-441a1c63c26f admin admin] RBAC: Authorizing `identity:delete_project(project_id=29c09cf294264d0ea05a4ec7f8182084)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:47.685099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0440e5-edeb-4f88-ace1-441a1c63c26f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:47.691502 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9f0cb-3639-49e7-b2e9-d9b906b55851 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:47.697580 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a0595-806d-423c-a670-8dd3d0514b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:47.698291 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a0595-806d-423c-a670-8dd3d0514b44 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:47.698502 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a0595-806d-423c-a670-8dd3d0514b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:47.698770 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a0595-806d-423c-a670-8dd3d0514b44 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:47.699577 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a0595-806d-423c-a670-8dd3d0514b44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:47.701806 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a0595-806d-423c-a670-8dd3d0514b44 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:47.705301 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:47.732721 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1088/2144] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:47 2022] POST /identity/v3/users => generated 298 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:47.737238 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a0595-806d-423c-a670-8dd3d0514b44 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:47.744886 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0d0440e5-edeb-4f88-ace1-441a1c63c26f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29c09cf294264d0ea05a4ec7f8182084', 'request_id': 'req-0d0440e5-edeb-4f88-ace1-441a1c63c26f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:47.752025 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a0595-806d-423c-a670-8dd3d0514b44 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:47.753211 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0d0440e5-edeb-4f88-ace1-441a1c63c26f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29c09cf294264d0ea05a4ec7f8182084', 'request_id': 'req-0d0440e5-edeb-4f88-ace1-441a1c63c26f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:47.761455 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0d0440e5-edeb-4f88-ace1-441a1c63c26f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29c09cf294264d0ea05a4ec7f8182084', 'request_id': 'req-0d0440e5-edeb-4f88-ace1-441a1c63c26f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:47.780778 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0d0440e5-edeb-4f88-ace1-441a1c63c26f admin admin] The token cache is being invalidate because project 29c09cf294264d0ea05a4ec7f8182084 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:47.781168 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0d0440e5-edeb-4f88-ace1-441a1c63c26f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:47.781858 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0d0440e5-edeb-4f88-ace1-441a1c63c26f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:47.795899 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1057/2145] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:47 2022] DELETE /identity/v3/projects/29c09cf294264d0ea05a4ec7f8182084 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:47.802775 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2c683-654e-430c-8376-5a058987b3e9 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:47.803237 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2c683-654e-430c-8376-5a058987b3e9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:47.803526 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2c683-654e-430c-8376-5a058987b3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:47.827355 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-70a2c683-654e-430c-8376-5a058987b3e9 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:47.829193 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-70a2c683-654e-430c-8376-5a058987b3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:47.862145 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db230834-1837-4217-9c4d-7e3a4683858e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:47.863277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db230834-1837-4217-9c4d-7e3a4683858e admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:47.863559 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db230834-1837-4217-9c4d-7e3a4683858e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:47.863833 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db230834-1837-4217-9c4d-7e3a4683858e admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:47.866928 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db230834-1837-4217-9c4d-7e3a4683858e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:47.868821 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db230834-1837-4217-9c4d-7e3a4683858e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:47.887833 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1089/2146] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:47.888943 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db230834-1837-4217-9c4d-7e3a4683858e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:47.891230 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-db230834-1837-4217-9c4d-7e3a4683858e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:47.906321 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db230834-1837-4217-9c4d-7e3a4683858e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:47.912597 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b62ad-679a-45ce-9e7c-98fb0c3af9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:47.913952 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b62ad-679a-45ce-9e7c-98fb0c3af9eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:47.913952 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b62ad-679a-45ce-9e7c-98fb0c3af9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:47.914171 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b62ad-679a-45ce-9e7c-98fb0c3af9eb admin admin] PATH_INFO: `/v3/projects/3946cee39845455ea6a2d5780c849c26/users/b1253d11eab44bb6abba5aa1af08583f/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:47.918395 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1058/2147] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:47.927832 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a928e2e-a599-4806-b8d1-834ef4ebae04 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:47.929080 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a928e2e-a599-4806-b8d1-834ef4ebae04 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:47.929649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a928e2e-a599-4806-b8d1-834ef4ebae04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:47.932617 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b62ad-679a-45ce-9e7c-98fb0c3af9eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3946cee39845455ea6a2d5780c849c26, user_id=b1253d11eab44bb6abba5aa1af08583f, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:47.935149 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b62ad-679a-45ce-9e7c-98fb0c3af9eb admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:47.952713 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3a928e2e-a599-4806-b8d1-834ef4ebae04 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:47.955038 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3a928e2e-a599-4806-b8d1-834ef4ebae04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:47.960004 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1090/2148] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:47 2022] PUT /identity/v3/projects/3946cee39845455ea6a2d5780c849c26/users/b1253d11eab44bb6abba5aa1af08583f/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:47.964059 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b62ad-679a-45ce-9e7c-98fb0c3af9eb admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:48.041742 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b62ad-679a-45ce-9e7c-98fb0c3af9eb admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:48.051403 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e1a76-3b89-4089-828d-b380a23d1cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:48.052183 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e1a76-3b89-4089-828d-b380a23d1cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:48.052375 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e1a76-3b89-4089-828d-b380a23d1cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:48.052644 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e1a76-3b89-4089-828d-b380a23d1cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:48.053373 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e1a76-3b89-4089-828d-b380a23d1cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:48.054983 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e1a76-3b89-4089-828d-b380a23d1cc3 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:48.056615 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:48.070637 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1059/2149] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:48.073571 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1091/2150] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:57:48.073917 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a928e2e-a599-4806-b8d1-834ef4ebae04 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:48.074550 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e1a76-3b89-4089-828d-b380a23d1cc3 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:48.084611 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a928e2e-a599-4806-b8d1-834ef4ebae04 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:48.085883 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e1a76-3b89-4089-828d-b380a23d1cc3 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:48.089262 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e4dac-aaae-4c60-bee0-64df0119acf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:48.090428 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e4dac-aaae-4c60-bee0-64df0119acf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:48.090763 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e4dac-aaae-4c60-bee0-64df0119acf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:48.091064 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bda0a-6d0a-4fcb-9531-490721c774c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:48.091176 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e4dac-aaae-4c60-bee0-64df0119acf3 admin admin] PATH_INFO: `/v3/projects/3946cee39845455ea6a2d5780c849c26/users/b1253d11eab44bb6abba5aa1af08583f/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:48.091884 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bda0a-6d0a-4fcb-9531-490721c774c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:48.092283 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bda0a-6d0a-4fcb-9531-490721c774c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:48.092796 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bda0a-6d0a-4fcb-9531-490721c774c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:48.093738 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e4dac-aaae-4c60-bee0-64df0119acf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3946cee39845455ea6a2d5780c849c26, user_id=b1253d11eab44bb6abba5aa1af08583f, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:48.094229 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643bda0a-6d0a-4fcb-9531-490721c774c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:57:48.094556 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643bda0a-6d0a-4fcb-9531-490721c774c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:48.096375 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643bda0a-6d0a-4fcb-9531-490721c774c9 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:48.096561 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e4dac-aaae-4c60-bee0-64df0119acf3 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:48.108245 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1060/2151] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:48 2022] PUT /identity/v3/projects/3946cee39845455ea6a2d5780c849c26/users/b1253d11eab44bb6abba5aa1af08583f/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:48.119087 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44a7ee-aef9-4a41-b5fe-d23e27317c00 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:48.119437 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44a7ee-aef9-4a41-b5fe-d23e27317c00 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:48.119783 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1092/2152] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:57:48.124118 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44a7ee-aef9-4a41-b5fe-d23e27317c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:48.124528 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bda0a-6d0a-4fcb-9531-490721c774c9 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:48.135929 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bda0a-6d0a-4fcb-9531-490721c774c9 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:48.156633 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-8d44a7ee-aef9-4a41-b5fe-d23e27317c00 None None] MFA Rules not processed for user `b1253d11eab44bb6abba5aa1af08583f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:48.158344 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8d44a7ee-aef9-4a41-b5fe-d23e27317c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:48.184244 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:48.215231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cdb94-960e-4776-88d1-92b1f71fdbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:48.215915 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cdb94-960e-4776-88d1-92b1f71fdbf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:48.216202 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cdb94-960e-4776-88d1-92b1f71fdbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:48.216477 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cdb94-960e-4776-88d1-92b1f71fdbf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:48.217163 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9cdb94-960e-4776-88d1-92b1f71fdbf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:48.219466 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9cdb94-960e-4776-88d1-92b1f71fdbf8 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:48.248545 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1093/2153] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:48 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:57:48.248733 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1061/2154] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:57:48.253095 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cdb94-960e-4776-88d1-92b1f71fdbf8 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:48.262674 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44a7ee-aef9-4a41-b5fe-d23e27317c00 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:48.264264 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8d44a7ee-aef9-4a41-b5fe-d23e27317c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:48.323272 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cdb94-960e-4776-88d1-92b1f71fdbf8 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:48.328495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a7ff6-fd58-4282-baca-b1de7121d554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:48.329156 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a7ff6-fd58-4282-baca-b1de7121d554 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:48.329441 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a7ff6-fd58-4282-baca-b1de7121d554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:48.329713 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a7ff6-fd58-4282-baca-b1de7121d554 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:48.330459 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a7ff6-fd58-4282-baca-b1de7121d554 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:48.331710 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44a7ee-aef9-4a41-b5fe-d23e27317c00 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:48.332565 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a7ff6-fd58-4282-baca-b1de7121d554 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:48.359254 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1094/2155] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:48 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:48.363388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a7ff6-fd58-4282-baca-b1de7121d554 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:48.375436 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a7ff6-fd58-4282-baca-b1de7121d554 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:48.382752 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc023bd6-7157-4907-81cb-82718c3d84d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:48.383638 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc023bd6-7157-4907-81cb-82718c3d84d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:48.384095 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc023bd6-7157-4907-81cb-82718c3d84d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:48.384432 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc023bd6-7157-4907-81cb-82718c3d84d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:48.385223 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc023bd6-7157-4907-81cb-82718c3d84d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:48.386898 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc023bd6-7157-4907-81cb-82718c3d84d8 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:48.398075 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1095/2156] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:48.401903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc023bd6-7157-4907-81cb-82718c3d84d8 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:48.408290 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08aa1b-5701-4765-9668-cb3670dc4960 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:48.409015 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08aa1b-5701-4765-9668-cb3670dc4960 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:48.410482 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08aa1b-5701-4765-9668-cb3670dc4960 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:48.410798 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08aa1b-5701-4765-9668-cb3670dc4960 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:48.415022 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc023bd6-7157-4907-81cb-82718c3d84d8 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:48.415161 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fd08aa1b-5701-4765-9668-cb3670dc4960 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:48.419981 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e528dd-cd08-4f65-9af7-c8e81b5db87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:48.421169 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e528dd-cd08-4f65-9af7-c8e81b5db87e admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:48.421602 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e528dd-cd08-4f65-9af7-c8e81b5db87e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:48.421979 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e528dd-cd08-4f65-9af7-c8e81b5db87e admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:48.422833 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e528dd-cd08-4f65-9af7-c8e81b5db87e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:48.425012 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e528dd-cd08-4f65-9af7-c8e81b5db87e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:48.439278 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1096/2157] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:48.440428 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e528dd-cd08-4f65-9af7-c8e81b5db87e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:48.450282 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e528dd-cd08-4f65-9af7-c8e81b5db87e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:48.457058 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d78c2-4e88-4df0-be56-8bfbc3025dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:48.457866 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d78c2-4e88-4df0-be56-8bfbc3025dd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:48.458146 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d78c2-4e88-4df0-be56-8bfbc3025dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:48.458506 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d78c2-4e88-4df0-be56-8bfbc3025dd3 admin admin] PATH_INFO: `/v3/projects/79e18d0a45654642b9ddcae6b523c6ed/users/aac679c24c8c46d6a76217fd2df01f86/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:48.473475 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d78c2-4e88-4df0-be56-8bfbc3025dd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79e18d0a45654642b9ddcae6b523c6ed, user_id=aac679c24c8c46d6a76217fd2df01f86, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:48.476261 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d78c2-4e88-4df0-be56-8bfbc3025dd3 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:48.479351 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08aa1b-5701-4765-9668-cb3670dc4960 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:48.480901 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08aa1b-5701-4765-9668-cb3670dc4960 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:48.492137 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1062/2158] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:57:48.494409 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1097/2159] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:48 2022] PUT /identity/v3/projects/79e18d0a45654642b9ddcae6b523c6ed/users/aac679c24c8c46d6a76217fd2df01f86/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:48.505373 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9366f6-f641-459d-bbc2-41cc13f9f3eb None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:48.505727 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9366f6-f641-459d-bbc2-41cc13f9f3eb None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:48.506698 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9366f6-f641-459d-bbc2-41cc13f9f3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:48.534050 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-cf9366f6-f641-459d-bbc2-41cc13f9f3eb None None] MFA Rules not processed for user `aac679c24c8c46d6a76217fd2df01f86`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:48.535393 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-cf9366f6-f641-459d-bbc2-41cc13f9f3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:48.552164 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:48.613531 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1063/2160] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:48.618082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d78c2-4e88-4df0-be56-8bfbc3025dd3 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:48.631246 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:48.683725 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d78c2-4e88-4df0-be56-8bfbc3025dd3 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:48.689689 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231e917-dbfa-4bd3-b515-03ad437e46df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:48.690347 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231e917-dbfa-4bd3-b515-03ad437e46df admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:48.690652 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231e917-dbfa-4bd3-b515-03ad437e46df admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:48.690943 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231e917-dbfa-4bd3-b515-03ad437e46df admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:48.694353 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231e917-dbfa-4bd3-b515-03ad437e46df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:48.698370 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231e917-dbfa-4bd3-b515-03ad437e46df admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:48.727284 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1098/2161] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:48 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:48.731294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9366f6-f641-459d-bbc2-41cc13f9f3eb None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:48.742791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9366f6-f641-459d-bbc2-41cc13f9f3eb None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:48.816732 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f238c-f048-4ce3-a4cf-4e25e35b54c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:48.817486 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f238c-f048-4ce3-a4cf-4e25e35b54c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:48.817765 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f238c-f048-4ce3-a4cf-4e25e35b54c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:48.818035 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f238c-f048-4ce3-a4cf-4e25e35b54c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:48.818756 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f238c-f048-4ce3-a4cf-4e25e35b54c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:48.821439 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f238c-f048-4ce3-a4cf-4e25e35b54c4 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:48.856068 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1064/2162] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:48 2022] POST /identity/v3/users => generated 297 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:57:48.859667 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231e917-dbfa-4bd3-b515-03ad437e46df admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:48.875061 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231e917-dbfa-4bd3-b515-03ad437e46df admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:48.880615 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b31c0-807d-43ce-b8d9-883b2ea2631c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:48.881467 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b31c0-807d-43ce-b8d9-883b2ea2631c admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:48.881825 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b31c0-807d-43ce-b8d9-883b2ea2631c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:48.882102 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b31c0-807d-43ce-b8d9-883b2ea2631c admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:48.882947 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b31c0-807d-43ce-b8d9-883b2ea2631c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:48.885095 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b31c0-807d-43ce-b8d9-883b2ea2631c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:48.899391 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1099/2163] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:48.906803 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f238c-f048-4ce3-a4cf-4e25e35b54c4 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:48.917019 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f238c-f048-4ce3-a4cf-4e25e35b54c4 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:48.921743 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8d63a-4461-40d8-96fd-18827d2cf89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:48.922627 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8d63a-4461-40d8-96fd-18827d2cf89d admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:48.922904 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8d63a-4461-40d8-96fd-18827d2cf89d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:48.923172 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8d63a-4461-40d8-96fd-18827d2cf89d admin admin] PATH_INFO: `/v3/projects/fd69040b232547e39dc68ea66e27b1dd/users/a020f313af4b4f549897f1cc40a379e1/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:48.939318 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8d63a-4461-40d8-96fd-18827d2cf89d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd69040b232547e39dc68ea66e27b1dd, user_id=a020f313af4b4f549897f1cc40a379e1, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:48.942436 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8d63a-4461-40d8-96fd-18827d2cf89d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:48.964560 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1065/2164] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:48 2022] PUT /identity/v3/projects/fd69040b232547e39dc68ea66e27b1dd/users/a020f313af4b4f549897f1cc40a379e1/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:48.969562 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b31c0-807d-43ce-b8d9-883b2ea2631c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:48.982362 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b31c0-807d-43ce-b8d9-883b2ea2631c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:49.056461 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313fd30-2d4f-4873-bc45-c4fb1bbd3ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:49.056647 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313fd30-2d4f-4873-bc45-c4fb1bbd3ffa admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:49.056850 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313fd30-2d4f-4873-bc45-c4fb1bbd3ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:49.057128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313fd30-2d4f-4873-bc45-c4fb1bbd3ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:49.058070 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313fd30-2d4f-4873-bc45-c4fb1bbd3ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:49.059741 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313fd30-2d4f-4873-bc45-c4fb1bbd3ffa admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:49.072565 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1100/2165] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:57:49.076658 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8d63a-4461-40d8-96fd-18827d2cf89d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:49.088959 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8d63a-4461-40d8-96fd-18827d2cf89d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:49.094381 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893886f-919b-4ba5-9415-4929cbd2e2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:49.095294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893886f-919b-4ba5-9415-4929cbd2e2dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:49.095584 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893886f-919b-4ba5-9415-4929cbd2e2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:49.095853 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893886f-919b-4ba5-9415-4929cbd2e2dc admin admin] PATH_INFO: `/v3/projects/fd69040b232547e39dc68ea66e27b1dd/users/a020f313af4b4f549897f1cc40a379e1/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:49.098890 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893886f-919b-4ba5-9415-4929cbd2e2dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd69040b232547e39dc68ea66e27b1dd, user_id=a020f313af4b4f549897f1cc40a379e1, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:49.105677 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893886f-919b-4ba5-9415-4929cbd2e2dc admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:49.113993 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1066/2166] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:49 2022] PUT /identity/v3/projects/fd69040b232547e39dc68ea66e27b1dd/users/a020f313af4b4f549897f1cc40a379e1/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:49.128070 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e9139-1ceb-459b-abe0-c21fd147d0e1 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:49.128375 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e9139-1ceb-459b-abe0-c21fd147d0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:49.129515 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e9139-1ceb-459b-abe0-c21fd147d0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:49.164413 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-dd0e9139-1ceb-459b-abe0-c21fd147d0e1 None None] MFA Rules not processed for user `a020f313af4b4f549897f1cc40a379e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:49.166292 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-dd0e9139-1ceb-459b-abe0-c21fd147d0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:49.249955 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1101/2167] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:49.262846 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893886f-919b-4ba5-9415-4929cbd2e2dc admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:49.346033 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893886f-919b-4ba5-9415-4929cbd2e2dc admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:49.350559 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab86db-9b79-4d5f-aeae-fc1c28207573 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:49.351217 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab86db-9b79-4d5f-aeae-fc1c28207573 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:49.351497 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab86db-9b79-4d5f-aeae-fc1c28207573 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:49.351772 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab86db-9b79-4d5f-aeae-fc1c28207573 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:49.364729 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dab86db-9b79-4d5f-aeae-fc1c28207573 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:49.366860 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dab86db-9b79-4d5f-aeae-fc1c28207573 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:49.380883 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1067/2168] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:49.463682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e9139-1ceb-459b-abe0-c21fd147d0e1 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:49.465353 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-dd0e9139-1ceb-459b-abe0-c21fd147d0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:49.483572 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e9139-1ceb-459b-abe0-c21fd147d0e1 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:49.487412 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bbaf6f-8098-43a1-83dd-64e9d5866ce6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:49.488178 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbaf6f-8098-43a1-83dd-64e9d5866ce6 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:49.488407 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbaf6f-8098-43a1-83dd-64e9d5866ce6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:49.488727 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbaf6f-8098-43a1-83dd-64e9d5866ce6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:49.493837 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:49.566535 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bbaf6f-8098-43a1-83dd-64e9d5866ce6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:49.567892 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bbaf6f-8098-43a1-83dd-64e9d5866ce6 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:49.579965 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1102/2169] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:49.951795 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab86db-9b79-4d5f-aeae-fc1c28207573 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:49.972927 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:50.050178 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab86db-9b79-4d5f-aeae-fc1c28207573 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:50.055243 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a8a88-18ef-4f34-a56f-e89b957e3f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:50.056353 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a8a88-18ef-4f34-a56f-e89b957e3f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:50.056696 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a8a88-18ef-4f34-a56f-e89b957e3f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:50.057040 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a8a88-18ef-4f34-a56f-e89b957e3f25 admin admin] PATH_INFO: `/v3/users/aac679c24c8c46d6a76217fd2df01f86` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:50.060167 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a8a88-18ef-4f34-a56f-e89b957e3f25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aac679c24c8c46d6a76217fd2df01f86)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:50.062449 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a8a88-18ef-4f34-a56f-e89b957e3f25 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:50.132586 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ef9a8a88-18ef-4f34-a56f-e89b957e3f25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aac679c24c8c46d6a76217fd2df01f86'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:50.145242 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ef9a8a88-18ef-4f34-a56f-e89b957e3f25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aac679c24c8c46d6a76217fd2df01f86'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:50.162202 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ef9a8a88-18ef-4f34-a56f-e89b957e3f25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aac679c24c8c46d6a76217fd2df01f86'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:50.180618 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ef9a8a88-18ef-4f34-a56f-e89b957e3f25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aac679c24c8c46d6a76217fd2df01f86'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:50.181557 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ef9a8a88-18ef-4f34-a56f-e89b957e3f25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aac679c24c8c46d6a76217fd2df01f86'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:50.193228 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1068/2170] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:49 2022] DELETE /identity/v3/users/aac679c24c8c46d6a76217fd2df01f86 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:50.197152 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0522c1-25ad-4795-9bc8-051135af6ed7 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:50.198206 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0522c1-25ad-4795-9bc8-051135af6ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:50.199180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0522c1-25ad-4795-9bc8-051135af6ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:50.224867 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-0c0522c1-25ad-4795-9bc8-051135af6ed7 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:50.226661 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-0c0522c1-25ad-4795-9bc8-051135af6ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:50.333459 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1103/2171] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:50.349390 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a8a88-18ef-4f34-a56f-e89b957e3f25 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:50.351713 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ef9a8a88-18ef-4f34-a56f-e89b957e3f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:50.461024 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a8a88-18ef-4f34-a56f-e89b957e3f25 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:50.466884 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55139414-1af8-4080-acc3-9c5b39461175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:50.469298 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55139414-1af8-4080-acc3-9c5b39461175 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:50.469298 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55139414-1af8-4080-acc3-9c5b39461175 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:50.469298 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55139414-1af8-4080-acc3-9c5b39461175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:50.482564 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55139414-1af8-4080-acc3-9c5b39461175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:50.484756 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55139414-1af8-4080-acc3-9c5b39461175 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:50.502741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1069/2172] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:51.077587 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0522c1-25ad-4795-9bc8-051135af6ed7 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:51.079047 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-0c0522c1-25ad-4795-9bc8-051135af6ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:51.091423 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0522c1-25ad-4795-9bc8-051135af6ed7 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:51.096743 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039e43a-2a4d-4025-8587-14d752a955f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:51.097805 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039e43a-2a4d-4025-8587-14d752a955f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:51.098117 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039e43a-2a4d-4025-8587-14d752a955f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:51.098484 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039e43a-2a4d-4025-8587-14d752a955f4 admin admin] PATH_INFO: `/v3/projects/79e18d0a45654642b9ddcae6b523c6ed` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:51.099844 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039e43a-2a4d-4025-8587-14d752a955f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79e18d0a45654642b9ddcae6b523c6ed)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:51.101922 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039e43a-2a4d-4025-8587-14d752a955f4 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:51.159739 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8039e43a-2a4d-4025-8587-14d752a955f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79e18d0a45654642b9ddcae6b523c6ed', 'request_id': 'req-8039e43a-2a4d-4025-8587-14d752a955f4'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:51.167449 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8039e43a-2a4d-4025-8587-14d752a955f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79e18d0a45654642b9ddcae6b523c6ed', 'request_id': 'req-8039e43a-2a4d-4025-8587-14d752a955f4'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:51.175034 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8039e43a-2a4d-4025-8587-14d752a955f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79e18d0a45654642b9ddcae6b523c6ed', 'request_id': 'req-8039e43a-2a4d-4025-8587-14d752a955f4'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:51.191901 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8039e43a-2a4d-4025-8587-14d752a955f4 admin admin] The token cache is being invalidate because project 79e18d0a45654642b9ddcae6b523c6ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:51.192278 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8039e43a-2a4d-4025-8587-14d752a955f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:51.194638 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8039e43a-2a4d-4025-8587-14d752a955f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:51.196777 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1104/2173] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:51 2022] DELETE /identity/v3/projects/79e18d0a45654642b9ddcae6b523c6ed => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:51.200671 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55139414-1af8-4080-acc3-9c5b39461175 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:51.211138 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55139414-1af8-4080-acc3-9c5b39461175 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:51.263862 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:51.322108 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64557cbc-d48f-4eff-8ceb-a73a27bb43c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:51.322935 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64557cbc-d48f-4eff-8ceb-a73a27bb43c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:51.323265 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64557cbc-d48f-4eff-8ceb-a73a27bb43c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:51.323723 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64557cbc-d48f-4eff-8ceb-a73a27bb43c2 admin admin] PATH_INFO: `/v3/users/a020f313af4b4f549897f1cc40a379e1` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:51.327597 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64557cbc-d48f-4eff-8ceb-a73a27bb43c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a020f313af4b4f549897f1cc40a379e1)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:51.341975 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64557cbc-d48f-4eff-8ceb-a73a27bb43c2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:51.410881 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-64557cbc-d48f-4eff-8ceb-a73a27bb43c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a020f313af4b4f549897f1cc40a379e1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:51.422876 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-64557cbc-d48f-4eff-8ceb-a73a27bb43c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a020f313af4b4f549897f1cc40a379e1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:51.434327 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-64557cbc-d48f-4eff-8ceb-a73a27bb43c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a020f313af4b4f549897f1cc40a379e1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:51.455057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-64557cbc-d48f-4eff-8ceb-a73a27bb43c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a020f313af4b4f549897f1cc40a379e1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:51.456424 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-64557cbc-d48f-4eff-8ceb-a73a27bb43c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a020f313af4b4f549897f1cc40a379e1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:51.465145 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1070/2174] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:51 2022] DELETE /identity/v3/users/a020f313af4b4f549897f1cc40a379e1 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:51.870125 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039e43a-2a4d-4025-8587-14d752a955f4 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:51.872604 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8039e43a-2a4d-4025-8587-14d752a955f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:51.924662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039e43a-2a4d-4025-8587-14d752a955f4 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:51.966623 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:52.031680 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696ccf9-7737-4ccd-9f74-feab7b197c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:52.033085 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696ccf9-7737-4ccd-9f74-feab7b197c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:52.033225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696ccf9-7737-4ccd-9f74-feab7b197c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:52.033433 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696ccf9-7737-4ccd-9f74-feab7b197c1c admin admin] PATH_INFO: `/v3/projects/fd69040b232547e39dc68ea66e27b1dd` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:52.034820 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8696ccf9-7737-4ccd-9f74-feab7b197c1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd69040b232547e39dc68ea66e27b1dd)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:52.037199 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8696ccf9-7737-4ccd-9f74-feab7b197c1c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:52.091858 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8696ccf9-7737-4ccd-9f74-feab7b197c1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd69040b232547e39dc68ea66e27b1dd', 'request_id': 'req-8696ccf9-7737-4ccd-9f74-feab7b197c1c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:52.098074 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8696ccf9-7737-4ccd-9f74-feab7b197c1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd69040b232547e39dc68ea66e27b1dd', 'request_id': 'req-8696ccf9-7737-4ccd-9f74-feab7b197c1c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:52.104735 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8696ccf9-7737-4ccd-9f74-feab7b197c1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd69040b232547e39dc68ea66e27b1dd', 'request_id': 'req-8696ccf9-7737-4ccd-9f74-feab7b197c1c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:52.118187 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8696ccf9-7737-4ccd-9f74-feab7b197c1c admin admin] The token cache is being invalidate because project fd69040b232547e39dc68ea66e27b1dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:52.118489 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8696ccf9-7737-4ccd-9f74-feab7b197c1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:52.119161 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8696ccf9-7737-4ccd-9f74-feab7b197c1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:52.120805 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1105/2175] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:51 2022] DELETE /identity/v3/projects/fd69040b232547e39dc68ea66e27b1dd => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:52.125864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda97c3-ed11-4998-8ac5-755db99532a5 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:52.126152 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda97c3-ed11-4998-8ac5-755db99532a5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:52.126430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda97c3-ed11-4998-8ac5-755db99532a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:52.145769 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-aeda97c3-ed11-4998-8ac5-755db99532a5 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:52.147274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-aeda97c3-ed11-4998-8ac5-755db99532a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:52.218151 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1071/2176] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:52.225707 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b3eff-631e-4a7b-8479-6a89fb45aa5b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:52.226097 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b3eff-631e-4a7b-8479-6a89fb45aa5b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:52.226442 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b3eff-631e-4a7b-8479-6a89fb45aa5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:52.246357 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-f02b3eff-631e-4a7b-8479-6a89fb45aa5b None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:52.247782 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f02b3eff-631e-4a7b-8479-6a89fb45aa5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:52.258576 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1106/2177] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:52.263404 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda97c3-ed11-4998-8ac5-755db99532a5 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:52.274396 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda97c3-ed11-4998-8ac5-755db99532a5 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:52.280156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3ec7a-6614-4a9c-8f82-709c3575120c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:52.280918 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3ec7a-6614-4a9c-8f82-709c3575120c admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:52.281207 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3ec7a-6614-4a9c-8f82-709c3575120c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:52.281485 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3ec7a-6614-4a9c-8f82-709c3575120c admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:52.282478 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3ec7a-6614-4a9c-8f82-709c3575120c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:57:52.282794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3ec7a-6614-4a9c-8f82-709c3575120c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:52.285199 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3ec7a-6614-4a9c-8f82-709c3575120c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:52.302297 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1072/2178] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:57:52.303491 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b3eff-631e-4a7b-8479-6a89fb45aa5b None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:52.313468 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b3eff-631e-4a7b-8479-6a89fb45aa5b None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:52.318586 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6f91d-1aff-417b-a83b-3bcc6680282c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:52.319239 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6f91d-1aff-417b-a83b-3bcc6680282c admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:52.319521 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6f91d-1aff-417b-a83b-3bcc6680282c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:52.319796 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6f91d-1aff-417b-a83b-3bcc6680282c admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:52.320525 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c6f91d-1aff-417b-a83b-3bcc6680282c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:52.322456 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c6f91d-1aff-417b-a83b-3bcc6680282c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:52.364646 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1107/2179] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:52 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:57:52.369746 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3ec7a-6614-4a9c-8f82-709c3575120c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:52.383973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3ec7a-6614-4a9c-8f82-709c3575120c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:52.447792 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:52.475546 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6b933-d420-44fa-b577-46682b62bb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:52.476357 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6b933-d420-44fa-b577-46682b62bb17 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:52.476670 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6b933-d420-44fa-b577-46682b62bb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:52.477249 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6b933-d420-44fa-b577-46682b62bb17 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:52.477969 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6b933-d420-44fa-b577-46682b62bb17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:52.479927 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6b933-d420-44fa-b577-46682b62bb17 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:52.512301 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1073/2180] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:52 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:57:52.514787 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6f91d-1aff-417b-a83b-3bcc6680282c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:52.533831 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6f91d-1aff-417b-a83b-3bcc6680282c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:52.541023 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308c982-6b45-4968-a662-dd71695d0ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:52.541957 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308c982-6b45-4968-a662-dd71695d0ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:52.542639 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308c982-6b45-4968-a662-dd71695d0ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:52.543177 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308c982-6b45-4968-a662-dd71695d0ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:52.544554 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308c982-6b45-4968-a662-dd71695d0ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:52.547298 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308c982-6b45-4968-a662-dd71695d0ba8 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:52.575494 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1108/2181] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:52.576822 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6b933-d420-44fa-b577-46682b62bb17 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:52.587747 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6b933-d420-44fa-b577-46682b62bb17 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:52.593387 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84de187-0938-489d-b5ee-e3f50ba9f425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:52.594063 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84de187-0938-489d-b5ee-e3f50ba9f425 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:52.594352 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84de187-0938-489d-b5ee-e3f50ba9f425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:52.594817 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84de187-0938-489d-b5ee-e3f50ba9f425 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:52.595590 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84de187-0938-489d-b5ee-e3f50ba9f425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:52.597368 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84de187-0938-489d-b5ee-e3f50ba9f425 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:52.610261 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1074/2182] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:52.614636 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308c982-6b45-4968-a662-dd71695d0ba8 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:52.628243 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308c982-6b45-4968-a662-dd71695d0ba8 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:52.634570 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb3226-5a59-40eb-ada9-422822209171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:52.636186 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb3226-5a59-40eb-ada9-422822209171 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:52.636472 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb3226-5a59-40eb-ada9-422822209171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:52.636886 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb3226-5a59-40eb-ada9-422822209171 admin admin] PATH_INFO: `/v3/projects/1c32525118c54f22978e4eba83573e9e/users/e521d781947d4e1c95461b2f901674a6/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:52.666229 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb3226-5a59-40eb-ada9-422822209171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c32525118c54f22978e4eba83573e9e, user_id=e521d781947d4e1c95461b2f901674a6, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:52.670287 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb3226-5a59-40eb-ada9-422822209171 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:52.700129 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1109/2183] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:52 2022] PUT /identity/v3/projects/1c32525118c54f22978e4eba83573e9e/users/e521d781947d4e1c95461b2f901674a6/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:52.703040 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93515811-dfdd-41ee-aa47-aee2d701d14e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:52.703356 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93515811-dfdd-41ee-aa47-aee2d701d14e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:52.703757 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93515811-dfdd-41ee-aa47-aee2d701d14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:52.725300 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-93515811-dfdd-41ee-aa47-aee2d701d14e None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:52.726626 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-93515811-dfdd-41ee-aa47-aee2d701d14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:52.790161 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1075/2184] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:52.802578 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb3226-5a59-40eb-ada9-422822209171 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:52.804415 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d6bb3226-5a59-40eb-ada9-422822209171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:52.881495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb3226-5a59-40eb-ada9-422822209171 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:52.885996 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9959bf1-1b3d-42ff-99fd-940f69bfa120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:52.886704 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9959bf1-1b3d-42ff-99fd-940f69bfa120 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:52.886991 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9959bf1-1b3d-42ff-99fd-940f69bfa120 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:52.887391 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9959bf1-1b3d-42ff-99fd-940f69bfa120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:52.909250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9959bf1-1b3d-42ff-99fd-940f69bfa120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:52.911255 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9959bf1-1b3d-42ff-99fd-940f69bfa120 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:52.917722 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:52.927133 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1110/2185] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:57:53.138419 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93515811-dfdd-41ee-aa47-aee2d701d14e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:53.141275 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-93515811-dfdd-41ee-aa47-aee2d701d14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:53.241034 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93515811-dfdd-41ee-aa47-aee2d701d14e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:53.248180 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01dfad9-7bbf-4dd5-b2df-09ffd35e7ad2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:53.249257 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dfad9-7bbf-4dd5-b2df-09ffd35e7ad2 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:53.249544 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dfad9-7bbf-4dd5-b2df-09ffd35e7ad2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:53.249816 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dfad9-7bbf-4dd5-b2df-09ffd35e7ad2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:53.251842 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a01dfad9-7bbf-4dd5-b2df-09ffd35e7ad2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:53.345314 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01dfad9-7bbf-4dd5-b2df-09ffd35e7ad2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:53.347406 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01dfad9-7bbf-4dd5-b2df-09ffd35e7ad2 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:53.378714 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1076/2186] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:54.271295 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f2c49-e310-400f-9fb7-4888d55e36b9 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:54.271892 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f2c49-e310-400f-9fb7-4888d55e36b9 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:54.271892 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f2c49-e310-400f-9fb7-4888d55e36b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:54.274897 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a3d90-2143-4e37-924d-72f374dc2b00 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:54.275813 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a3d90-2143-4e37-924d-72f374dc2b00 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:54.276140 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a3d90-2143-4e37-924d-72f374dc2b00 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:54.277863 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1077/2187] 10.222.0.85 () {54 vars in 921 bytes} [Thu Jun 16 14:57:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:57:54.286002 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b97b36-d64e-42a2-93ff-a766a8caace7 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:54.287930 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b97b36-d64e-42a2-93ff-a766a8caace7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:54.288449 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b97b36-d64e-42a2-93ff-a766a8caace7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:54.308504 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-3e4f2c49-e310-400f-9fb7-4888d55e36b9 None None] MFA Rules not processed for user `e521d781947d4e1c95461b2f901674a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:54.310412 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3e4f2c49-e310-400f-9fb7-4888d55e36b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:54.314698 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-01b97b36-d64e-42a2-93ff-a766a8caace7 None None] MFA Rules not processed for user `819ad532defb4adaa2f4fd06b47630d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:54.315932 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-01b97b36-d64e-42a2-93ff-a766a8caace7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:54.327263 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:54.411073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1111/2188] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:54.413100 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f2c49-e310-400f-9fb7-4888d55e36b9 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:54.415748 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3e4f2c49-e310-400f-9fb7-4888d55e36b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:54.417392 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1078/2189] 10.222.0.85 () {58 vars in 1018 bytes} [Thu Jun 16 14:57:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:57:54.418484 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b97b36-d64e-42a2-93ff-a766a8caace7 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:54.430068 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b97b36-d64e-42a2-93ff-a766a8caace7 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:54.431544 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f2c49-e310-400f-9fb7-4888d55e36b9 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:54.434740 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470333e-59d2-40a6-b300-169896801508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:54.435567 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470333e-59d2-40a6-b300-169896801508 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:54.435861 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470333e-59d2-40a6-b300-169896801508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:54.436209 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470333e-59d2-40a6-b300-169896801508 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:54.436768 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5f6c3-80f4-4832-ac85-bff65167d143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:54.436941 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470333e-59d2-40a6-b300-169896801508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:54.437785 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5f6c3-80f4-4832-ac85-bff65167d143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:54.438131 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5f6c3-80f4-4832-ac85-bff65167d143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:54.438468 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5f6c3-80f4-4832-ac85-bff65167d143 admin admin] PATH_INFO: `/v3/users/80e736205b5f4f4588f74b33624a5c15` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:54.438818 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470333e-59d2-40a6-b300-169896801508 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:54.439986 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5f6c3-80f4-4832-ac85-bff65167d143 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80e736205b5f4f4588f74b33624a5c15)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:54.442083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5f6c3-80f4-4832-ac85-bff65167d143 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:54.476044 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1079/2190] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:54 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:54.476796 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470333e-59d2-40a6-b300-169896801508 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:54.478438 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1470333e-59d2-40a6-b300-169896801508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:54.518211 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-f1a5f6c3-80f4-4832-ac85-bff65167d143 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80e736205b5f4f4588f74b33624a5c15'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:54.531258 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-f1a5f6c3-80f4-4832-ac85-bff65167d143 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80e736205b5f4f4588f74b33624a5c15'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:54.532098 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-f1a5f6c3-80f4-4832-ac85-bff65167d143 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80e736205b5f4f4588f74b33624a5c15'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:54.541910 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-f1a5f6c3-80f4-4832-ac85-bff65167d143 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80e736205b5f4f4588f74b33624a5c15'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:54.549866 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-f1a5f6c3-80f4-4832-ac85-bff65167d143 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80e736205b5f4f4588f74b33624a5c15'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:54.557378 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1112/2191] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:54 2022] DELETE /identity/v3/users/80e736205b5f4f4588f74b33624a5c15 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:54.564360 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5f6c3-80f4-4832-ac85-bff65167d143 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:54.568341 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-f1a5f6c3-80f4-4832-ac85-bff65167d143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:54.573735 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470333e-59d2-40a6-b300-169896801508 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:54.662908 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5f6c3-80f4-4832-ac85-bff65167d143 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:54.667125 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138e52d-b240-40da-b3eb-3674865d49e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819ad532defb4adaa2f4fd06b47630d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:54.667793 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138e52d-b240-40da-b3eb-3674865d49e2 service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:54.668116 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138e52d-b240-40da-b3eb-3674865d49e2 service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:54.668217 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c971fae-0325-41e2-87ff-f9dcc151ae85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:54.668391 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138e52d-b240-40da-b3eb-3674865d49e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:54.669139 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c971fae-0325-41e2-87ff-f9dcc151ae85 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:54.669499 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c971fae-0325-41e2-87ff-f9dcc151ae85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:54.669923 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c971fae-0325-41e2-87ff-f9dcc151ae85 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:54.670510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a138e52d-b240-40da-b3eb-3674865d49e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:54.670832 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c971fae-0325-41e2-87ff-f9dcc151ae85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:54.673215 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c971fae-0325-41e2-87ff-f9dcc151ae85 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:54.682060 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:54.684814 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138e52d-b240-40da-b3eb-3674865d49e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:54.688240 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138e52d-b240-40da-b3eb-3674865d49e2 service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:54.702472 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1080/2192] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:54.710218 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1113/2193] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:54 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:54.711724 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138e52d-b240-40da-b3eb-3674865d49e2 service placement] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:54.723263 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138e52d-b240-40da-b3eb-3674865d49e2 service placement] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:54.733786 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d02b5-c140-49d2-a6b8-bc79c92b4a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:54.734470 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d02b5-c140-49d2-a6b8-bc79c92b4a82 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:54.735018 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d02b5-c140-49d2-a6b8-bc79c92b4a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:54.735018 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d02b5-c140-49d2-a6b8-bc79c92b4a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:54.735738 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d02b5-c140-49d2-a6b8-bc79c92b4a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:54.737374 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d02b5-c140-49d2-a6b8-bc79c92b4a82 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:54.750230 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1081/2194] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:54.754400 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c971fae-0325-41e2-87ff-f9dcc151ae85 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:54.765668 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c971fae-0325-41e2-87ff-f9dcc151ae85 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:54.771481 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64584bf0-298c-4655-883f-b152d66c89a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:54.772502 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64584bf0-298c-4655-883f-b152d66c89a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:54.772786 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64584bf0-298c-4655-883f-b152d66c89a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:54.773063 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64584bf0-298c-4655-883f-b152d66c89a3 admin admin] PATH_INFO: `/v3/projects/6f662430268d48bcb58ea60b3d1c8458/users/cd94ad67fc1d46e9a6731ec93faa3c44/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:54.795199 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64584bf0-298c-4655-883f-b152d66c89a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f662430268d48bcb58ea60b3d1c8458, user_id=cd94ad67fc1d46e9a6731ec93faa3c44, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:54.799117 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64584bf0-298c-4655-883f-b152d66c89a3 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:54.826613 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1114/2195] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:54 2022] PUT /identity/v3/projects/6f662430268d48bcb58ea60b3d1c8458/users/cd94ad67fc1d46e9a6731ec93faa3c44/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:54.828111 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d02b5-c140-49d2-a6b8-bc79c92b4a82 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:54.836417 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:54.841199 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d02b5-c140-49d2-a6b8-bc79c92b4a82 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:54.851693 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64584bf0-298c-4655-883f-b152d66c89a3 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:54.853859 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-64584bf0-298c-4655-883f-b152d66c89a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:54.925313 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8127b5-e77a-470c-bb15-641f49559e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:54.925979 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8127b5-e77a-470c-bb15-641f49559e1e admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:54.926251 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8127b5-e77a-470c-bb15-641f49559e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:54.926637 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8127b5-e77a-470c-bb15-641f49559e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:54.927397 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8127b5-e77a-470c-bb15-641f49559e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:54.929268 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8127b5-e77a-470c-bb15-641f49559e1e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:54.939104 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64584bf0-298c-4655-883f-b152d66c89a3 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:54.940486 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1082/2196] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:54.944589 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8127b5-e77a-470c-bb15-641f49559e1e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:54.947379 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c352d8-b07c-47d6-b513-6b15b1e1cfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:54.948281 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c352d8-b07c-47d6-b513-6b15b1e1cfa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:54.948565 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c352d8-b07c-47d6-b513-6b15b1e1cfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:54.948842 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c352d8-b07c-47d6-b513-6b15b1e1cfa8 admin admin] PATH_INFO: `/v3/projects/8293e9a7092d4757ba9dc795e3644b35` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:54.950091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c352d8-b07c-47d6-b513-6b15b1e1cfa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8293e9a7092d4757ba9dc795e3644b35)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:54.952227 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c352d8-b07c-47d6-b513-6b15b1e1cfa8 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:54.955796 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8127b5-e77a-470c-bb15-641f49559e1e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:54.962188 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04bd47-0975-4d45-b2bc-f798e4183238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:54.963239 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04bd47-0975-4d45-b2bc-f798e4183238 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:54.963526 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04bd47-0975-4d45-b2bc-f798e4183238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:54.963821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04bd47-0975-4d45-b2bc-f798e4183238 admin admin] PATH_INFO: `/v3/projects/6f662430268d48bcb58ea60b3d1c8458/users/cd94ad67fc1d46e9a6731ec93faa3c44/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:54.965884 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04bd47-0975-4d45-b2bc-f798e4183238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f662430268d48bcb58ea60b3d1c8458, user_id=cd94ad67fc1d46e9a6731ec93faa3c44, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:54.968706 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04bd47-0975-4d45-b2bc-f798e4183238 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:54.981516 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1083/2197] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:54 2022] PUT /identity/v3/projects/6f662430268d48bcb58ea60b3d1c8458/users/cd94ad67fc1d46e9a6731ec93faa3c44/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:55.021416 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e4c352d8-b07c-47d6-b513-6b15b1e1cfa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8293e9a7092d4757ba9dc795e3644b35', 'request_id': 'req-e4c352d8-b07c-47d6-b513-6b15b1e1cfa8'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:55.030430 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e4c352d8-b07c-47d6-b513-6b15b1e1cfa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8293e9a7092d4757ba9dc795e3644b35', 'request_id': 'req-e4c352d8-b07c-47d6-b513-6b15b1e1cfa8'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:55.038602 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e4c352d8-b07c-47d6-b513-6b15b1e1cfa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8293e9a7092d4757ba9dc795e3644b35', 'request_id': 'req-e4c352d8-b07c-47d6-b513-6b15b1e1cfa8'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:55.056196 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e4c352d8-b07c-47d6-b513-6b15b1e1cfa8 admin admin] The token cache is being invalidate because project 8293e9a7092d4757ba9dc795e3644b35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:57:55.056557 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e4c352d8-b07c-47d6-b513-6b15b1e1cfa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:55.057717 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e4c352d8-b07c-47d6-b513-6b15b1e1cfa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:55.059562 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1115/2198] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:57:54 2022] DELETE /identity/v3/projects/8293e9a7092d4757ba9dc795e3644b35 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:55.065825 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf08cd-6e59-474d-b44b-fcb9246fe1ca None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:55.066170 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf08cd-6e59-474d-b44b-fcb9246fe1ca None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:55.066564 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf08cd-6e59-474d-b44b-fcb9246fe1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:55.091446 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4ddf08cd-6e59-474d-b44b-fcb9246fe1ca None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:55.091446 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4ddf08cd-6e59-474d-b44b-fcb9246fe1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:55.179806 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1084/2199] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:57:55.189526 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907315d-5f35-4179-ba39-ac35e075baa5 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:55.189817 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907315d-5f35-4179-ba39-ac35e075baa5 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:55.190095 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907315d-5f35-4179-ba39-ac35e075baa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:55.219505 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-c907315d-5f35-4179-ba39-ac35e075baa5 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:55.221038 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c907315d-5f35-4179-ba39-ac35e075baa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:55.230986 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1116/2200] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:55.235838 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf08cd-6e59-474d-b44b-fcb9246fe1ca None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:55.246276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf08cd-6e59-474d-b44b-fcb9246fe1ca None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:55.258391 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19f1e8-da2f-43bf-a6c6-9134ab44c977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:55.259131 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19f1e8-da2f-43bf-a6c6-9134ab44c977 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:55.259414 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19f1e8-da2f-43bf-a6c6-9134ab44c977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:55.259690 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19f1e8-da2f-43bf-a6c6-9134ab44c977 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:55.260976 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19f1e8-da2f-43bf-a6c6-9134ab44c977 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:57:55.261293 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19f1e8-da2f-43bf-a6c6-9134ab44c977 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:55.264237 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19f1e8-da2f-43bf-a6c6-9134ab44c977 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:55.280592 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1085/2201] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:57:55.285078 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907315d-5f35-4179-ba39-ac35e075baa5 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:55.295328 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907315d-5f35-4179-ba39-ac35e075baa5 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:55.300869 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05d446-812b-4ae5-a66b-9d085472978d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:55.301536 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05d446-812b-4ae5-a66b-9d085472978d admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:55.301885 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05d446-812b-4ae5-a66b-9d085472978d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:55.302154 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05d446-812b-4ae5-a66b-9d085472978d admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:55.302862 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05d446-812b-4ae5-a66b-9d085472978d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:55.304838 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05d446-812b-4ae5-a66b-9d085472978d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:55.335906 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1117/2202] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:55 2022] POST /identity/v3/projects => generated 403 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:55.337444 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19f1e8-da2f-43bf-a6c6-9134ab44c977 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:55.348024 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19f1e8-da2f-43bf-a6c6-9134ab44c977 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:55.432943 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77de54-821a-4d5f-8958-e2585e6baf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:55.433731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77de54-821a-4d5f-8958-e2585e6baf8d admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:55.434024 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77de54-821a-4d5f-8958-e2585e6baf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:55.434262 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77de54-821a-4d5f-8958-e2585e6baf8d admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:55.435145 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a77de54-821a-4d5f-8958-e2585e6baf8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:55.437258 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a77de54-821a-4d5f-8958-e2585e6baf8d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:55.459269 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1086/2203] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:55 2022] POST /identity/v3/users => generated 302 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:55.463840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05d446-812b-4ae5-a66b-9d085472978d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:55.474899 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05d446-812b-4ae5-a66b-9d085472978d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:55.480141 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae686b-e33f-4ede-a553-6164cb39efb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:55.480901 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae686b-e33f-4ede-a553-6164cb39efb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:55.481157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae686b-e33f-4ede-a553-6164cb39efb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:55.481593 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae686b-e33f-4ede-a553-6164cb39efb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:55.482336 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae686b-e33f-4ede-a553-6164cb39efb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:55.484135 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae686b-e33f-4ede-a553-6164cb39efb8 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:55.496740 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1118/2204] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:55.501313 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77de54-821a-4d5f-8958-e2585e6baf8d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:55.508221 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:55.512363 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77de54-821a-4d5f-8958-e2585e6baf8d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:55.521580 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e9114-26d9-49a3-b56c-ea5fd0077172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:55.521580 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e9114-26d9-49a3-b56c-ea5fd0077172 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:55.521580 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e9114-26d9-49a3-b56c-ea5fd0077172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:55.521580 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e9114-26d9-49a3-b56c-ea5fd0077172 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:55.521978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e9114-26d9-49a3-b56c-ea5fd0077172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:55.521978 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e9114-26d9-49a3-b56c-ea5fd0077172 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:55.534181 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1087/2205] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:55.538817 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae686b-e33f-4ede-a553-6164cb39efb8 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:55.549509 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae686b-e33f-4ede-a553-6164cb39efb8 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:55.554709 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b216a3-8603-40ea-bdee-37abad334228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:55.555616 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b216a3-8603-40ea-bdee-37abad334228 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:55.555916 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b216a3-8603-40ea-bdee-37abad334228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:55.556198 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b216a3-8603-40ea-bdee-37abad334228 admin admin] PATH_INFO: `/v3/projects/16715fa6ddcf41d680bbebb253ffddf2/users/ed2c5220a4cc422a84a62b6f6c6e6f37/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:55.574643 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:INSERT=6,keystone:SELECT=87,keystone:DELETE=7 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:55.578789 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b216a3-8603-40ea-bdee-37abad334228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16715fa6ddcf41d680bbebb253ffddf2, user_id=ed2c5220a4cc422a84a62b6f6c6e6f37, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:55.582321 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b216a3-8603-40ea-bdee-37abad334228 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:55.598610 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1119/2206] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:55 2022] PUT /identity/v3/projects/16715fa6ddcf41d680bbebb253ffddf2/users/ed2c5220a4cc422a84a62b6f6c6e6f37/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:55.603779 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3b389-48e2-464f-be64-c6c82359909a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:55.604106 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3b389-48e2-464f-be64-c6c82359909a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:55.604376 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3b389-48e2-464f-be64-c6c82359909a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:55.626329 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-efc3b389-48e2-464f-be64-c6c82359909a None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:55.627900 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-efc3b389-48e2-464f-be64-c6c82359909a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:55.696807 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1088/2207] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:55.707100 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b216a3-8603-40ea-bdee-37abad334228 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:55.709256 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-59b216a3-8603-40ea-bdee-37abad334228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:55.782174 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b216a3-8603-40ea-bdee-37abad334228 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:55.788361 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5146e-3da6-4bd5-a4d9-b5c73932f7eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:55.789090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5146e-3da6-4bd5-a4d9-b5c73932f7eb service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:55.789295 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5146e-3da6-4bd5-a4d9-b5c73932f7eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:55.789662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5146e-3da6-4bd5-a4d9-b5c73932f7eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:55.801212 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5146e-3da6-4bd5-a4d9-b5c73932f7eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:55.802680 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5146e-3da6-4bd5-a4d9-b5c73932f7eb service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:55.814307 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1120/2208] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:56.040353 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6016687-f11e-460d-bdce-409a30493ea5 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:56.040703 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6016687-f11e-460d-bdce-409a30493ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:56.041042 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6016687-f11e-460d-bdce-409a30493ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:56.077255 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b6016687-f11e-460d-bdce-409a30493ea5 None None] MFA Rules not processed for user `cd94ad67fc1d46e9a6731ec93faa3c44`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:56.079410 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b6016687-f11e-460d-bdce-409a30493ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:56.227552 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1089/2209] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:56 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:57:56.229791 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8575b-2c94-4e1c-abab-ca93e4f9a637 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:56.230110 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8575b-2c94-4e1c-abab-ca93e4f9a637 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:56.230384 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8575b-2c94-4e1c-abab-ca93e4f9a637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:56.258829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b9f8575b-2c94-4e1c-abab-ca93e4f9a637 None None] MFA Rules not processed for user `e521d781947d4e1c95461b2f901674a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:56.260083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b9f8575b-2c94-4e1c-abab-ca93e4f9a637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:56.390938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1121/2210] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:57:56.401946 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6016687-f11e-460d-bdce-409a30493ea5 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:56.403628 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b6016687-f11e-460d-bdce-409a30493ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:56.507736 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6016687-f11e-460d-bdce-409a30493ea5 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:56.515859 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b9ab7-5cf9-4110-8ed6-f16ed68c575b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:56.516852 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b9ab7-5cf9-4110-8ed6-f16ed68c575b service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:56.517819 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b9ab7-5cf9-4110-8ed6-f16ed68c575b service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:56.518148 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b9ab7-5cf9-4110-8ed6-f16ed68c575b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:56.520184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-810b9ab7-5cf9-4110-8ed6-f16ed68c575b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:56.535264 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b9ab7-5cf9-4110-8ed6-f16ed68c575b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:56.537531 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b9ab7-5cf9-4110-8ed6-f16ed68c575b service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:56.551892 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1090/2211] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:56.941433 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2d125-fc13-48b7-96e5-94db5016d367 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:56.941721 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2d125-fc13-48b7-96e5-94db5016d367 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:56.942001 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2d125-fc13-48b7-96e5-94db5016d367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:56.979746 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-afb2d125-fc13-48b7-96e5-94db5016d367 None None] MFA Rules not processed for user `ed2c5220a4cc422a84a62b6f6c6e6f37`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:56.981074 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-afb2d125-fc13-48b7-96e5-94db5016d367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:57.065699 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1122/2212] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:57.069757 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b9ab7-5cf9-4110-8ed6-f16ed68c575b service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:57.076393 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:57.083153 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b9ab7-5cf9-4110-8ed6-f16ed68c575b service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:57.088538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fb27c-022c-4542-97f4-f4f05de39379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:57.089516 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fb27c-022c-4542-97f4-f4f05de39379 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:57.090017 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fb27c-022c-4542-97f4-f4f05de39379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:57.090444 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fb27c-022c-4542-97f4-f4f05de39379 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:57.091355 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418fb27c-022c-4542-97f4-f4f05de39379 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:57.093974 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418fb27c-022c-4542-97f4-f4f05de39379 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:57.136700 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1091/2213] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:57:57 2022] POST /identity/v3/projects => generated 405 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:57.138208 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2d125-fc13-48b7-96e5-94db5016d367 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:57.154023 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2d125-fc13-48b7-96e5-94db5016d367 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:57.191587 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:57.230866 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0284b-8fa9-449d-b515-147d391a1510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:57.231699 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0284b-8fa9-449d-b515-147d391a1510 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:57.232076 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0284b-8fa9-449d-b515-147d391a1510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:57.232411 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0284b-8fa9-449d-b515-147d391a1510 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:57.233501 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0284b-8fa9-449d-b515-147d391a1510 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:57.237363 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0284b-8fa9-449d-b515-147d391a1510 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:57.274802 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1123/2214] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:57:57 2022] POST /identity/v3/users => generated 309 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:57:57.276184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fb27c-022c-4542-97f4-f4f05de39379 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:57.288815 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fb27c-022c-4542-97f4-f4f05de39379 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:57.305960 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd532a-6f7d-4957-b612-653e8223aaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:57.306695 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd532a-6f7d-4957-b612-653e8223aaec admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:57.306980 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd532a-6f7d-4957-b612-653e8223aaec admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:57.307256 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd532a-6f7d-4957-b612-653e8223aaec admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:57.308134 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd532a-6f7d-4957-b612-653e8223aaec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:57.310099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd532a-6f7d-4957-b612-653e8223aaec admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:57.332421 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1092/2215] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:57.334520 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0284b-8fa9-449d-b515-147d391a1510 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:57.351267 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0284b-8fa9-449d-b515-147d391a1510 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:57.356311 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36282dc-9696-4c0c-9685-67aa741885b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:57.357216 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36282dc-9696-4c0c-9685-67aa741885b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:57.357495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36282dc-9696-4c0c-9685-67aa741885b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:57.357772 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36282dc-9696-4c0c-9685-67aa741885b6 admin admin] PATH_INFO: `/v3/projects/c91bce25a8114d4183b0b87ec69726a6/users/13a911ac26044020b5cf0ec7a5b02693/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:57.376428 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36282dc-9696-4c0c-9685-67aa741885b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c91bce25a8114d4183b0b87ec69726a6, user_id=13a911ac26044020b5cf0ec7a5b02693, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:57.388447 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36282dc-9696-4c0c-9685-67aa741885b6 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:57.413281 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1124/2216] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:57 2022] PUT /identity/v3/projects/c91bce25a8114d4183b0b87ec69726a6/users/13a911ac26044020b5cf0ec7a5b02693/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:57.417147 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd532a-6f7d-4957-b612-653e8223aaec admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:57.432860 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd532a-6f7d-4957-b612-653e8223aaec admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:57.547461 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf08d83-5379-497a-99f1-a595beff139a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:57.548275 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf08d83-5379-497a-99f1-a595beff139a admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:57.548662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf08d83-5379-497a-99f1-a595beff139a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:57.548946 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf08d83-5379-497a-99f1-a595beff139a admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:57.549789 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf08d83-5379-497a-99f1-a595beff139a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:57.551518 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf08d83-5379-497a-99f1-a595beff139a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:57.563999 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1093/2217] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:57.567924 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36282dc-9696-4c0c-9685-67aa741885b6 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:57.579006 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36282dc-9696-4c0c-9685-67aa741885b6 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:57.583962 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33670b2-1820-47ad-a8cb-a0f02b3b2007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:57.584877 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33670b2-1820-47ad-a8cb-a0f02b3b2007 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:57.585156 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33670b2-1820-47ad-a8cb-a0f02b3b2007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:57.585459 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33670b2-1820-47ad-a8cb-a0f02b3b2007 admin admin] PATH_INFO: `/v3/projects/c91bce25a8114d4183b0b87ec69726a6/users/13a911ac26044020b5cf0ec7a5b02693/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:57.587684 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33670b2-1820-47ad-a8cb-a0f02b3b2007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c91bce25a8114d4183b0b87ec69726a6, user_id=13a911ac26044020b5cf0ec7a5b02693, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:57.590525 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33670b2-1820-47ad-a8cb-a0f02b3b2007 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:57.603004 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1125/2218] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:57:57 2022] PUT /identity/v3/projects/c91bce25a8114d4183b0b87ec69726a6/users/13a911ac26044020b5cf0ec7a5b02693/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:57:58.270851 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedb0e0-b0d5-4f19-9ee3-ebfc2b10ee97 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:58.271124 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedb0e0-b0d5-4f19-9ee3-ebfc2b10ee97 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:58.271404 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedb0e0-b0d5-4f19-9ee3-ebfc2b10ee97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:58.299457 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4aedb0e0-b0d5-4f19-9ee3-ebfc2b10ee97 None None] MFA Rules not processed for user `13a911ac26044020b5cf0ec7a5b02693`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:58.300747 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4aedb0e0-b0d5-4f19-9ee3-ebfc2b10ee97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:58.441849 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1094/2219] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:57:58 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:59.713246 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33670b2-1820-47ad-a8cb-a0f02b3b2007 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:59.715501 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d33670b2-1820-47ad-a8cb-a0f02b3b2007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:59.755363 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedb0e0-b0d5-4f19-9ee3-ebfc2b10ee97 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:59.757009 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4aedb0e0-b0d5-4f19-9ee3-ebfc2b10ee97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:59.809251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33670b2-1820-47ad-a8cb-a0f02b3b2007 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:59.815245 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b551e5-acfa-42ed-95da-295a1cd63011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:59.815788 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b551e5-acfa-42ed-95da-295a1cd63011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:59.816636 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b551e5-acfa-42ed-95da-295a1cd63011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:59.816984 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b551e5-acfa-42ed-95da-295a1cd63011 admin admin] PATH_INFO: `/v3/users/f0c519bb4a79403f93612414b6db66ee` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:59.818508 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b551e5-acfa-42ed-95da-295a1cd63011 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0c519bb4a79403f93612414b6db66ee)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:59.820563 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b551e5-acfa-42ed-95da-295a1cd63011 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:59.865744 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:59.886550 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e0b551e5-acfa-42ed-95da-295a1cd63011 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0c519bb4a79403f93612414b6db66ee'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:59.899955 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedb0e0-b0d5-4f19-9ee3-ebfc2b10ee97 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:59.909793 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e0b551e5-acfa-42ed-95da-295a1cd63011 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0c519bb4a79403f93612414b6db66ee'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:59.910683 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e0b551e5-acfa-42ed-95da-295a1cd63011 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0c519bb4a79403f93612414b6db66ee'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:59.911728 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f228f-1e8c-456a-b9c7-29b901678212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:59.913122 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f228f-1e8c-456a-b9c7-29b901678212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:59.913627 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f228f-1e8c-456a-b9c7-29b901678212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:59.914295 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f228f-1e8c-456a-b9c7-29b901678212 admin admin] PATH_INFO: `/v3/users/f95939bda4bf420796ed9eb312227620` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:59.915998 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f228f-1e8c-456a-b9c7-29b901678212 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f95939bda4bf420796ed9eb312227620)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:59.918710 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f228f-1e8c-456a-b9c7-29b901678212 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:59.922720 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e0b551e5-acfa-42ed-95da-295a1cd63011 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0c519bb4a79403f93612414b6db66ee'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:59.932873 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e0b551e5-acfa-42ed-95da-295a1cd63011 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0c519bb4a79403f93612414b6db66ee'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:57:59.935846 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:59.942783 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1126/2220] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:59 2022] DELETE /identity/v3/users/f0c519bb4a79403f93612414b6db66ee => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:57:59.944672 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d1665-05c7-4832-8091-7777bc02b3cd None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:59.945029 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d1665-05c7-4832-8091-7777bc02b3cd None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:59.945372 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d1665-05c7-4832-8091-7777bc02b3cd None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:59.947110 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1127/2221] 10.222.0.85 () {54 vars in 921 bytes} [Thu Jun 16 14:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:57:59.947935 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d1665-05c7-4832-8091-7777bc02b3cd None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:59.950028 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-592d1665-05c7-4832-8091-7777bc02b3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:59.990024 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3d5f228f-1e8c-456a-b9c7-29b901678212 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f95939bda4bf420796ed9eb312227620'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:00.006383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3d5f228f-1e8c-456a-b9c7-29b901678212 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f95939bda4bf420796ed9eb312227620'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:00.018744 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3d5f228f-1e8c-456a-b9c7-29b901678212 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f95939bda4bf420796ed9eb312227620'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:00.034771 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3d5f228f-1e8c-456a-b9c7-29b901678212 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f95939bda4bf420796ed9eb312227620'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:00.035648 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-3d5f228f-1e8c-456a-b9c7-29b901678212 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f95939bda4bf420796ed9eb312227620'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:00.042504 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1095/2222] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:59 2022] DELETE /identity/v3/users/f95939bda4bf420796ed9eb312227620 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:58:00.045218 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330261a-2e70-4844-90bf-d96f3686b2a7 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:00.045540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330261a-2e70-4844-90bf-d96f3686b2a7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:00.046275 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330261a-2e70-4844-90bf-d96f3686b2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:00.050738 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d1665-05c7-4832-8091-7777bc02b3cd None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:00.066318 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-0330261a-2e70-4844-90bf-d96f3686b2a7 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:00.067693 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0330261a-2e70-4844-90bf-d96f3686b2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:00.133473 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b68fd3-ad4f-4158-a5fd-843ff28838b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:00.134674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b68fd3-ad4f-4158-a5fd-843ff28838b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:00.135206 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b68fd3-ad4f-4158-a5fd-843ff28838b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:00.135501 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b68fd3-ad4f-4158-a5fd-843ff28838b6 admin admin] PATH_INFO: `/v3/users/ed2c5220a4cc422a84a62b6f6c6e6f37` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:00.137434 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b68fd3-ad4f-4158-a5fd-843ff28838b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed2c5220a4cc422a84a62b6f6c6e6f37)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:00.140927 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b68fd3-ad4f-4158-a5fd-843ff28838b6 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:00.150900 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1096/2223] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:00.152106 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac368f0-5377-485b-9910-56fcfe2f741f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:00.152393 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac368f0-5377-485b-9910-56fcfe2f741f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:00.152665 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac368f0-5377-485b-9910-56fcfe2f741f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:00.179376 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-dac368f0-5377-485b-9910-56fcfe2f741f None None] MFA Rules not processed for user `819ad532defb4adaa2f4fd06b47630d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:00.181146 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-dac368f0-5377-485b-9910-56fcfe2f741f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:00.203111 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c6b68fd3-ad4f-4158-a5fd-843ff28838b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed2c5220a4cc422a84a62b6f6c6e6f37'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:00.216930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c6b68fd3-ad4f-4158-a5fd-843ff28838b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed2c5220a4cc422a84a62b6f6c6e6f37'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:00.218135 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c6b68fd3-ad4f-4158-a5fd-843ff28838b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed2c5220a4cc422a84a62b6f6c6e6f37'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:00.228380 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c6b68fd3-ad4f-4158-a5fd-843ff28838b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed2c5220a4cc422a84a62b6f6c6e6f37'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:00.243257 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c6b68fd3-ad4f-4158-a5fd-843ff28838b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed2c5220a4cc422a84a62b6f6c6e6f37'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:00.253261 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1128/2224] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:57:59 2022] DELETE /identity/v3/users/ed2c5220a4cc422a84a62b6f6c6e6f37 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:00.254592 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf290f19-0be7-4660-8d76-230fef01d377 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:00.255021 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf290f19-0be7-4660-8d76-230fef01d377 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:00.255302 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf290f19-0be7-4660-8d76-230fef01d377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:00.271582 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1097/2225] 10.222.0.85 () {58 vars in 1018 bytes} [Thu Jun 16 14:58:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:00.273885 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac368f0-5377-485b-9910-56fcfe2f741f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:00.274166 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-cf290f19-0be7-4660-8d76-230fef01d377 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:00.276357 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-dac368f0-5377-485b-9910-56fcfe2f741f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:00.276533 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-cf290f19-0be7-4660-8d76-230fef01d377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:00.294425 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:00.309756 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:00.371807 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac368f0-5377-485b-9910-56fcfe2f741f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:00.380194 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1129/2226] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:00.380987 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf290f19-0be7-4660-8d76-230fef01d377 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:00.386185 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-cf290f19-0be7-4660-8d76-230fef01d377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:00.472317 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10031e0-4363-4313-b220-05914f51cc5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:00.473063 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10031e0-4363-4313-b220-05914f51cc5f service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:00.473448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10031e0-4363-4313-b220-05914f51cc5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:00.473878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10031e0-4363-4313-b220-05914f51cc5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:00.475954 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b10031e0-4363-4313-b220-05914f51cc5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:00.497664 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10031e0-4363-4313-b220-05914f51cc5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:00.498985 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10031e0-4363-4313-b220-05914f51cc5f service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:00.514553 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1098/2227] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:58:00.515744 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10031e0-4363-4313-b220-05914f51cc5f service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:00.527590 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10031e0-4363-4313-b220-05914f51cc5f service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:00.533196 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d75fb-037b-4e2c-a8ef-a1cada56466f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:00.534778 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d75fb-037b-4e2c-a8ef-a1cada56466f service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:00.535064 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d75fb-037b-4e2c-a8ef-a1cada56466f service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:00.535256 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf290f19-0be7-4660-8d76-230fef01d377 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:00.535390 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d75fb-037b-4e2c-a8ef-a1cada56466f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:00.542257 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f63e4-3001-4948-b0db-335615e65fa1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819ad532defb4adaa2f4fd06b47630d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:00.543196 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f63e4-3001-4948-b0db-335615e65fa1 service placement] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:00.543632 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f63e4-3001-4948-b0db-335615e65fa1 service placement] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:00.545018 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f63e4-3001-4948-b0db-335615e65fa1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:00.582365 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f63e4-3001-4948-b0db-335615e65fa1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:00.585228 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f63e4-3001-4948-b0db-335615e65fa1 service placement] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:00.588142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d75fb-037b-4e2c-a8ef-a1cada56466f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:00.590935 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d75fb-037b-4e2c-a8ef-a1cada56466f service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:00.603658 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1099/2228] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:58:00.605233 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d75fb-037b-4e2c-a8ef-a1cada56466f service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:00.607467 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a71d75fb-037b-4e2c-a8ef-a1cada56466f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:00.625918 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d75fb-037b-4e2c-a8ef-a1cada56466f service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:00.632508 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076201d4-d935-4960-a812-d82d0ddae709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:00.633563 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076201d4-d935-4960-a812-d82d0ddae709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:00.634024 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076201d4-d935-4960-a812-d82d0ddae709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:00.634299 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076201d4-d935-4960-a812-d82d0ddae709 admin admin] PATH_INFO: `/v3/projects/16715fa6ddcf41d680bbebb253ffddf2` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:00.636590 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1130/2229] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:58:00.645041 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076201d4-d935-4960-a812-d82d0ddae709 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16715fa6ddcf41d680bbebb253ffddf2)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:00.647096 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076201d4-d935-4960-a812-d82d0ddae709 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:00.731447 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-076201d4-d935-4960-a812-d82d0ddae709 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16715fa6ddcf41d680bbebb253ffddf2', 'request_id': 'req-076201d4-d935-4960-a812-d82d0ddae709'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:00.739190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-076201d4-d935-4960-a812-d82d0ddae709 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16715fa6ddcf41d680bbebb253ffddf2', 'request_id': 'req-076201d4-d935-4960-a812-d82d0ddae709'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:00.746899 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-076201d4-d935-4960-a812-d82d0ddae709 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16715fa6ddcf41d680bbebb253ffddf2', 'request_id': 'req-076201d4-d935-4960-a812-d82d0ddae709'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:00.767754 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-076201d4-d935-4960-a812-d82d0ddae709 admin admin] The token cache is being invalidate because project 16715fa6ddcf41d680bbebb253ffddf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:58:00.768482 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-076201d4-d935-4960-a812-d82d0ddae709 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:00.772944 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-076201d4-d935-4960-a812-d82d0ddae709 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:00.776177 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1100/2230] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:58:00 2022] DELETE /identity/v3/projects/16715fa6ddcf41d680bbebb253ffddf2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:00.780452 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f63e4-3001-4948-b0db-335615e65fa1 service placement] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:00.804447 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f63e4-3001-4948-b0db-335615e65fa1 service placement] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:00.910074 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe4ca0-aa4a-4d57-a811-259f18a6708d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:00.911909 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe4ca0-aa4a-4d57-a811-259f18a6708d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:00.912287 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe4ca0-aa4a-4d57-a811-259f18a6708d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:00.912684 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe4ca0-aa4a-4d57-a811-259f18a6708d admin admin] PATH_INFO: `/v3/users/13a911ac26044020b5cf0ec7a5b02693` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:00.914070 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe4ca0-aa4a-4d57-a811-259f18a6708d admin admin] RBAC: Authorizing `identity:delete_user(user_id=13a911ac26044020b5cf0ec7a5b02693)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:00.916208 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe4ca0-aa4a-4d57-a811-259f18a6708d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:00.996944 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-76fe4ca0-aa4a-4d57-a811-259f18a6708d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13a911ac26044020b5cf0ec7a5b02693'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:01.016222 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:01.030705 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-76fe4ca0-aa4a-4d57-a811-259f18a6708d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13a911ac26044020b5cf0ec7a5b02693'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:01.032734 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-76fe4ca0-aa4a-4d57-a811-259f18a6708d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13a911ac26044020b5cf0ec7a5b02693'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:01.049617 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-76fe4ca0-aa4a-4d57-a811-259f18a6708d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13a911ac26044020b5cf0ec7a5b02693'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:01.062337 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-76fe4ca0-aa4a-4d57-a811-259f18a6708d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13a911ac26044020b5cf0ec7a5b02693'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:01.069332 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1131/2231] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:58:00 2022] DELETE /identity/v3/users/13a911ac26044020b5cf0ec7a5b02693 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:01.258220 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076201d4-d935-4960-a812-d82d0ddae709 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:01.259773 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-076201d4-d935-4960-a812-d82d0ddae709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:01.282315 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076201d4-d935-4960-a812-d82d0ddae709 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:01.345506 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:01.349676 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe4ca0-aa4a-4d57-a811-259f18a6708d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:01.351322 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-76fe4ca0-aa4a-4d57-a811-259f18a6708d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:01.417640 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec0d6c-3cef-40ce-9016-dfbc3551cbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:01.418618 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec0d6c-3cef-40ce-9016-dfbc3551cbc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:01.418814 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec0d6c-3cef-40ce-9016-dfbc3551cbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:01.419093 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec0d6c-3cef-40ce-9016-dfbc3551cbc3 admin admin] PATH_INFO: `/v3/projects/5116abd27ade49aba0820e73c50ede05` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:01.420666 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec0d6c-3cef-40ce-9016-dfbc3551cbc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5116abd27ade49aba0820e73c50ede05)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:01.423386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec0d6c-3cef-40ce-9016-dfbc3551cbc3 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:01.452099 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe4ca0-aa4a-4d57-a811-259f18a6708d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:01.459352 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d5f45-6950-4038-9e93-86483261b034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:01.460944 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d5f45-6950-4038-9e93-86483261b034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:01.461430 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d5f45-6950-4038-9e93-86483261b034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:01.461810 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d5f45-6950-4038-9e93-86483261b034 admin admin] PATH_INFO: `/v3/projects/8032cca97f264817b6868c08def9651c` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:01.463447 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d5f45-6950-4038-9e93-86483261b034 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8032cca97f264817b6868c08def9651c)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:01.465806 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d5f45-6950-4038-9e93-86483261b034 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:01.500330 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-90ec0d6c-3cef-40ce-9016-dfbc3551cbc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5116abd27ade49aba0820e73c50ede05', 'request_id': 'req-90ec0d6c-3cef-40ce-9016-dfbc3551cbc3'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:01.509555 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-90ec0d6c-3cef-40ce-9016-dfbc3551cbc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5116abd27ade49aba0820e73c50ede05', 'request_id': 'req-90ec0d6c-3cef-40ce-9016-dfbc3551cbc3'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:01.525347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-90ec0d6c-3cef-40ce-9016-dfbc3551cbc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5116abd27ade49aba0820e73c50ede05', 'request_id': 'req-90ec0d6c-3cef-40ce-9016-dfbc3551cbc3'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:01.546552 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-90ec0d6c-3cef-40ce-9016-dfbc3551cbc3 admin admin] The token cache is being invalidate because project 5116abd27ade49aba0820e73c50ede05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:58:01.547034 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-90ec0d6c-3cef-40ce-9016-dfbc3551cbc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:01.547824 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-90ec0d6c-3cef-40ce-9016-dfbc3551cbc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:01.549637 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1101/2232] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:58:01 2022] DELETE /identity/v3/projects/5116abd27ade49aba0820e73c50ede05 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:01.550136 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c93d5f45-6950-4038-9e93-86483261b034 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8032cca97f264817b6868c08def9651c', 'request_id': 'req-c93d5f45-6950-4038-9e93-86483261b034'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:01.553441 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec0d6c-3cef-40ce-9016-dfbc3551cbc3 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:01.555170 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-90ec0d6c-3cef-40ce-9016-dfbc3551cbc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:01.558053 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c93d5f45-6950-4038-9e93-86483261b034 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8032cca97f264817b6868c08def9651c', 'request_id': 'req-c93d5f45-6950-4038-9e93-86483261b034'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:01.572295 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c93d5f45-6950-4038-9e93-86483261b034 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8032cca97f264817b6868c08def9651c', 'request_id': 'req-c93d5f45-6950-4038-9e93-86483261b034'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:01.585951 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c93d5f45-6950-4038-9e93-86483261b034 admin admin] The token cache is being invalidate because project 8032cca97f264817b6868c08def9651c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:58:01.586279 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c93d5f45-6950-4038-9e93-86483261b034 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:01.586980 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c93d5f45-6950-4038-9e93-86483261b034 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:01.588700 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1132/2233] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:58:01 2022] DELETE /identity/v3/projects/8032cca97f264817b6868c08def9651c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:01.592249 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d5f45-6950-4038-9e93-86483261b034 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:01.592249 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c93d5f45-6950-4038-9e93-86483261b034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:01.640226 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec0d6c-3cef-40ce-9016-dfbc3551cbc3 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:01.667027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d5f45-6950-4038-9e93-86483261b034 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:01.671763 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6df37-5572-467b-bad3-4eddd4075f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:01.672657 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6df37-5572-467b-bad3-4eddd4075f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:01.672940 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6df37-5572-467b-bad3-4eddd4075f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:01.673243 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6df37-5572-467b-bad3-4eddd4075f0e admin admin] PATH_INFO: `/v3/users/b1253d11eab44bb6abba5aa1af08583f` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:01.674622 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6df37-5572-467b-bad3-4eddd4075f0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1253d11eab44bb6abba5aa1af08583f)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:01.676770 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6df37-5572-467b-bad3-4eddd4075f0e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:01.682857 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:01.709656 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9dee4-c1d7-4ea0-b95b-6d40be4bb88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:01.710627 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9dee4-c1d7-4ea0-b95b-6d40be4bb88b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:01.711053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9dee4-c1d7-4ea0-b95b-6d40be4bb88b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:01.711340 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9dee4-c1d7-4ea0-b95b-6d40be4bb88b admin admin] PATH_INFO: `/v3/projects/c91bce25a8114d4183b0b87ec69726a6` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:01.713191 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9dee4-c1d7-4ea0-b95b-6d40be4bb88b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c91bce25a8114d4183b0b87ec69726a6)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:01.715553 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9dee4-c1d7-4ea0-b95b-6d40be4bb88b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:01.737753 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:01.742145 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e9b6df37-5572-467b-bad3-4eddd4075f0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1253d11eab44bb6abba5aa1af08583f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:01.757333 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e9b6df37-5572-467b-bad3-4eddd4075f0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1253d11eab44bb6abba5aa1af08583f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:01.758034 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e9b6df37-5572-467b-bad3-4eddd4075f0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1253d11eab44bb6abba5aa1af08583f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:01.766655 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e9b6df37-5572-467b-bad3-4eddd4075f0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1253d11eab44bb6abba5aa1af08583f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:01.773688 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-32a9dee4-c1d7-4ea0-b95b-6d40be4bb88b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c91bce25a8114d4183b0b87ec69726a6', 'request_id': 'req-32a9dee4-c1d7-4ea0-b95b-6d40be4bb88b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:01.775095 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e9b6df37-5572-467b-bad3-4eddd4075f0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1253d11eab44bb6abba5aa1af08583f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:01.781998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1133/2234] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:58:01 2022] DELETE /identity/v3/users/b1253d11eab44bb6abba5aa1af08583f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:01.782658 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-32a9dee4-c1d7-4ea0-b95b-6d40be4bb88b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c91bce25a8114d4183b0b87ec69726a6', 'request_id': 'req-32a9dee4-c1d7-4ea0-b95b-6d40be4bb88b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:01.784078 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628978e-5ba3-42b0-bdb8-a2a5ce4064d9 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:01.784474 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628978e-5ba3-42b0-bdb8-a2a5ce4064d9 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:01.785124 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628978e-5ba3-42b0-bdb8-a2a5ce4064d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:01.789883 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-32a9dee4-c1d7-4ea0-b95b-6d40be4bb88b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c91bce25a8114d4183b0b87ec69726a6', 'request_id': 'req-32a9dee4-c1d7-4ea0-b95b-6d40be4bb88b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:01.804762 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-32a9dee4-c1d7-4ea0-b95b-6d40be4bb88b admin admin] The token cache is being invalidate because project c91bce25a8114d4183b0b87ec69726a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:58:01.805081 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-32a9dee4-c1d7-4ea0-b95b-6d40be4bb88b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:01.806078 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-32a9dee4-c1d7-4ea0-b95b-6d40be4bb88b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:01.807822 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1102/2235] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:58:01 2022] DELETE /identity/v3/projects/c91bce25a8114d4183b0b87ec69726a6 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:01.813014 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-0628978e-5ba3-42b0-bdb8-a2a5ce4064d9 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:01.813216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459251f9-c512-468b-976b-5a6a49829a15 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:01.813592 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459251f9-c512-468b-976b-5a6a49829a15 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:01.813879 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459251f9-c512-468b-976b-5a6a49829a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:01.814846 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-0628978e-5ba3-42b0-bdb8-a2a5ce4064d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:01.833610 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-459251f9-c512-468b-976b-5a6a49829a15 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:01.834708 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-459251f9-c512-468b-976b-5a6a49829a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:01.903439 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1134/2236] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:01.911643 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd22b27-77b4-4afa-8c3b-eec16587eb60 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:01.912030 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd22b27-77b4-4afa-8c3b-eec16587eb60 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:01.912457 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd22b27-77b4-4afa-8c3b-eec16587eb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:01.919090 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1103/2237] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:58:01.927499 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd63e50-1e85-4f53-a82b-79b28dc7ddda None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:01.930533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd63e50-1e85-4f53-a82b-79b28dc7ddda None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:01.930835 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd63e50-1e85-4f53-a82b-79b28dc7ddda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:01.932074 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-4fd22b27-77b4-4afa-8c3b-eec16587eb60 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:01.933320 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4fd22b27-77b4-4afa-8c3b-eec16587eb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:01.942568 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1135/2238] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:58:01.946609 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd22b27-77b4-4afa-8c3b-eec16587eb60 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:01.950747 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-0dd63e50-1e85-4f53-a82b-79b28dc7ddda None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:01.952569 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0dd63e50-1e85-4f53-a82b-79b28dc7ddda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:01.956815 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd22b27-77b4-4afa-8c3b-eec16587eb60 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:01.970244 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1104/2239] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:01.974492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd63e50-1e85-4f53-a82b-79b28dc7ddda None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:01.980516 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f804c0b-ccad-480c-abe8-0b5a3ba0cb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:01.981518 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f804c0b-ccad-480c-abe8-0b5a3ba0cb29 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:01.982003 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f804c0b-ccad-480c-abe8-0b5a3ba0cb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:01.982361 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f804c0b-ccad-480c-abe8-0b5a3ba0cb29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:01.983310 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f804c0b-ccad-480c-abe8-0b5a3ba0cb29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:58:01.983811 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f804c0b-ccad-480c-abe8-0b5a3ba0cb29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:01.984898 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd63e50-1e85-4f53-a82b-79b28dc7ddda None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:01.985683 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f804c0b-ccad-480c-abe8-0b5a3ba0cb29 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:01.989867 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53adc37c-b8dc-4fe9-8c7d-bb1f094d536c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:01.990674 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adc37c-b8dc-4fe9-8c7d-bb1f094d536c admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:01.990962 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adc37c-b8dc-4fe9-8c7d-bb1f094d536c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:01.991332 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adc37c-b8dc-4fe9-8c7d-bb1f094d536c admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:01.992064 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53adc37c-b8dc-4fe9-8c7d-bb1f094d536c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:58:01.992303 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53adc37c-b8dc-4fe9-8c7d-bb1f094d536c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:01.993914 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53adc37c-b8dc-4fe9-8c7d-bb1f094d536c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:02.000422 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1136/2240] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:58:02.006715 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f804c0b-ccad-480c-abe8-0b5a3ba0cb29 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:02.008733 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1105/2241] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:58:02.016924 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53adc37c-b8dc-4fe9-8c7d-bb1f094d536c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:02.024789 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f804c0b-ccad-480c-abe8-0b5a3ba0cb29 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:02.037441 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53adc37c-b8dc-4fe9-8c7d-bb1f094d536c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:02.038952 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af87af08-a984-4beb-8668-1b7922732d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:02.039639 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87af08-a984-4beb-8668-1b7922732d2a admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:02.040024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87af08-a984-4beb-8668-1b7922732d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:02.040235 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87af08-a984-4beb-8668-1b7922732d2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:02.040936 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af87af08-a984-4beb-8668-1b7922732d2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:02.043059 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af87af08-a984-4beb-8668-1b7922732d2a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:02.050291 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c13a8-cde8-469d-8a63-b382bcd0cfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:02.051296 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c13a8-cde8-469d-8a63-b382bcd0cfcb admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:02.051648 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c13a8-cde8-469d-8a63-b382bcd0cfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:02.052025 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c13a8-cde8-469d-8a63-b382bcd0cfcb admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:02.052897 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c13a8-cde8-469d-8a63-b382bcd0cfcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:02.054939 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c13a8-cde8-469d-8a63-b382bcd0cfcb admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:02.084819 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1137/2242] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:58:02 2022] POST /identity/v3/projects => generated 363 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:58:02.088366 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af87af08-a984-4beb-8668-1b7922732d2a admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:02.090654 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1106/2243] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:58:02 2022] POST /identity/v3/projects => generated 363 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:58:02.095605 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c13a8-cde8-469d-8a63-b382bcd0cfcb admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:02.151935 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:02.175063 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af87af08-a984-4beb-8668-1b7922732d2a admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:02.180716 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4669c-6371-4f86-ab43-213ff7a9382a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:02.181611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4669c-6371-4f86-ab43-213ff7a9382a admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:02.182103 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4669c-6371-4f86-ab43-213ff7a9382a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:02.182377 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4669c-6371-4f86-ab43-213ff7a9382a admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:02.183076 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4669c-6371-4f86-ab43-213ff7a9382a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:02.185090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4669c-6371-4f86-ab43-213ff7a9382a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:02.185230 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c13a8-cde8-469d-8a63-b382bcd0cfcb admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:02.192736 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe098f-48e4-459d-ae08-164e8edcde84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:02.193592 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe098f-48e4-459d-ae08-164e8edcde84 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:02.194603 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe098f-48e4-459d-ae08-164e8edcde84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:02.194985 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe098f-48e4-459d-ae08-164e8edcde84 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:02.195998 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe098f-48e4-459d-ae08-164e8edcde84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:02.198404 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe098f-48e4-459d-ae08-164e8edcde84 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:02.220054 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:02.221538 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1138/2244] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:58:02 2022] POST /identity/v3/users => generated 282 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:58:02.222614 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4669c-6371-4f86-ab43-213ff7a9382a admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:02.239590 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4669c-6371-4f86-ab43-213ff7a9382a admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:02.242950 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1107/2245] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:58:02 2022] POST /identity/v3/users => generated 282 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:58:02.242950 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe098f-48e4-459d-ae08-164e8edcde84 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:02.243372 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-eabe098f-48e4-459d-ae08-164e8edcde84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:02.251787 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c02f70-3c19-49d3-81b6-9c424bbf450b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:02.252509 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c02f70-3c19-49d3-81b6-9c424bbf450b admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:02.252788 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c02f70-3c19-49d3-81b6-9c424bbf450b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:02.253856 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c02f70-3c19-49d3-81b6-9c424bbf450b admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:02.254603 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c02f70-3c19-49d3-81b6-9c424bbf450b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:02.256474 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c02f70-3c19-49d3-81b6-9c424bbf450b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:02.257450 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe098f-48e4-459d-ae08-164e8edcde84 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:02.263059 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7e2b4-2358-4a69-b4a0-985b11956f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:02.263570 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7e2b4-2358-4a69-b4a0-985b11956f4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:02.263853 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7e2b4-2358-4a69-b4a0-985b11956f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:02.264246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7e2b4-2358-4a69-b4a0-985b11956f4e admin admin] PATH_INFO: `/v3/projects/3946cee39845455ea6a2d5780c849c26` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:02.265788 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7e2b4-2358-4a69-b4a0-985b11956f4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3946cee39845455ea6a2d5780c849c26)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:02.267708 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7e2b4-2358-4a69-b4a0-985b11956f4e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:02.269075 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1139/2246] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:58:02.269950 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c02f70-3c19-49d3-81b6-9c424bbf450b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:02.285733 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c02f70-3c19-49d3-81b6-9c424bbf450b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:02.292017 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58ed93-5e6f-442d-ba9f-04aa00dd9ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:02.292737 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58ed93-5e6f-442d-ba9f-04aa00dd9ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:02.293029 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58ed93-5e6f-442d-ba9f-04aa00dd9ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:02.293333 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58ed93-5e6f-442d-ba9f-04aa00dd9ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:02.294096 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58ed93-5e6f-442d-ba9f-04aa00dd9ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:02.295984 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58ed93-5e6f-442d-ba9f-04aa00dd9ee6 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:02.313228 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1140/2247] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:58:02.313228 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58ed93-5e6f-442d-ba9f-04aa00dd9ee6 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:02.321688 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58ed93-5e6f-442d-ba9f-04aa00dd9ee6 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:02.337714 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-55e7e2b4-2358-4a69-b4a0-985b11956f4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3946cee39845455ea6a2d5780c849c26', 'request_id': 'req-55e7e2b4-2358-4a69-b4a0-985b11956f4e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:02.345552 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-55e7e2b4-2358-4a69-b4a0-985b11956f4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3946cee39845455ea6a2d5780c849c26', 'request_id': 'req-55e7e2b4-2358-4a69-b4a0-985b11956f4e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:02.360853 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-55e7e2b4-2358-4a69-b4a0-985b11956f4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3946cee39845455ea6a2d5780c849c26', 'request_id': 'req-55e7e2b4-2358-4a69-b4a0-985b11956f4e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:02.383979 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-55e7e2b4-2358-4a69-b4a0-985b11956f4e admin admin] The token cache is being invalidate because project 3946cee39845455ea6a2d5780c849c26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:58:02.384508 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-55e7e2b4-2358-4a69-b4a0-985b11956f4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:02.385366 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-55e7e2b4-2358-4a69-b4a0-985b11956f4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:02.387810 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1108/2248] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:58:02 2022] DELETE /identity/v3/projects/3946cee39845455ea6a2d5780c849c26 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:02.388794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7e2b4-2358-4a69-b4a0-985b11956f4e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:02.390235 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-55e7e2b4-2358-4a69-b4a0-985b11956f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:02.406045 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21768739-7377-42c4-a877-c9d4a36cd6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:02.407188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21768739-7377-42c4-a877-c9d4a36cd6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:02.407492 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21768739-7377-42c4-a877-c9d4a36cd6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:02.407767 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21768739-7377-42c4-a877-c9d4a36cd6a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:02.408528 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21768739-7377-42c4-a877-c9d4a36cd6a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:02.410329 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21768739-7377-42c4-a877-c9d4a36cd6a2 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:02.424994 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1141/2249] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:58:02.426402 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1512f-9c32-4b0d-962b-6336ec855792 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:02.426635 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1512f-9c32-4b0d-962b-6336ec855792 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:02.426917 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1512f-9c32-4b0d-962b-6336ec855792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:02.449080 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-76c1512f-9c32-4b0d-962b-6336ec855792 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:02.450583 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-76c1512f-9c32-4b0d-962b-6336ec855792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:02.460240 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1142/2250] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:02.461149 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1512f-9c32-4b0d-962b-6336ec855792 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:02.462600 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-76c1512f-9c32-4b0d-962b-6336ec855792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:02.473717 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7e2b4-2358-4a69-b4a0-985b11956f4e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:02.476665 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1512f-9c32-4b0d-962b-6336ec855792 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:02.479172 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72887c09-31fe-47f1-b531-48c9cea4279f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:02.479998 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72887c09-31fe-47f1-b531-48c9cea4279f admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:02.480286 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72887c09-31fe-47f1-b531-48c9cea4279f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:02.480572 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72887c09-31fe-47f1-b531-48c9cea4279f admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:02.481367 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72887c09-31fe-47f1-b531-48c9cea4279f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:02.482255 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b8533-b65e-490c-b4d7-413ae880c28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:02.483142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72887c09-31fe-47f1-b531-48c9cea4279f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:02.483256 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b8533-b65e-490c-b4d7-413ae880c28f admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:02.483503 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b8533-b65e-490c-b4d7-413ae880c28f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:02.483779 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b8533-b65e-490c-b4d7-413ae880c28f admin admin] PATH_INFO: `/v3/projects/2cff91abe323475eadc0bc8a04452d46/users/4f250b645c004e17a895a1a48dd9cede/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:02.494620 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1109/2251] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:58:02.496367 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be52343-5142-47a0-9770-783e93082fd7 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:02.496847 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be52343-5142-47a0-9770-783e93082fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:02.497341 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be52343-5142-47a0-9770-783e93082fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:02.507661 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b8533-b65e-490c-b4d7-413ae880c28f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cff91abe323475eadc0bc8a04452d46, user_id=4f250b645c004e17a895a1a48dd9cede, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:02.510517 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b8533-b65e-490c-b4d7-413ae880c28f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:02.518461 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3be52343-5142-47a0-9770-783e93082fd7 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:02.519693 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3be52343-5142-47a0-9770-783e93082fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:02.527430 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1143/2252] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:58:02 2022] PUT /identity/v3/projects/2cff91abe323475eadc0bc8a04452d46/users/4f250b645c004e17a895a1a48dd9cede/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:02.528370 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b8533-b65e-490c-b4d7-413ae880c28f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:02.596995 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b8533-b65e-490c-b4d7-413ae880c28f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:02.597539 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1110/2253] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:02.599002 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95015e-6525-491b-8d82-fb5a190e03bb None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:02.599297 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95015e-6525-491b-8d82-fb5a190e03bb None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:02.599599 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95015e-6525-491b-8d82-fb5a190e03bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:02.602699 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbb644-f6f7-44a9-822c-8ba01c9b454e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:02.603899 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbb644-f6f7-44a9-822c-8ba01c9b454e admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:02.604219 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbb644-f6f7-44a9-822c-8ba01c9b454e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:02.604513 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbb644-f6f7-44a9-822c-8ba01c9b454e admin admin] PATH_INFO: `/v3/projects/65c2250f2c4d4eaba7d7768e1432ad15/users/81f7ba28d1cc4666b5836e13cdb69dce/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:02.623181 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fbb644-f6f7-44a9-822c-8ba01c9b454e admin admin] RBAC: Authorizing `identity:create_grant(project_id=65c2250f2c4d4eaba7d7768e1432ad15, user_id=81f7ba28d1cc4666b5836e13cdb69dce, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:02.626448 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fbb644-f6f7-44a9-822c-8ba01c9b454e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:02.627124 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:02.631995 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3a95015e-6525-491b-8d82-fb5a190e03bb None None] MFA Rules not processed for user `4f250b645c004e17a895a1a48dd9cede`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:02.635158 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3a95015e-6525-491b-8d82-fb5a190e03bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:02.636698 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:02.643644 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1144/2254] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:58:02 2022] PUT /identity/v3/projects/65c2250f2c4d4eaba7d7768e1432ad15/users/81f7ba28d1cc4666b5836e13cdb69dce/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:02.644606 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbb644-f6f7-44a9-822c-8ba01c9b454e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:02.709583 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbb644-f6f7-44a9-822c-8ba01c9b454e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:02.714684 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3dcdf-0f42-470e-b317-c588d17e6d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:02.715354 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3dcdf-0f42-470e-b317-c588d17e6d5b admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:02.715500 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1111/2255] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:02 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:02.715685 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3dcdf-0f42-470e-b317-c588d17e6d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:02.715979 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3dcdf-0f42-470e-b317-c588d17e6d5b admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:02.716893 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3dcdf-0f42-470e-b317-c588d17e6d5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:58:02.717001 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc4aba-4429-4bc6-9ae1-b1d52c984eda None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:02.717214 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3dcdf-0f42-470e-b317-c588d17e6d5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:02.717378 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc4aba-4429-4bc6-9ae1-b1d52c984eda None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:02.717605 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc4aba-4429-4bc6-9ae1-b1d52c984eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:02.718870 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3dcdf-0f42-470e-b317-c588d17e6d5b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:02.735627 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1145/2256] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:58:02.740821 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3dcdf-0f42-470e-b317-c588d17e6d5b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:02.744864 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c9b3dcdf-0f42-470e-b317-c588d17e6d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:02.755386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-62fc4aba-4429-4bc6-9ae1-b1d52c984eda None None] MFA Rules not processed for user `81f7ba28d1cc4666b5836e13cdb69dce`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:02.758201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-62fc4aba-4429-4bc6-9ae1-b1d52c984eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:02.810706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3dcdf-0f42-470e-b317-c588d17e6d5b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:02.814622 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bfece-aa60-4f8d-a09c-0b3d6280af94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:02.815277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bfece-aa60-4f8d-a09c-0b3d6280af94 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:02.815556 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bfece-aa60-4f8d-a09c-0b3d6280af94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:02.815828 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bfece-aa60-4f8d-a09c-0b3d6280af94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:02.825123 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97bfece-aa60-4f8d-a09c-0b3d6280af94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:02.826855 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97bfece-aa60-4f8d-a09c-0b3d6280af94 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:02.837805 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1112/2257] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:02 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:02.838776 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc4aba-4429-4bc6-9ae1-b1d52c984eda None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:02.839276 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1146/2258] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:02 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:58:02.842494 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bfece-aa60-4f8d-a09c-0b3d6280af94 service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:02.852154 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc4aba-4429-4bc6-9ae1-b1d52c984eda None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:02.857380 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69efb0cf-8e77-4b5b-bf97-a4dadad66f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:02.858122 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bfece-aa60-4f8d-a09c-0b3d6280af94 service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:02.858336 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efb0cf-8e77-4b5b-bf97-a4dadad66f84 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:02.858472 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efb0cf-8e77-4b5b-bf97-a4dadad66f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:02.858878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efb0cf-8e77-4b5b-bf97-a4dadad66f84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:02.859678 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69efb0cf-8e77-4b5b-bf97-a4dadad66f84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:02.861856 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69efb0cf-8e77-4b5b-bf97-a4dadad66f84 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:02.862899 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf3a36-2897-418e-9488-52e7834689e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:02.863554 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf3a36-2897-418e-9488-52e7834689e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:02.863838 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf3a36-2897-418e-9488-52e7834689e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:02.864142 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf3a36-2897-418e-9488-52e7834689e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:02.864832 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf3a36-2897-418e-9488-52e7834689e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:02.866936 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf3a36-2897-418e-9488-52e7834689e9 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:02.894158 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1113/2259] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:58:02 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:58:02.896946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1147/2260] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:58:02 2022] POST /identity/v3/projects => generated 363 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:58:02.901110 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf3a36-2897-418e-9488-52e7834689e9 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:02.901270 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69efb0cf-8e77-4b5b-bf97-a4dadad66f84 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:02.982572 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69efb0cf-8e77-4b5b-bf97-a4dadad66f84 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:02.993936 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:03.010090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf3a36-2897-418e-9488-52e7834689e9 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:03.015291 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fada7-3c8c-4804-a86f-2c953880cc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:03.016022 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fada7-3c8c-4804-a86f-2c953880cc2e admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:03.016306 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fada7-3c8c-4804-a86f-2c953880cc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:03.016583 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fada7-3c8c-4804-a86f-2c953880cc2e admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:03.017276 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761fada7-3c8c-4804-a86f-2c953880cc2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:03.019259 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761fada7-3c8c-4804-a86f-2c953880cc2e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:03.051421 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1148/2261] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:58:02 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:58:03.055757 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fada7-3c8c-4804-a86f-2c953880cc2e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:03.055934 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d9b94-cd13-4495-b088-462d93fbaa75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:03.056587 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d9b94-cd13-4495-b088-462d93fbaa75 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:03.056959 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d9b94-cd13-4495-b088-462d93fbaa75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:03.057236 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d9b94-cd13-4495-b088-462d93fbaa75 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:03.057953 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d9b94-cd13-4495-b088-462d93fbaa75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:03.059903 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d9b94-cd13-4495-b088-462d93fbaa75 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:03.064436 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:03.068517 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fada7-3c8c-4804-a86f-2c953880cc2e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:03.075993 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361257a3-b95e-432b-bbfa-dce3e309b8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:03.076199 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361257a3-b95e-432b-bbfa-dce3e309b8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:03.076572 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361257a3-b95e-432b-bbfa-dce3e309b8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:03.076861 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361257a3-b95e-432b-bbfa-dce3e309b8c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:03.077685 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361257a3-b95e-432b-bbfa-dce3e309b8c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:03.080277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361257a3-b95e-432b-bbfa-dce3e309b8c7 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:03.087837 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1114/2262] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:58:02 2022] POST /identity/v3/users => generated 288 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:58:03.093372 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d9b94-cd13-4495-b088-462d93fbaa75 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:03.096574 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1149/2263] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:58:03.101179 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361257a3-b95e-432b-bbfa-dce3e309b8c7 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:03.112614 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d9b94-cd13-4495-b088-462d93fbaa75 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:03.114714 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361257a3-b95e-432b-bbfa-dce3e309b8c7 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:03.119732 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477849bf-c159-4eac-9c1f-1cb0b4178f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:03.119989 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd1c3d-ec7a-4ab4-959d-c362b5d5d120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:03.120934 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd1c3d-ec7a-4ab4-959d-c362b5d5d120 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:03.121060 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd1c3d-ec7a-4ab4-959d-c362b5d5d120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:03.121393 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd1c3d-ec7a-4ab4-959d-c362b5d5d120 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:03.121637 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477849bf-c159-4eac-9c1f-1cb0b4178f9e admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:03.122102 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477849bf-c159-4eac-9c1f-1cb0b4178f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:03.122448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477849bf-c159-4eac-9c1f-1cb0b4178f9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:03.122562 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd1c3d-ec7a-4ab4-959d-c362b5d5d120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:03.123662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477849bf-c159-4eac-9c1f-1cb0b4178f9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:03.125103 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd1c3d-ec7a-4ab4-959d-c362b5d5d120 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:03.127145 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477849bf-c159-4eac-9c1f-1cb0b4178f9e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:03.138573 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1150/2264] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:58:03.141706 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1115/2265] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:58:03.145427 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd1c3d-ec7a-4ab4-959d-c362b5d5d120 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:03.146323 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477849bf-c159-4eac-9c1f-1cb0b4178f9e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:03.157746 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd1c3d-ec7a-4ab4-959d-c362b5d5d120 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:03.160102 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477849bf-c159-4eac-9c1f-1cb0b4178f9e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:03.167103 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89063b9f-de02-4aab-a79c-8294650334ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:03.167287 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3c1e0-689f-4747-8dfe-1da000f72552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:03.168397 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3c1e0-689f-4747-8dfe-1da000f72552 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:03.168712 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89063b9f-de02-4aab-a79c-8294650334ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:03.169123 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3c1e0-689f-4747-8dfe-1da000f72552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:03.169449 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89063b9f-de02-4aab-a79c-8294650334ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:03.169570 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3c1e0-689f-4747-8dfe-1da000f72552 admin admin] PATH_INFO: `/v3/projects/d3346c34190b47d3a89e2a4ccb31d119/users/5b2baeaad7d6495f95d3204c3913057c/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:03.169996 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89063b9f-de02-4aab-a79c-8294650334ef admin admin] PATH_INFO: `/v3/projects/dd33c8f9f7b04e81b04e159b9e8c49cb/users/f7946c3162f3422c89af3a12c59ceaec/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:03.190852 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3c1e0-689f-4747-8dfe-1da000f72552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3346c34190b47d3a89e2a4ccb31d119, user_id=5b2baeaad7d6495f95d3204c3913057c, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:03.193040 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89063b9f-de02-4aab-a79c-8294650334ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd33c8f9f7b04e81b04e159b9e8c49cb, user_id=f7946c3162f3422c89af3a12c59ceaec, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:03.193945 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3c1e0-689f-4747-8dfe-1da000f72552 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:03.196277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89063b9f-de02-4aab-a79c-8294650334ef admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:03.211917 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1116/2266] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:58:03 2022] PUT /identity/v3/projects/d3346c34190b47d3a89e2a4ccb31d119/users/5b2baeaad7d6495f95d3204c3913057c/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:03.214467 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3c1e0-689f-4747-8dfe-1da000f72552 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:03.228176 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1151/2267] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:58:03 2022] PUT /identity/v3/projects/dd33c8f9f7b04e81b04e159b9e8c49cb/users/f7946c3162f3422c89af3a12c59ceaec/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:03.232121 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa50db6-45b5-4c84-b700-7e084899cd4f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:03.232448 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa50db6-45b5-4c84-b700-7e084899cd4f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:03.232693 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa50db6-45b5-4c84-b700-7e084899cd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:03.286654 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-6aa50db6-45b5-4c84-b700-7e084899cd4f None None] MFA Rules not processed for user `f7946c3162f3422c89af3a12c59ceaec`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:03.288565 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6aa50db6-45b5-4c84-b700-7e084899cd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:03.320873 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3c1e0-689f-4747-8dfe-1da000f72552 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:03.377935 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1152/2268] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:03.385007 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa50db6-45b5-4c84-b700-7e084899cd4f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:03.395052 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e76a1f-fc35-42c6-8397-49930ff236c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:03.395799 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e76a1f-fc35-42c6-8397-49930ff236c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:03.396878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e76a1f-fc35-42c6-8397-49930ff236c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:03.396878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e76a1f-fc35-42c6-8397-49930ff236c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:03.397173 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e76a1f-fc35-42c6-8397-49930ff236c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:03.398834 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e76a1f-fc35-42c6-8397-49930ff236c7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:03.414509 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1117/2269] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:58:03.419554 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e76a1f-fc35-42c6-8397-49930ff236c7 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:03.431476 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e76a1f-fc35-42c6-8397-49930ff236c7 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:03.436443 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4fc1f-f92f-4893-aa33-c8ca414b4d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:03.437330 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4fc1f-f92f-4893-aa33-c8ca414b4d45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:03.437616 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4fc1f-f92f-4893-aa33-c8ca414b4d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:03.437885 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4fc1f-f92f-4893-aa33-c8ca414b4d45 admin admin] PATH_INFO: `/v3/projects/d3346c34190b47d3a89e2a4ccb31d119/users/5b2baeaad7d6495f95d3204c3913057c/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:03.441489 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b4fc1f-f92f-4893-aa33-c8ca414b4d45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3346c34190b47d3a89e2a4ccb31d119, user_id=5b2baeaad7d6495f95d3204c3913057c, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:03.444938 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b4fc1f-f92f-4893-aa33-c8ca414b4d45 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:03.457390 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1118/2270] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:58:03 2022] PUT /identity/v3/projects/d3346c34190b47d3a89e2a4ccb31d119/users/5b2baeaad7d6495f95d3204c3913057c/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:58:03.469832 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596b8f2-98c9-4190-becd-f2a30f8e8d7c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:03.470112 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa50db6-45b5-4c84-b700-7e084899cd4f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:03.470215 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596b8f2-98c9-4190-becd-f2a30f8e8d7c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:03.470410 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596b8f2-98c9-4190-becd-f2a30f8e8d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:03.476501 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:03.501554 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-6596b8f2-98c9-4190-becd-f2a30f8e8d7c None None] MFA Rules not processed for user `5b2baeaad7d6495f95d3204c3913057c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:03.503788 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6596b8f2-98c9-4190-becd-f2a30f8e8d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:03.533644 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:03.540735 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a34d0-14d8-41e3-910f-8400bdaff445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:03.541975 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a34d0-14d8-41e3-910f-8400bdaff445 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:03.542920 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a34d0-14d8-41e3-910f-8400bdaff445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:03.543275 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a34d0-14d8-41e3-910f-8400bdaff445 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:03.544890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a34d0-14d8-41e3-910f-8400bdaff445 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:03.547127 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a34d0-14d8-41e3-910f-8400bdaff445 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:03.578642 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1153/2271] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:58:03 2022] POST /identity/v3/projects => generated 377 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:58:03.582826 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a34d0-14d8-41e3-910f-8400bdaff445 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:03.601785 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1119/2272] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:03 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:58:03.616337 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596b8f2-98c9-4190-becd-f2a30f8e8d7c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:03.661821 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a34d0-14d8-41e3-910f-8400bdaff445 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:03.668014 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fe8e6-1d06-42b0-bb26-d291e58011ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:03.668993 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fe8e6-1d06-42b0-bb26-d291e58011ed admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:03.669274 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fe8e6-1d06-42b0-bb26-d291e58011ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:03.669554 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fe8e6-1d06-42b0-bb26-d291e58011ed admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:03.670426 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450fe8e6-1d06-42b0-bb26-d291e58011ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:03.673044 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450fe8e6-1d06-42b0-bb26-d291e58011ed admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:03.693604 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596b8f2-98c9-4190-becd-f2a30f8e8d7c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:03.700989 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1154/2273] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:58:03 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:58:03.702090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fe8e6-1d06-42b0-bb26-d291e58011ed admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:03.713428 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fe8e6-1d06-42b0-bb26-d291e58011ed admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:03.718508 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384ee77-27f1-4b16-a7f2-42571f324d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:03.719171 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384ee77-27f1-4b16-a7f2-42571f324d06 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:03.719452 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384ee77-27f1-4b16-a7f2-42571f324d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:03.719726 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384ee77-27f1-4b16-a7f2-42571f324d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:03.720541 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4384ee77-27f1-4b16-a7f2-42571f324d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:03.722284 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4384ee77-27f1-4b16-a7f2-42571f324d06 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:03.732809 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1155/2274] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:58:03.736751 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384ee77-27f1-4b16-a7f2-42571f324d06 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:03.741057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57a85d-5681-4d0f-b3c1-e97e32144218 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:03.741709 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57a85d-5681-4d0f-b3c1-e97e32144218 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:03.741992 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57a85d-5681-4d0f-b3c1-e97e32144218 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:03.742266 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57a85d-5681-4d0f-b3c1-e97e32144218 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:03.751230 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384ee77-27f1-4b16-a7f2-42571f324d06 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:03.756216 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7e5e6-6d53-4afc-be69-f4a3197b1b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:03.756809 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7e5e6-6d53-4afc-be69-f4a3197b1b93 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:03.757112 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7e5e6-6d53-4afc-be69-f4a3197b1b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:03.757383 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7e5e6-6d53-4afc-be69-f4a3197b1b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:03.758217 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7e5e6-6d53-4afc-be69-f4a3197b1b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:03.759844 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7e5e6-6d53-4afc-be69-f4a3197b1b93 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:03.771897 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1156/2275] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:58:03.776507 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7e5e6-6d53-4afc-be69-f4a3197b1b93 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:03.787751 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7e5e6-6d53-4afc-be69-f4a3197b1b93 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:03.793151 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cb885-d26b-4008-9a5a-0f3ef4936ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:03.794038 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cb885-d26b-4008-9a5a-0f3ef4936ff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:03.794316 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cb885-d26b-4008-9a5a-0f3ef4936ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:03.794583 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cb885-d26b-4008-9a5a-0f3ef4936ff7 admin admin] PATH_INFO: `/v3/projects/81b3c06cd6e74dc79f74214bc7c55f03/users/b10dc6c1ff0c48edbad50e32f0e7bfb4/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:03.805732 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:03.809615 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57a85d-5681-4d0f-b3c1-e97e32144218 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:03.811640 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57a85d-5681-4d0f-b3c1-e97e32144218 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:03.815203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1cb885-d26b-4008-9a5a-0f3ef4936ff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81b3c06cd6e74dc79f74214bc7c55f03, user_id=b10dc6c1ff0c48edbad50e32f0e7bfb4, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:03.818295 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1cb885-d26b-4008-9a5a-0f3ef4936ff7 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:03.822290 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1120/2276] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:03 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:58:03.833437 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1157/2277] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:58:03 2022] PUT /identity/v3/projects/81b3c06cd6e74dc79f74214bc7c55f03/users/b10dc6c1ff0c48edbad50e32f0e7bfb4/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:58:03.844386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb72de-689e-40dc-93b5-0b4232142783 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:03.845231 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb72de-689e-40dc-93b5-0b4232142783 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:03.845569 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb72de-689e-40dc-93b5-0b4232142783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:03.874639 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-68fb72de-689e-40dc-93b5-0b4232142783 None None] MFA Rules not processed for user `b10dc6c1ff0c48edbad50e32f0e7bfb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:03.875856 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-68fb72de-689e-40dc-93b5-0b4232142783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:03.915311 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cb885-d26b-4008-9a5a-0f3ef4936ff7 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:03.949412 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1121/2278] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:03.954174 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb72de-689e-40dc-93b5-0b4232142783 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:03.981543 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cb885-d26b-4008-9a5a-0f3ef4936ff7 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:03.985893 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e9800-d2ce-403b-b0fa-8169705ccd3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:03.986531 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e9800-d2ce-403b-b0fa-8169705ccd3a service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:03.986807 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e9800-d2ce-403b-b0fa-8169705ccd3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:03.987078 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e9800-d2ce-403b-b0fa-8169705ccd3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:04.017881 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb72de-689e-40dc-93b5-0b4232142783 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:04.022427 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ac522-ad62-422c-b2c1-e44788a8fdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:04.023092 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ac522-ad62-422c-b2c1-e44788a8fdb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:04.023369 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ac522-ad62-422c-b2c1-e44788a8fdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:04.023646 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ac522-ad62-422c-b2c1-e44788a8fdb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:04.024374 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ac522-ad62-422c-b2c1-e44788a8fdb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:04.026286 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ac522-ad62-422c-b2c1-e44788a8fdb8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:04.028559 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:04.049597 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e9800-d2ce-403b-b0fa-8169705ccd3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:04.051059 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e9800-d2ce-403b-b0fa-8169705ccd3a service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:04.054420 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1122/2279] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:58:03 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:58:04.058961 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ac522-ad62-422c-b2c1-e44788a8fdb8 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:04.063473 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1158/2280] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:03 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:58:04.124731 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ac522-ad62-422c-b2c1-e44788a8fdb8 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:04.130117 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e9c88-023b-4658-b714-2601a6a8fd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:04.130804 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e9c88-023b-4658-b714-2601a6a8fd57 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:04.131093 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e9c88-023b-4658-b714-2601a6a8fd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:04.131635 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e9c88-023b-4658-b714-2601a6a8fd57 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:04.132418 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e9c88-023b-4658-b714-2601a6a8fd57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:04.134729 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e9c88-023b-4658-b714-2601a6a8fd57 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:04.151295 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:04.159671 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1123/2281] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:58:04 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:58:04.163136 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e9800-d2ce-403b-b0fa-8169705ccd3a service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:04.176963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e9800-d2ce-403b-b0fa-8169705ccd3a service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:04.182099 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a3d2b-f162-447a-b358-9ab22a6edd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:04.182861 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a3d2b-f162-447a-b358-9ab22a6edd9b admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:04.183279 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a3d2b-f162-447a-b358-9ab22a6edd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:04.183672 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a3d2b-f162-447a-b358-9ab22a6edd9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:04.184559 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a3d2b-f162-447a-b358-9ab22a6edd9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:04.186450 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a3d2b-f162-447a-b358-9ab22a6edd9b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:04.197346 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1159/2282] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:58:04.202608 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e9c88-023b-4658-b714-2601a6a8fd57 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:04.217936 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e9c88-023b-4658-b714-2601a6a8fd57 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:04.223074 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4aaedf-17be-4857-9ad8-1665f56687b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:04.224010 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4aaedf-17be-4857-9ad8-1665f56687b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:04.224297 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4aaedf-17be-4857-9ad8-1665f56687b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:04.224573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4aaedf-17be-4857-9ad8-1665f56687b7 admin admin] PATH_INFO: `/v3/projects/a4e5cb92f36d44d9a1f61eee98d97f88/users/4decaada81814ab3bdb30a22bf844d29/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:04.244211 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4aaedf-17be-4857-9ad8-1665f56687b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4e5cb92f36d44d9a1f61eee98d97f88, user_id=4decaada81814ab3bdb30a22bf844d29, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:04.247018 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4aaedf-17be-4857-9ad8-1665f56687b7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:04.260883 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1124/2283] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:58:04 2022] PUT /identity/v3/projects/a4e5cb92f36d44d9a1f61eee98d97f88/users/4decaada81814ab3bdb30a22bf844d29/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:04.264885 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a3d2b-f162-447a-b358-9ab22a6edd9b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:04.275028 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a3d2b-f162-447a-b358-9ab22a6edd9b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:04.336283 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599d0f2-9f91-4f83-a52d-b61ca0326a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:04.336947 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599d0f2-9f91-4f83-a52d-b61ca0326a86 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:04.337204 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599d0f2-9f91-4f83-a52d-b61ca0326a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:04.337480 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599d0f2-9f91-4f83-a52d-b61ca0326a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:04.338205 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599d0f2-9f91-4f83-a52d-b61ca0326a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:04.339806 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599d0f2-9f91-4f83-a52d-b61ca0326a86 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:04.353470 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1160/2284] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:58:04.359059 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4aaedf-17be-4857-9ad8-1665f56687b7 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:04.370501 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4aaedf-17be-4857-9ad8-1665f56687b7 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:04.376250 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e2e9d-d465-49a5-b827-99c0d3adba3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:04.377150 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e2e9d-d465-49a5-b827-99c0d3adba3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:04.377430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e2e9d-d465-49a5-b827-99c0d3adba3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:04.377708 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e2e9d-d465-49a5-b827-99c0d3adba3e admin admin] PATH_INFO: `/v3/projects/a4e5cb92f36d44d9a1f61eee98d97f88/users/4decaada81814ab3bdb30a22bf844d29/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:04.379758 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e2e9d-d465-49a5-b827-99c0d3adba3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4e5cb92f36d44d9a1f61eee98d97f88, user_id=4decaada81814ab3bdb30a22bf844d29, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:04.382602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e2e9d-d465-49a5-b827-99c0d3adba3e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:04.393479 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1125/2285] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:58:04 2022] PUT /identity/v3/projects/a4e5cb92f36d44d9a1f61eee98d97f88/users/4decaada81814ab3bdb30a22bf844d29/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:04.405615 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfa89b-b991-4be5-8031-ce0c920900ec None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:04.405927 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfa89b-b991-4be5-8031-ce0c920900ec None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:04.406236 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfa89b-b991-4be5-8031-ce0c920900ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:04.444527 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-33cfa89b-b991-4be5-8031-ce0c920900ec None None] MFA Rules not processed for user `4decaada81814ab3bdb30a22bf844d29`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:04.445769 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-33cfa89b-b991-4be5-8031-ce0c920900ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:04.525227 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1161/2286] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:04.537475 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e2e9d-d465-49a5-b827-99c0d3adba3e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:04.539482 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e06e2e9d-d465-49a5-b827-99c0d3adba3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:04.606495 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e2e9d-d465-49a5-b827-99c0d3adba3e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:04.610850 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8cd43c-af38-4e75-b112-115c7a6f0d01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:04.611576 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cd43c-af38-4e75-b112-115c7a6f0d01 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:04.611897 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cd43c-af38-4e75-b112-115c7a6f0d01 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:04.612186 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cd43c-af38-4e75-b112-115c7a6f0d01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:04.683057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8cd43c-af38-4e75-b112-115c7a6f0d01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:04.684589 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8cd43c-af38-4e75-b112-115c7a6f0d01 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:04.696266 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1126/2287] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:58:06.291321 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cfa89b-b991-4be5-8031-ce0c920900ec None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:06.302185 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cfa89b-b991-4be5-8031-ce0c920900ec None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:06.306012 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be316b7e-7b58-4c63-ba9d-6e8db96c8fd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:06.306651 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be316b7e-7b58-4c63-ba9d-6e8db96c8fd2 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:06.306937 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be316b7e-7b58-4c63-ba9d-6e8db96c8fd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:06.307214 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be316b7e-7b58-4c63-ba9d-6e8db96c8fd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:06.361875 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:06.378234 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be316b7e-7b58-4c63-ba9d-6e8db96c8fd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:06.379705 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be316b7e-7b58-4c63-ba9d-6e8db96c8fd2 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:06.389530 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1162/2288] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:58:06.968361 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8cd43c-af38-4e75-b112-115c7a6f0d01 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:06.981054 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8cd43c-af38-4e75-b112-115c7a6f0d01 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:06.985654 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b30753-f0bc-417d-bb24-2a126efcffcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:06.986312 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b30753-f0bc-417d-bb24-2a126efcffcd service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:06.986573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b30753-f0bc-417d-bb24-2a126efcffcd service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:06.986878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b30753-f0bc-417d-bb24-2a126efcffcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:06.998071 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b30753-f0bc-417d-bb24-2a126efcffcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:06.999661 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b30753-f0bc-417d-bb24-2a126efcffcd service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:07.011036 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1127/2289] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:06 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:58:12.172260 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be316b7e-7b58-4c63-ba9d-6e8db96c8fd2 service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:12.251469 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be316b7e-7b58-4c63-ba9d-6e8db96c8fd2 service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:12.259267 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dade044-8ef0-4c94-b0aa-68ab28f81ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:12.260563 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dade044-8ef0-4c94-b0aa-68ab28f81ea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:12.260882 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dade044-8ef0-4c94-b0aa-68ab28f81ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:12.261295 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dade044-8ef0-4c94-b0aa-68ab28f81ea8 admin admin] PATH_INFO: `/v3/users/f7946c3162f3422c89af3a12c59ceaec` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:12.263173 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dade044-8ef0-4c94-b0aa-68ab28f81ea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7946c3162f3422c89af3a12c59ceaec)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:12.265853 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dade044-8ef0-4c94-b0aa-68ab28f81ea8 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:12.335977 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5dade044-8ef0-4c94-b0aa-68ab28f81ea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7946c3162f3422c89af3a12c59ceaec'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:12.354504 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5dade044-8ef0-4c94-b0aa-68ab28f81ea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7946c3162f3422c89af3a12c59ceaec'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:12.355715 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5dade044-8ef0-4c94-b0aa-68ab28f81ea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7946c3162f3422c89af3a12c59ceaec'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:12.364703 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5dade044-8ef0-4c94-b0aa-68ab28f81ea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7946c3162f3422c89af3a12c59ceaec'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:12.372278 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5dade044-8ef0-4c94-b0aa-68ab28f81ea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7946c3162f3422c89af3a12c59ceaec'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:12.378398 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1163/2290] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:58:12 2022] DELETE /identity/v3/users/f7946c3162f3422c89af3a12c59ceaec => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:58:12.382904 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01305cc-2071-4515-bfb0-edcaee5e9071 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:12.383395 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01305cc-2071-4515-bfb0-edcaee5e9071 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:12.383501 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01305cc-2071-4515-bfb0-edcaee5e9071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:12.401820 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d01305cc-2071-4515-bfb0-edcaee5e9071 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:12.403054 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d01305cc-2071-4515-bfb0-edcaee5e9071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:12.468705 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1128/2291] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:12.478555 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dade044-8ef0-4c94-b0aa-68ab28f81ea8 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:12.480142 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5dade044-8ef0-4c94-b0aa-68ab28f81ea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:12.541038 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dade044-8ef0-4c94-b0aa-68ab28f81ea8 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:12.545399 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac4244-f2c9-4216-8ab4-7ee41819f24b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:12.546067 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac4244-f2c9-4216-8ab4-7ee41819f24b service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:12.546341 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac4244-f2c9-4216-8ab4-7ee41819f24b service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:12.546613 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac4244-f2c9-4216-8ab4-7ee41819f24b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:12.556550 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac4244-f2c9-4216-8ab4-7ee41819f24b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:12.558053 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac4244-f2c9-4216-8ab4-7ee41819f24b service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:12.568338 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1164/2292] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:58:12.861853 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01305cc-2071-4515-bfb0-edcaee5e9071 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:12.863561 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d01305cc-2071-4515-bfb0-edcaee5e9071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:12.871028 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:12.878548 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01305cc-2071-4515-bfb0-edcaee5e9071 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:12.885730 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3df69-ff68-45cd-9a6a-0d4f5adef7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:12.886627 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3df69-ff68-45cd-9a6a-0d4f5adef7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:12.886913 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3df69-ff68-45cd-9a6a-0d4f5adef7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:12.887206 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3df69-ff68-45cd-9a6a-0d4f5adef7e7 admin admin] PATH_INFO: `/v3/projects/dd33c8f9f7b04e81b04e159b9e8c49cb` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:12.888493 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3df69-ff68-45cd-9a6a-0d4f5adef7e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd33c8f9f7b04e81b04e159b9e8c49cb)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:12.890620 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3df69-ff68-45cd-9a6a-0d4f5adef7e7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:12.940738 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7ef3df69-ff68-45cd-9a6a-0d4f5adef7e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd33c8f9f7b04e81b04e159b9e8c49cb', 'request_id': 'req-7ef3df69-ff68-45cd-9a6a-0d4f5adef7e7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:12.947546 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7ef3df69-ff68-45cd-9a6a-0d4f5adef7e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd33c8f9f7b04e81b04e159b9e8c49cb', 'request_id': 'req-7ef3df69-ff68-45cd-9a6a-0d4f5adef7e7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:12.955212 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7ef3df69-ff68-45cd-9a6a-0d4f5adef7e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd33c8f9f7b04e81b04e159b9e8c49cb', 'request_id': 'req-7ef3df69-ff68-45cd-9a6a-0d4f5adef7e7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:12.970066 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7ef3df69-ff68-45cd-9a6a-0d4f5adef7e7 admin admin] The token cache is being invalidate because project dd33c8f9f7b04e81b04e159b9e8c49cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:58:12.970350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7ef3df69-ff68-45cd-9a6a-0d4f5adef7e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:12.970985 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7ef3df69-ff68-45cd-9a6a-0d4f5adef7e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:12.972596 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1129/2293] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:58:12 2022] DELETE /identity/v3/projects/dd33c8f9f7b04e81b04e159b9e8c49cb => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:12.976795 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac4244-f2c9-4216-8ab4-7ee41819f24b service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:12.988146 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac4244-f2c9-4216-8ab4-7ee41819f24b service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:12.993081 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:13.058573 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea6b7d-f1a2-477f-bb7f-7d86394467a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:13.059538 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea6b7d-f1a2-477f-bb7f-7d86394467a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:13.059822 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea6b7d-f1a2-477f-bb7f-7d86394467a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:13.060135 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea6b7d-f1a2-477f-bb7f-7d86394467a4 admin admin] PATH_INFO: `/v3/users/b10dc6c1ff0c48edbad50e32f0e7bfb4` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:13.061576 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea6b7d-f1a2-477f-bb7f-7d86394467a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b10dc6c1ff0c48edbad50e32f0e7bfb4)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:13.063516 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea6b7d-f1a2-477f-bb7f-7d86394467a4 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:13.118252 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-44ea6b7d-f1a2-477f-bb7f-7d86394467a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b10dc6c1ff0c48edbad50e32f0e7bfb4'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:13.131512 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-44ea6b7d-f1a2-477f-bb7f-7d86394467a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b10dc6c1ff0c48edbad50e32f0e7bfb4'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:13.132250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-44ea6b7d-f1a2-477f-bb7f-7d86394467a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b10dc6c1ff0c48edbad50e32f0e7bfb4'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:13.141128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-44ea6b7d-f1a2-477f-bb7f-7d86394467a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b10dc6c1ff0c48edbad50e32f0e7bfb4'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:13.150577 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-44ea6b7d-f1a2-477f-bb7f-7d86394467a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b10dc6c1ff0c48edbad50e32f0e7bfb4'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:13.158781 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1165/2294] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:58:12 2022] DELETE /identity/v3/users/b10dc6c1ff0c48edbad50e32f0e7bfb4 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:13.482260 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3df69-ff68-45cd-9a6a-0d4f5adef7e7 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:13.485115 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7ef3df69-ff68-45cd-9a6a-0d4f5adef7e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:13.502593 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3df69-ff68-45cd-9a6a-0d4f5adef7e7 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:13.606991 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435d69c-bc20-46be-870a-e03617e540d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:13.608251 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435d69c-bc20-46be-870a-e03617e540d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:13.608606 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435d69c-bc20-46be-870a-e03617e540d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:13.609105 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435d69c-bc20-46be-870a-e03617e540d4 admin admin] PATH_INFO: `/v3/projects/81b3c06cd6e74dc79f74214bc7c55f03` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:13.610497 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0435d69c-bc20-46be-870a-e03617e540d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81b3c06cd6e74dc79f74214bc7c55f03)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:13.613606 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0435d69c-bc20-46be-870a-e03617e540d4 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:13.697599 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0435d69c-bc20-46be-870a-e03617e540d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81b3c06cd6e74dc79f74214bc7c55f03', 'request_id': 'req-0435d69c-bc20-46be-870a-e03617e540d4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:13.706595 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0435d69c-bc20-46be-870a-e03617e540d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81b3c06cd6e74dc79f74214bc7c55f03', 'request_id': 'req-0435d69c-bc20-46be-870a-e03617e540d4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:13.714504 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0435d69c-bc20-46be-870a-e03617e540d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81b3c06cd6e74dc79f74214bc7c55f03', 'request_id': 'req-0435d69c-bc20-46be-870a-e03617e540d4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:13.739071 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0435d69c-bc20-46be-870a-e03617e540d4 admin admin] The token cache is being invalidate because project 81b3c06cd6e74dc79f74214bc7c55f03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:58:13.740484 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0435d69c-bc20-46be-870a-e03617e540d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:13.741410 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0435d69c-bc20-46be-870a-e03617e540d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:13.744086 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1130/2295] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:58:13 2022] DELETE /identity/v3/projects/81b3c06cd6e74dc79f74214bc7c55f03 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:13.748443 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea6b7d-f1a2-477f-bb7f-7d86394467a4 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:13.749933 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-44ea6b7d-f1a2-477f-bb7f-7d86394467a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:13.763268 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea6b7d-f1a2-477f-bb7f-7d86394467a4 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:13.794393 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435d69c-bc20-46be-870a-e03617e540d4 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:13.796342 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0435d69c-bc20-46be-870a-e03617e540d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:13.838053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:13.870820 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b71be-7e0c-4b4d-b21b-855709bdf15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:13.872617 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b71be-7e0c-4b4d-b21b-855709bdf15e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:13.873215 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b71be-7e0c-4b4d-b21b-855709bdf15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:13.873708 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b71be-7e0c-4b4d-b21b-855709bdf15e admin admin] PATH_INFO: `/v3/users/4decaada81814ab3bdb30a22bf844d29` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:13.876968 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b71be-7e0c-4b4d-b21b-855709bdf15e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4decaada81814ab3bdb30a22bf844d29)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:13.880869 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b71be-7e0c-4b4d-b21b-855709bdf15e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:13.939858 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:13.969255 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435d69c-bc20-46be-870a-e03617e540d4 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:13.977026 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ee448-34b1-406a-800c-2c102c0706ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:13.978638 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ee448-34b1-406a-800c-2c102c0706ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:13.979239 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ee448-34b1-406a-800c-2c102c0706ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:13.979608 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a84b71be-7e0c-4b4d-b21b-855709bdf15e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4decaada81814ab3bdb30a22bf844d29'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:13.980028 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ee448-34b1-406a-800c-2c102c0706ff admin admin] PATH_INFO: `/v3/users/81f7ba28d1cc4666b5836e13cdb69dce` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:13.981757 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ee448-34b1-406a-800c-2c102c0706ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=81f7ba28d1cc4666b5836e13cdb69dce)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:13.984903 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ee448-34b1-406a-800c-2c102c0706ff admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:13.995404 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a84b71be-7e0c-4b4d-b21b-855709bdf15e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4decaada81814ab3bdb30a22bf844d29'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:13.996909 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a84b71be-7e0c-4b4d-b21b-855709bdf15e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4decaada81814ab3bdb30a22bf844d29'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:14.011948 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a84b71be-7e0c-4b4d-b21b-855709bdf15e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4decaada81814ab3bdb30a22bf844d29'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:14.040222 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a84b71be-7e0c-4b4d-b21b-855709bdf15e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4decaada81814ab3bdb30a22bf844d29'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:14.049116 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1166/2296] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:58:13 2022] DELETE /identity/v3/users/4decaada81814ab3bdb30a22bf844d29 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:58:14.066331 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-624ee448-34b1-406a-800c-2c102c0706ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81f7ba28d1cc4666b5836e13cdb69dce'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:14.079343 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-624ee448-34b1-406a-800c-2c102c0706ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81f7ba28d1cc4666b5836e13cdb69dce'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:14.093230 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-624ee448-34b1-406a-800c-2c102c0706ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81f7ba28d1cc4666b5836e13cdb69dce'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:14.112981 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-624ee448-34b1-406a-800c-2c102c0706ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81f7ba28d1cc4666b5836e13cdb69dce'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:14.114062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-624ee448-34b1-406a-800c-2c102c0706ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81f7ba28d1cc4666b5836e13cdb69dce'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:14.127702 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1131/2297] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:58:13 2022] DELETE /identity/v3/users/81f7ba28d1cc4666b5836e13cdb69dce => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:14.132638 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0588b-a852-434d-bd6d-bc446060614e None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:14.132969 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0588b-a852-434d-bd6d-bc446060614e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:14.133520 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0588b-a852-434d-bd6d-bc446060614e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:14.157272 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-93d0588b-a852-434d-bd6d-bc446060614e None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:14.158973 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-93d0588b-a852-434d-bd6d-bc446060614e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:14.249928 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1167/2298] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:58:14.267157 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ee448-34b1-406a-800c-2c102c0706ff admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:14.269107 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-624ee448-34b1-406a-800c-2c102c0706ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:14.349172 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ee448-34b1-406a-800c-2c102c0706ff admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:14.355215 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f55b0-9a83-4731-8cff-87191d127841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:14.356156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f55b0-9a83-4731-8cff-87191d127841 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:14.356588 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f55b0-9a83-4731-8cff-87191d127841 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:14.356954 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f55b0-9a83-4731-8cff-87191d127841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:14.369192 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f55b0-9a83-4731-8cff-87191d127841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:14.370802 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f55b0-9a83-4731-8cff-87191d127841 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:14.377668 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0588b-a852-434d-bd6d-bc446060614e None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:14.379311 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-93d0588b-a852-434d-bd6d-bc446060614e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:14.387591 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1132/2299] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:58:14.395007 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0588b-a852-434d-bd6d-bc446060614e None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:14.400959 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ba28f-3917-4817-b77f-ac151b06ea6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:14.401938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ba28f-3917-4817-b77f-ac151b06ea6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:14.402276 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ba28f-3917-4817-b77f-ac151b06ea6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:14.402622 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ba28f-3917-4817-b77f-ac151b06ea6e admin admin] PATH_INFO: `/v3/projects/a4e5cb92f36d44d9a1f61eee98d97f88` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:14.404152 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ba28f-3917-4817-b77f-ac151b06ea6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4e5cb92f36d44d9a1f61eee98d97f88)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:14.406350 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ba28f-3917-4817-b77f-ac151b06ea6e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:14.473679 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c90ba28f-3917-4817-b77f-ac151b06ea6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4e5cb92f36d44d9a1f61eee98d97f88', 'request_id': 'req-c90ba28f-3917-4817-b77f-ac151b06ea6e'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:14.480619 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c90ba28f-3917-4817-b77f-ac151b06ea6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4e5cb92f36d44d9a1f61eee98d97f88', 'request_id': 'req-c90ba28f-3917-4817-b77f-ac151b06ea6e'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:14.490292 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c90ba28f-3917-4817-b77f-ac151b06ea6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4e5cb92f36d44d9a1f61eee98d97f88', 'request_id': 'req-c90ba28f-3917-4817-b77f-ac151b06ea6e'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:14.506938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c90ba28f-3917-4817-b77f-ac151b06ea6e admin admin] The token cache is being invalidate because project a4e5cb92f36d44d9a1f61eee98d97f88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:58:14.507229 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c90ba28f-3917-4817-b77f-ac151b06ea6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:14.508030 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c90ba28f-3917-4817-b77f-ac151b06ea6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:14.511920 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1168/2300] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:58:14 2022] DELETE /identity/v3/projects/a4e5cb92f36d44d9a1f61eee98d97f88 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:14.816057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f55b0-9a83-4731-8cff-87191d127841 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:14.818705 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-571f55b0-9a83-4731-8cff-87191d127841 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:14.842202 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f55b0-9a83-4731-8cff-87191d127841 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:14.893741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:14.930915 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255273d3-ee2d-4394-b9b8-1b214f976302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:14.932336 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255273d3-ee2d-4394-b9b8-1b214f976302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:14.932336 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255273d3-ee2d-4394-b9b8-1b214f976302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:14.932705 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255273d3-ee2d-4394-b9b8-1b214f976302 admin admin] PATH_INFO: `/v3/projects/65c2250f2c4d4eaba7d7768e1432ad15` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:14.934346 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255273d3-ee2d-4394-b9b8-1b214f976302 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65c2250f2c4d4eaba7d7768e1432ad15)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:14.936527 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255273d3-ee2d-4394-b9b8-1b214f976302 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:14.989195 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-255273d3-ee2d-4394-b9b8-1b214f976302 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65c2250f2c4d4eaba7d7768e1432ad15', 'request_id': 'req-255273d3-ee2d-4394-b9b8-1b214f976302'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:15.002844 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-255273d3-ee2d-4394-b9b8-1b214f976302 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65c2250f2c4d4eaba7d7768e1432ad15', 'request_id': 'req-255273d3-ee2d-4394-b9b8-1b214f976302'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:15.009086 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-255273d3-ee2d-4394-b9b8-1b214f976302 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65c2250f2c4d4eaba7d7768e1432ad15', 'request_id': 'req-255273d3-ee2d-4394-b9b8-1b214f976302'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:15.022381 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-255273d3-ee2d-4394-b9b8-1b214f976302 admin admin] The token cache is being invalidate because project 65c2250f2c4d4eaba7d7768e1432ad15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:58:15.022668 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-255273d3-ee2d-4394-b9b8-1b214f976302 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:15.023895 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-255273d3-ee2d-4394-b9b8-1b214f976302 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:15.025439 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1133/2301] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:58:14 2022] DELETE /identity/v3/projects/65c2250f2c4d4eaba7d7768e1432ad15 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:15.029620 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ba28f-3917-4817-b77f-ac151b06ea6e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:15.031039 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c90ba28f-3917-4817-b77f-ac151b06ea6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:15.044577 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ba28f-3917-4817-b77f-ac151b06ea6e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:15.073259 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:15.102554 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c5cee-eff7-4324-97b4-3426ae644877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:15.103438 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c5cee-eff7-4324-97b4-3426ae644877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:15.103715 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c5cee-eff7-4324-97b4-3426ae644877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:15.104012 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c5cee-eff7-4324-97b4-3426ae644877 admin admin] PATH_INFO: `/v3/users/5b2baeaad7d6495f95d3204c3913057c` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:15.105213 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c5cee-eff7-4324-97b4-3426ae644877 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b2baeaad7d6495f95d3204c3913057c)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:15.107256 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c5cee-eff7-4324-97b4-3426ae644877 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:15.158103 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-231c5cee-eff7-4324-97b4-3426ae644877 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b2baeaad7d6495f95d3204c3913057c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:15.170713 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-231c5cee-eff7-4324-97b4-3426ae644877 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b2baeaad7d6495f95d3204c3913057c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:15.171468 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-231c5cee-eff7-4324-97b4-3426ae644877 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b2baeaad7d6495f95d3204c3913057c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:15.179663 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-231c5cee-eff7-4324-97b4-3426ae644877 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b2baeaad7d6495f95d3204c3913057c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:15.187232 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-231c5cee-eff7-4324-97b4-3426ae644877 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b2baeaad7d6495f95d3204c3913057c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:15.193852 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1169/2302] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:58:15 2022] DELETE /identity/v3/users/5b2baeaad7d6495f95d3204c3913057c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:15.503861 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255273d3-ee2d-4394-b9b8-1b214f976302 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:15.505443 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-255273d3-ee2d-4394-b9b8-1b214f976302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:15.519591 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255273d3-ee2d-4394-b9b8-1b214f976302 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:15.592493 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc00df-1e21-4344-a7bd-a22781ffc46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:15.593475 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc00df-1e21-4344-a7bd-a22781ffc46f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:15.593756 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc00df-1e21-4344-a7bd-a22781ffc46f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:15.594031 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc00df-1e21-4344-a7bd-a22781ffc46f admin admin] PATH_INFO: `/v3/projects/d3346c34190b47d3a89e2a4ccb31d119` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:15.595238 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc00df-1e21-4344-a7bd-a22781ffc46f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3346c34190b47d3a89e2a4ccb31d119)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:15.597212 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc00df-1e21-4344-a7bd-a22781ffc46f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:15.652238 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b0fc00df-1e21-4344-a7bd-a22781ffc46f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3346c34190b47d3a89e2a4ccb31d119', 'request_id': 'req-b0fc00df-1e21-4344-a7bd-a22781ffc46f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:15.662102 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b0fc00df-1e21-4344-a7bd-a22781ffc46f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3346c34190b47d3a89e2a4ccb31d119', 'request_id': 'req-b0fc00df-1e21-4344-a7bd-a22781ffc46f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:15.669216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b0fc00df-1e21-4344-a7bd-a22781ffc46f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3346c34190b47d3a89e2a4ccb31d119', 'request_id': 'req-b0fc00df-1e21-4344-a7bd-a22781ffc46f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:15.681537 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:15.690300 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b0fc00df-1e21-4344-a7bd-a22781ffc46f admin admin] The token cache is being invalidate because project d3346c34190b47d3a89e2a4ccb31d119 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:58:15.690982 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b0fc00df-1e21-4344-a7bd-a22781ffc46f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:15.692383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b0fc00df-1e21-4344-a7bd-a22781ffc46f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:15.694117 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1134/2303] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:58:15 2022] DELETE /identity/v3/projects/d3346c34190b47d3a89e2a4ccb31d119 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:15.699097 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25732c3-30ba-48b0-bec6-a5f3a1ee347a None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:15.699387 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25732c3-30ba-48b0-bec6-a5f3a1ee347a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:15.699692 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25732c3-30ba-48b0-bec6-a5f3a1ee347a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:15.718620 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-a25732c3-30ba-48b0-bec6-a5f3a1ee347a None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:15.719858 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a25732c3-30ba-48b0-bec6-a5f3a1ee347a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:15.784644 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1170/2304] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:15.792813 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6225e-357e-4d73-a5e2-b6528b126fe4 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:15.793099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6225e-357e-4d73-a5e2-b6528b126fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:15.793380 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6225e-357e-4d73-a5e2-b6528b126fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:15.812275 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-39c6225e-357e-4d73-a5e2-b6528b126fe4 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:15.813473 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-39c6225e-357e-4d73-a5e2-b6528b126fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:15.821704 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1135/2305] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:15.825940 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25732c3-30ba-48b0-bec6-a5f3a1ee347a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:15.836224 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25732c3-30ba-48b0-bec6-a5f3a1ee347a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:15.840941 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3e823-e643-4db5-87c0-2a14bfa15947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:15.841588 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3e823-e643-4db5-87c0-2a14bfa15947 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:15.841860 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3e823-e643-4db5-87c0-2a14bfa15947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:15.842262 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3e823-e643-4db5-87c0-2a14bfa15947 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:15.843001 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3e823-e643-4db5-87c0-2a14bfa15947 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:58:15.843298 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3e823-e643-4db5-87c0-2a14bfa15947 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:15.844943 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3e823-e643-4db5-87c0-2a14bfa15947 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:15.856743 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1171/2306] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:58:15.860917 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6225e-357e-4d73-a5e2-b6528b126fe4 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:15.870444 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6225e-357e-4d73-a5e2-b6528b126fe4 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:15.876508 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef04c67-9407-4932-b2ee-7b7c29e15ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:15.877214 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef04c67-9407-4932-b2ee-7b7c29e15ac3 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:15.877503 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef04c67-9407-4932-b2ee-7b7c29e15ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:15.877818 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef04c67-9407-4932-b2ee-7b7c29e15ac3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:15.878514 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef04c67-9407-4932-b2ee-7b7c29e15ac3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:15.880461 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef04c67-9407-4932-b2ee-7b7c29e15ac3 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:15.908047 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1136/2307] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:58:15 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:58:15.912673 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3e823-e643-4db5-87c0-2a14bfa15947 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:15.923664 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3e823-e643-4db5-87c0-2a14bfa15947 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:15.958486 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:15.984926 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6c576-7d23-4eb6-9d00-8fb1ab029e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:15.985600 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6c576-7d23-4eb6-9d00-8fb1ab029e70 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:15.985886 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6c576-7d23-4eb6-9d00-8fb1ab029e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:15.986166 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6c576-7d23-4eb6-9d00-8fb1ab029e70 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:15.986866 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6c576-7d23-4eb6-9d00-8fb1ab029e70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:15.988846 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6c576-7d23-4eb6-9d00-8fb1ab029e70 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:16.011894 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1172/2308] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:58:15 2022] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:58:16.016264 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef04c67-9407-4932-b2ee-7b7c29e15ac3 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:16.027939 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef04c67-9407-4932-b2ee-7b7c29e15ac3 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:16.033908 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18aa761-6cfd-433d-b7c2-69ae75c9f411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:16.034586 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18aa761-6cfd-433d-b7c2-69ae75c9f411 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:16.034869 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18aa761-6cfd-433d-b7c2-69ae75c9f411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:16.035141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18aa761-6cfd-433d-b7c2-69ae75c9f411 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:16.035896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18aa761-6cfd-433d-b7c2-69ae75c9f411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:16.037830 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18aa761-6cfd-433d-b7c2-69ae75c9f411 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:16.052971 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1137/2309] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:58:16.054332 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6c576-7d23-4eb6-9d00-8fb1ab029e70 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:16.065358 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6c576-7d23-4eb6-9d00-8fb1ab029e70 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:16.070152 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f47310-811b-40bd-a132-7aa84702d349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:16.070812 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f47310-811b-40bd-a132-7aa84702d349 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:16.071098 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f47310-811b-40bd-a132-7aa84702d349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:16.071422 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f47310-811b-40bd-a132-7aa84702d349 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:16.072187 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f47310-811b-40bd-a132-7aa84702d349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:16.073862 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f47310-811b-40bd-a132-7aa84702d349 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:16.085365 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1173/2310] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:58:16.089797 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18aa761-6cfd-433d-b7c2-69ae75c9f411 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:16.102016 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18aa761-6cfd-433d-b7c2-69ae75c9f411 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:16.106996 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c1ab7-0d02-4419-854f-52f7d3d5a821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:16.108083 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c1ab7-0d02-4419-854f-52f7d3d5a821 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:16.108394 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c1ab7-0d02-4419-854f-52f7d3d5a821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:16.108678 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c1ab7-0d02-4419-854f-52f7d3d5a821 admin admin] PATH_INFO: `/v3/projects/e5bca35c837c49e5935aa0ea655cbae5/users/fd487618fce54557bd350b6da9f246dd/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:16.127578 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638c1ab7-0d02-4419-854f-52f7d3d5a821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5bca35c837c49e5935aa0ea655cbae5, user_id=fd487618fce54557bd350b6da9f246dd, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:16.131521 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638c1ab7-0d02-4419-854f-52f7d3d5a821 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:16.150473 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1138/2311] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:58:16 2022] PUT /identity/v3/projects/e5bca35c837c49e5935aa0ea655cbae5/users/fd487618fce54557bd350b6da9f246dd/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:58:16.170209 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eac856-d93e-46cd-9c56-dc5b09590fb9 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:16.170783 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eac856-d93e-46cd-9c56-dc5b09590fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:16.171059 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eac856-d93e-46cd-9c56-dc5b09590fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:16.199086 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-40eac856-d93e-46cd-9c56-dc5b09590fb9 None None] MFA Rules not processed for user `fd487618fce54557bd350b6da9f246dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:16.200348 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-40eac856-d93e-46cd-9c56-dc5b09590fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:16.266538 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1174/2312] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:16 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:16.271203 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c1ab7-0d02-4419-854f-52f7d3d5a821 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:16.339320 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c1ab7-0d02-4419-854f-52f7d3d5a821 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:16.347674 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a07c13-3d84-4603-a133-9bdebc8bb03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:16.348393 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a07c13-3d84-4603-a133-9bdebc8bb03f admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:16.348680 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a07c13-3d84-4603-a133-9bdebc8bb03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:16.348959 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a07c13-3d84-4603-a133-9bdebc8bb03f admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:16.349668 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a07c13-3d84-4603-a133-9bdebc8bb03f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:16.351603 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a07c13-3d84-4603-a133-9bdebc8bb03f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:16.385885 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1139/2313] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:58:16 2022] POST /identity/v3/projects => generated 369 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:58:16.390752 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eac856-d93e-46cd-9c56-dc5b09590fb9 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:16.401934 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eac856-d93e-46cd-9c56-dc5b09590fb9 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:16.458456 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a07c13-3d84-4603-a133-9bdebc8bb03f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:16.460376 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-19a07c13-3d84-4603-a133-9bdebc8bb03f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:16.466209 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd24006-50dd-4e2d-8ee9-c7012e86ec4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:16.466981 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd24006-50dd-4e2d-8ee9-c7012e86ec4e admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:16.467274 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd24006-50dd-4e2d-8ee9-c7012e86ec4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:16.467615 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd24006-50dd-4e2d-8ee9-c7012e86ec4e admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:16.468279 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd24006-50dd-4e2d-8ee9-c7012e86ec4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:16.470206 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd24006-50dd-4e2d-8ee9-c7012e86ec4e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:16.497137 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1175/2314] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:58:16 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:58:16.501088 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd24006-50dd-4e2d-8ee9-c7012e86ec4e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:16.512488 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd24006-50dd-4e2d-8ee9-c7012e86ec4e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:16.523008 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd52351-fc28-4fc8-b3c3-519c72cdfcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:16.523744 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd52351-fc28-4fc8-b3c3-519c72cdfcbe admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:16.524132 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd52351-fc28-4fc8-b3c3-519c72cdfcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:16.524412 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd52351-fc28-4fc8-b3c3-519c72cdfcbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:16.525140 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd52351-fc28-4fc8-b3c3-519c72cdfcbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:16.527090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd52351-fc28-4fc8-b3c3-519c72cdfcbe admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:16.536687 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a07c13-3d84-4603-a133-9bdebc8bb03f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:16.539363 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1176/2315] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:58:16.541758 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3a508-3c83-43d8-a2a0-5e25ee839f9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:16.542501 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3a508-3c83-43d8-a2a0-5e25ee839f9b service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:16.542805 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3a508-3c83-43d8-a2a0-5e25ee839f9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:16.543086 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3a508-3c83-43d8-a2a0-5e25ee839f9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:16.543754 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd52351-fc28-4fc8-b3c3-519c72cdfcbe admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:16.545006 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6bb3a508-3c83-43d8-a2a0-5e25ee839f9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:16.554543 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd52351-fc28-4fc8-b3c3-519c72cdfcbe admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:16.569036 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41e91a-bac3-44be-8669-044fbe12fd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:16.570103 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41e91a-bac3-44be-8669-044fbe12fd0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:16.570450 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41e91a-bac3-44be-8669-044fbe12fd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:16.570811 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41e91a-bac3-44be-8669-044fbe12fd0e admin admin] PATH_INFO: `/v3/projects/b442ef4dfc294123ad7435b304a0e51d/users/9ae5b4abe64b424199f61c491a13aa50/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:16.588674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41e91a-bac3-44be-8669-044fbe12fd0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b442ef4dfc294123ad7435b304a0e51d, user_id=9ae5b4abe64b424199f61c491a13aa50, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:16.592580 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41e91a-bac3-44be-8669-044fbe12fd0e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:16.597921 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:16.608698 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:16.617667 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1177/2316] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:58:16 2022] PUT /identity/v3/projects/b442ef4dfc294123ad7435b304a0e51d/users/9ae5b4abe64b424199f61c491a13aa50/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:16.622488 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41e91a-bac3-44be-8669-044fbe12fd0e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:16.644810 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3a508-3c83-43d8-a2a0-5e25ee839f9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:16.646358 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3a508-3c83-43d8-a2a0-5e25ee839f9b service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:16.658091 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1140/2317] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:58:16.707379 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41e91a-bac3-44be-8669-044fbe12fd0e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:16.712569 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b97e0d-e664-41c4-a37b-0c1780a66111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:16.713308 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b97e0d-e664-41c4-a37b-0c1780a66111 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:16.713652 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b97e0d-e664-41c4-a37b-0c1780a66111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:16.713992 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b97e0d-e664-41c4-a37b-0c1780a66111 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:16.714720 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b97e0d-e664-41c4-a37b-0c1780a66111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:16.716562 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b97e0d-e664-41c4-a37b-0c1780a66111 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:16.730342 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1178/2318] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:58:16.731594 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3a508-3c83-43d8-a2a0-5e25ee839f9b service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:16.743238 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3a508-3c83-43d8-a2a0-5e25ee839f9b service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:16.748120 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fe267-92e3-42a7-8840-57ebacbe9fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:16.749140 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fe267-92e3-42a7-8840-57ebacbe9fe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:16.749429 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fe267-92e3-42a7-8840-57ebacbe9fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:16.749713 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fe267-92e3-42a7-8840-57ebacbe9fe2 admin admin] PATH_INFO: `/v3/projects/b442ef4dfc294123ad7435b304a0e51d/users/9ae5b4abe64b424199f61c491a13aa50/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:16.751863 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4fe267-92e3-42a7-8840-57ebacbe9fe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b442ef4dfc294123ad7435b304a0e51d, user_id=9ae5b4abe64b424199f61c491a13aa50, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:16.754641 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4fe267-92e3-42a7-8840-57ebacbe9fe2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:16.765696 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1141/2319] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:58:16 2022] PUT /identity/v3/projects/b442ef4dfc294123ad7435b304a0e51d/users/9ae5b4abe64b424199f61c491a13aa50/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:58:16.775959 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c399c-d016-49e5-9b83-ab13c8e5d7bf None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:16.776256 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c399c-d016-49e5-9b83-ab13c8e5d7bf None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:16.776536 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c399c-d016-49e5-9b83-ab13c8e5d7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:16.806142 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-022c399c-d016-49e5-9b83-ab13c8e5d7bf None None] MFA Rules not processed for user `9ae5b4abe64b424199f61c491a13aa50`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:16.807378 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-022c399c-d016-49e5-9b83-ab13c8e5d7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:16.878225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1179/2320] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:16 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:16.889690 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fe267-92e3-42a7-8840-57ebacbe9fe2 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:16.891578 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4c4fe267-92e3-42a7-8840-57ebacbe9fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:16.950362 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fe267-92e3-42a7-8840-57ebacbe9fe2 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:16.954561 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c3876-c6ff-4df1-982e-6b0e0460b50e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:16.955208 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c3876-c6ff-4df1-982e-6b0e0460b50e service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:16.955488 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c3876-c6ff-4df1-982e-6b0e0460b50e service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:16.955764 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c3876-c6ff-4df1-982e-6b0e0460b50e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:16.965027 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c3876-c6ff-4df1-982e-6b0e0460b50e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:16.966402 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c3876-c6ff-4df1-982e-6b0e0460b50e service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:16.975850 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1142/2321] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:16 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:58:18.546737 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c399c-d016-49e5-9b83-ab13c8e5d7bf None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:18.615904 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c399c-d016-49e5-9b83-ab13c8e5d7bf None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:18.621897 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f979808-0a9d-4d9c-a238-756bc0da353e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:18.622780 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f979808-0a9d-4d9c-a238-756bc0da353e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:18.623146 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f979808-0a9d-4d9c-a238-756bc0da353e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:18.623477 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f979808-0a9d-4d9c-a238-756bc0da353e admin admin] PATH_INFO: `/v3/users/fd487618fce54557bd350b6da9f246dd` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:18.624829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f979808-0a9d-4d9c-a238-756bc0da353e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd487618fce54557bd350b6da9f246dd)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:18.626904 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f979808-0a9d-4d9c-a238-756bc0da353e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:18.662397 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:18.689789 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6f979808-0a9d-4d9c-a238-756bc0da353e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd487618fce54557bd350b6da9f246dd'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:18.703459 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6f979808-0a9d-4d9c-a238-756bc0da353e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd487618fce54557bd350b6da9f246dd'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:18.704320 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6f979808-0a9d-4d9c-a238-756bc0da353e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd487618fce54557bd350b6da9f246dd'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:18.714085 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6f979808-0a9d-4d9c-a238-756bc0da353e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd487618fce54557bd350b6da9f246dd'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:18.722069 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6f979808-0a9d-4d9c-a238-756bc0da353e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd487618fce54557bd350b6da9f246dd'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:18.728575 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1180/2322] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:58:18 2022] DELETE /identity/v3/users/fd487618fce54557bd350b6da9f246dd => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:18.735984 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba66624-fff9-4d43-a889-2784af8cc4f6 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:18.736490 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba66624-fff9-4d43-a889-2784af8cc4f6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:18.736592 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba66624-fff9-4d43-a889-2784af8cc4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:18.759564 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-eba66624-fff9-4d43-a889-2784af8cc4f6 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:18.760765 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-eba66624-fff9-4d43-a889-2784af8cc4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:18.824869 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1143/2323] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:18.839360 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f979808-0a9d-4d9c-a238-756bc0da353e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:18.841960 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6f979808-0a9d-4d9c-a238-756bc0da353e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:18.901740 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f979808-0a9d-4d9c-a238-756bc0da353e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:18.905828 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0280399-3687-4a3f-b303-b089348ac70e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:18.906453 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0280399-3687-4a3f-b303-b089348ac70e service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:18.906767 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0280399-3687-4a3f-b303-b089348ac70e service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:18.907013 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0280399-3687-4a3f-b303-b089348ac70e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:18.917122 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0280399-3687-4a3f-b303-b089348ac70e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:18.918909 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0280399-3687-4a3f-b303-b089348ac70e service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:18.930235 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1181/2324] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:58:19.302716 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba66624-fff9-4d43-a889-2784af8cc4f6 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:19.304544 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-eba66624-fff9-4d43-a889-2784af8cc4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:19.335350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba66624-fff9-4d43-a889-2784af8cc4f6 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:19.340891 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea509b72-e268-4796-ba1d-b03c73923e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:19.341790 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea509b72-e268-4796-ba1d-b03c73923e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:19.342632 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea509b72-e268-4796-ba1d-b03c73923e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:19.342918 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea509b72-e268-4796-ba1d-b03c73923e80 admin admin] PATH_INFO: `/v3/projects/e5bca35c837c49e5935aa0ea655cbae5` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:19.344171 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea509b72-e268-4796-ba1d-b03c73923e80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5bca35c837c49e5935aa0ea655cbae5)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:19.346078 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea509b72-e268-4796-ba1d-b03c73923e80 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:19.405467 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ea509b72-e268-4796-ba1d-b03c73923e80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5bca35c837c49e5935aa0ea655cbae5', 'request_id': 'req-ea509b72-e268-4796-ba1d-b03c73923e80'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:19.412088 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ea509b72-e268-4796-ba1d-b03c73923e80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5bca35c837c49e5935aa0ea655cbae5', 'request_id': 'req-ea509b72-e268-4796-ba1d-b03c73923e80'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:19.413278 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:19.418858 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ea509b72-e268-4796-ba1d-b03c73923e80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5bca35c837c49e5935aa0ea655cbae5', 'request_id': 'req-ea509b72-e268-4796-ba1d-b03c73923e80'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:19.432380 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ea509b72-e268-4796-ba1d-b03c73923e80 admin admin] The token cache is being invalidate because project e5bca35c837c49e5935aa0ea655cbae5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:58:19.432666 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ea509b72-e268-4796-ba1d-b03c73923e80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:19.433311 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ea509b72-e268-4796-ba1d-b03c73923e80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:19.434895 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1144/2325] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:58:19 2022] DELETE /identity/v3/projects/e5bca35c837c49e5935aa0ea655cbae5 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:19.439491 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0280399-3687-4a3f-b303-b089348ac70e service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:19.450731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0280399-3687-4a3f-b303-b089348ac70e service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:19.521728 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca3d66-be7a-466b-a080-c184a3e92126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:19.522547 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca3d66-be7a-466b-a080-c184a3e92126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:19.522883 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca3d66-be7a-466b-a080-c184a3e92126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:19.523164 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca3d66-be7a-466b-a080-c184a3e92126 admin admin] PATH_INFO: `/v3/users/9ae5b4abe64b424199f61c491a13aa50` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:19.524898 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca3d66-be7a-466b-a080-c184a3e92126 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ae5b4abe64b424199f61c491a13aa50)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:19.527840 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca3d66-be7a-466b-a080-c184a3e92126 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:19.577453 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:19.579559 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5fca3d66-be7a-466b-a080-c184a3e92126 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ae5b4abe64b424199f61c491a13aa50'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:19.592541 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5fca3d66-be7a-466b-a080-c184a3e92126 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ae5b4abe64b424199f61c491a13aa50'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:19.593217 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5fca3d66-be7a-466b-a080-c184a3e92126 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ae5b4abe64b424199f61c491a13aa50'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:19.601532 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5fca3d66-be7a-466b-a080-c184a3e92126 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ae5b4abe64b424199f61c491a13aa50'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:19.608761 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5fca3d66-be7a-466b-a080-c184a3e92126 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ae5b4abe64b424199f61c491a13aa50'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:19.615184 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1182/2326] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:58:19 2022] DELETE /identity/v3/users/9ae5b4abe64b424199f61c491a13aa50 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:19.907633 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea509b72-e268-4796-ba1d-b03c73923e80 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:19.909144 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ea509b72-e268-4796-ba1d-b03c73923e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:19.923223 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea509b72-e268-4796-ba1d-b03c73923e80 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:19.987172 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3be57-d419-425a-a5a7-d88323e608b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:19.988087 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3be57-d419-425a-a5a7-d88323e608b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:19.988370 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3be57-d419-425a-a5a7-d88323e608b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:19.988646 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3be57-d419-425a-a5a7-d88323e608b7 admin admin] PATH_INFO: `/v3/projects/b442ef4dfc294123ad7435b304a0e51d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:19.989877 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3be57-d419-425a-a5a7-d88323e608b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b442ef4dfc294123ad7435b304a0e51d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:19.991832 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3be57-d419-425a-a5a7-d88323e608b7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:20.043033 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0cf3be57-d419-425a-a5a7-d88323e608b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b442ef4dfc294123ad7435b304a0e51d', 'request_id': 'req-0cf3be57-d419-425a-a5a7-d88323e608b7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:20.049907 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0cf3be57-d419-425a-a5a7-d88323e608b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b442ef4dfc294123ad7435b304a0e51d', 'request_id': 'req-0cf3be57-d419-425a-a5a7-d88323e608b7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:20.055887 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0cf3be57-d419-425a-a5a7-d88323e608b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b442ef4dfc294123ad7435b304a0e51d', 'request_id': 'req-0cf3be57-d419-425a-a5a7-d88323e608b7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:20.074639 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0cf3be57-d419-425a-a5a7-d88323e608b7 admin admin] The token cache is being invalidate because project b442ef4dfc294123ad7435b304a0e51d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:58:20.074929 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0cf3be57-d419-425a-a5a7-d88323e608b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:20.075676 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0cf3be57-d419-425a-a5a7-d88323e608b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:20.077488 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1145/2327] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:58:19 2022] DELETE /identity/v3/projects/b442ef4dfc294123ad7435b304a0e51d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:20.082452 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4255a9-030f-4897-8015-4df82742a654 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:20.082756 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4255a9-030f-4897-8015-4df82742a654 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:20.083044 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4255a9-030f-4897-8015-4df82742a654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:20.102677 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-7a4255a9-030f-4897-8015-4df82742a654 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:20.103930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7a4255a9-030f-4897-8015-4df82742a654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:20.178599 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1183/2328] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:20.186646 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424067b-41b3-4a0f-95e7-295e1e4970f2 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:20.187000 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424067b-41b3-4a0f-95e7-295e1e4970f2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:20.187367 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424067b-41b3-4a0f-95e7-295e1e4970f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:20.208751 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-2424067b-41b3-4a0f-95e7-295e1e4970f2 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:20.210070 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2424067b-41b3-4a0f-95e7-295e1e4970f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:20.219227 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1146/2329] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:20.223679 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4255a9-030f-4897-8015-4df82742a654 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:20.234255 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4255a9-030f-4897-8015-4df82742a654 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:20.238776 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66292b6-1673-4424-9019-fe46fa29196f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:20.239458 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66292b6-1673-4424-9019-fe46fa29196f admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:20.239757 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66292b6-1673-4424-9019-fe46fa29196f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:20.240067 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66292b6-1673-4424-9019-fe46fa29196f admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:20.240803 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66292b6-1673-4424-9019-fe46fa29196f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:58:20.241108 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66292b6-1673-4424-9019-fe46fa29196f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:20.242805 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66292b6-1673-4424-9019-fe46fa29196f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:20.255669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1184/2330] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:58:20.260142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424067b-41b3-4a0f-95e7-295e1e4970f2 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:20.269624 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424067b-41b3-4a0f-95e7-295e1e4970f2 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:20.274658 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5963a4-bf9b-490f-9920-4e65dc93061e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:20.275386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5963a4-bf9b-490f-9920-4e65dc93061e admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:20.275770 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5963a4-bf9b-490f-9920-4e65dc93061e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:20.276083 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5963a4-bf9b-490f-9920-4e65dc93061e admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:20.276790 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5963a4-bf9b-490f-9920-4e65dc93061e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:20.278704 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5963a4-bf9b-490f-9920-4e65dc93061e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:20.310703 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1147/2331] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:58:20 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:58:20.312818 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66292b6-1673-4424-9019-fe46fa29196f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:20.328426 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66292b6-1673-4424-9019-fe46fa29196f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:20.402585 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d786b-1d3c-4ee0-bb32-797e43c79a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:20.403277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d786b-1d3c-4ee0-bb32-797e43c79a5e admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:20.403592 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d786b-1d3c-4ee0-bb32-797e43c79a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:20.403889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d786b-1d3c-4ee0-bb32-797e43c79a5e admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:20.404690 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d786b-1d3c-4ee0-bb32-797e43c79a5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:20.406622 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d786b-1d3c-4ee0-bb32-797e43c79a5e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:20.429137 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1185/2332] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:58:20 2022] POST /identity/v3/users => generated 294 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:58:20.433490 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5963a4-bf9b-490f-9920-4e65dc93061e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:20.444344 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5963a4-bf9b-490f-9920-4e65dc93061e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:20.449615 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7b0a6-15cd-4d74-a10b-5b3da97b013c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:20.450319 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7b0a6-15cd-4d74-a10b-5b3da97b013c admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:20.450606 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7b0a6-15cd-4d74-a10b-5b3da97b013c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:20.450886 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7b0a6-15cd-4d74-a10b-5b3da97b013c admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:20.451681 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee7b0a6-15cd-4d74-a10b-5b3da97b013c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:20.453382 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee7b0a6-15cd-4d74-a10b-5b3da97b013c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:20.464396 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1148/2333] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:58:20.468595 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d786b-1d3c-4ee0-bb32-797e43c79a5e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:20.479899 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d786b-1d3c-4ee0-bb32-797e43c79a5e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:20.485623 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760102c-c5ec-486f-8f1b-4be111ad6a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:20.486313 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760102c-c5ec-486f-8f1b-4be111ad6a46 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:20.486623 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760102c-c5ec-486f-8f1b-4be111ad6a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:20.486888 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760102c-c5ec-486f-8f1b-4be111ad6a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:20.487767 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1760102c-c5ec-486f-8f1b-4be111ad6a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:20.489516 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1760102c-c5ec-486f-8f1b-4be111ad6a46 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:20.509717 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1186/2334] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:58:20.511130 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7b0a6-15cd-4d74-a10b-5b3da97b013c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:20.527581 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7b0a6-15cd-4d74-a10b-5b3da97b013c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:20.532714 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a67e40-4467-43d0-90df-5c43392bae05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:20.533620 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a67e40-4467-43d0-90df-5c43392bae05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:20.533906 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a67e40-4467-43d0-90df-5c43392bae05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:20.534211 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a67e40-4467-43d0-90df-5c43392bae05 admin admin] PATH_INFO: `/v3/projects/61bdfa8a509f43419ee815842e1b01f8/users/9dfe9ff9cf0e4865a65319e6e945982d/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:20.550027 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a67e40-4467-43d0-90df-5c43392bae05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61bdfa8a509f43419ee815842e1b01f8, user_id=9dfe9ff9cf0e4865a65319e6e945982d, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:20.552683 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a67e40-4467-43d0-90df-5c43392bae05 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:20.567320 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1149/2335] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:58:20 2022] PUT /identity/v3/projects/61bdfa8a509f43419ee815842e1b01f8/users/9dfe9ff9cf0e4865a65319e6e945982d/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:20.578659 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55333224-113f-47ae-8537-8cfc621bb6a2 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:20.579114 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55333224-113f-47ae-8537-8cfc621bb6a2 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:20.579212 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55333224-113f-47ae-8537-8cfc621bb6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:20.607218 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-55333224-113f-47ae-8537-8cfc621bb6a2 None None] MFA Rules not processed for user `9dfe9ff9cf0e4865a65319e6e945982d`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:20.608559 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-55333224-113f-47ae-8537-8cfc621bb6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:20.626699 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:20.687190 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1187/2336] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:20.692145 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a67e40-4467-43d0-90df-5c43392bae05 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:20.704079 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:20.776548 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a67e40-4467-43d0-90df-5c43392bae05 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:20.782581 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49fe7f-6304-4891-a08f-aec36ebba320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:20.783250 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49fe7f-6304-4891-a08f-aec36ebba320 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:20.783529 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49fe7f-6304-4891-a08f-aec36ebba320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:20.783807 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49fe7f-6304-4891-a08f-aec36ebba320 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:20.784558 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49fe7f-6304-4891-a08f-aec36ebba320 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:20.786811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49fe7f-6304-4891-a08f-aec36ebba320 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:20.813634 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1150/2337] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:58:20 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:58:20.817725 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55333224-113f-47ae-8537-8cfc621bb6a2 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:20.828672 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55333224-113f-47ae-8537-8cfc621bb6a2 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:20.899104 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf78dbe-b791-4098-946e-307855056b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:20.899917 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf78dbe-b791-4098-946e-307855056b0f admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:20.900203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf78dbe-b791-4098-946e-307855056b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:20.900484 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf78dbe-b791-4098-946e-307855056b0f admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:20.901194 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf78dbe-b791-4098-946e-307855056b0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:20.903552 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf78dbe-b791-4098-946e-307855056b0f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:20.925103 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1188/2338] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:58:20 2022] POST /identity/v3/users => generated 300 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:58:20.929333 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49fe7f-6304-4891-a08f-aec36ebba320 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:20.940200 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49fe7f-6304-4891-a08f-aec36ebba320 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:20.944856 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6c7a3-622c-4323-a8df-20e1909326d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:20.945531 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6c7a3-622c-4323-a8df-20e1909326d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:20.945815 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6c7a3-622c-4323-a8df-20e1909326d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:20.946095 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6c7a3-622c-4323-a8df-20e1909326d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:20.946828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6c7a3-622c-4323-a8df-20e1909326d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:20.948811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6c7a3-622c-4323-a8df-20e1909326d2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:20.961863 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1151/2339] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:58:20.966220 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf78dbe-b791-4098-946e-307855056b0f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:20.978394 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf78dbe-b791-4098-946e-307855056b0f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:20.983344 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e8b94-ac65-4c07-a5cc-a0a927e3587d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:20.984438 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e8b94-ac65-4c07-a5cc-a0a927e3587d admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:20.984868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e8b94-ac65-4c07-a5cc-a0a927e3587d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:20.985094 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e8b94-ac65-4c07-a5cc-a0a927e3587d admin admin] PATH_INFO: `/v3/projects/0323aa0eabaa4ffd866c96099e90862b/users/af3359e5f66747aebc5dc0ae6dab7240/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:21.003530 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e8b94-ac65-4c07-a5cc-a0a927e3587d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0323aa0eabaa4ffd866c96099e90862b, user_id=af3359e5f66747aebc5dc0ae6dab7240, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:21.006389 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e8b94-ac65-4c07-a5cc-a0a927e3587d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:21.021945 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1189/2340] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:58:20 2022] PUT /identity/v3/projects/0323aa0eabaa4ffd866c96099e90862b/users/af3359e5f66747aebc5dc0ae6dab7240/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:21.025701 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6c7a3-622c-4323-a8df-20e1909326d2 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:21.041591 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6c7a3-622c-4323-a8df-20e1909326d2 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:21.129714 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0912c-031f-4ce4-8a9d-6f5ad5aa8920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:21.130504 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0912c-031f-4ce4-8a9d-6f5ad5aa8920 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:21.130839 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0912c-031f-4ce4-8a9d-6f5ad5aa8920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:21.131176 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0912c-031f-4ce4-8a9d-6f5ad5aa8920 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:21.132050 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0912c-031f-4ce4-8a9d-6f5ad5aa8920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:21.133723 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0912c-031f-4ce4-8a9d-6f5ad5aa8920 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:21.145414 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1152/2341] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:58:21.151316 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e8b94-ac65-4c07-a5cc-a0a927e3587d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:21.169201 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e8b94-ac65-4c07-a5cc-a0a927e3587d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:21.174776 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f785aee-4d71-44cc-ab4f-f29e31ccb31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:21.175752 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f785aee-4d71-44cc-ab4f-f29e31ccb31f admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:21.176051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f785aee-4d71-44cc-ab4f-f29e31ccb31f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:21.176365 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f785aee-4d71-44cc-ab4f-f29e31ccb31f admin admin] PATH_INFO: `/v3/projects/0323aa0eabaa4ffd866c96099e90862b/users/af3359e5f66747aebc5dc0ae6dab7240/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:21.179383 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f785aee-4d71-44cc-ab4f-f29e31ccb31f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0323aa0eabaa4ffd866c96099e90862b, user_id=af3359e5f66747aebc5dc0ae6dab7240, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:21.182059 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f785aee-4d71-44cc-ab4f-f29e31ccb31f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:21.196935 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1190/2342] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:58:21 2022] PUT /identity/v3/projects/0323aa0eabaa4ffd866c96099e90862b/users/af3359e5f66747aebc5dc0ae6dab7240/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:21.207481 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cef4b8-71f7-489c-a01c-7545a36e4ebb None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:21.207768 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cef4b8-71f7-489c-a01c-7545a36e4ebb None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:21.208071 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cef4b8-71f7-489c-a01c-7545a36e4ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:21.237299 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f1cef4b8-71f7-489c-a01c-7545a36e4ebb None None] MFA Rules not processed for user `af3359e5f66747aebc5dc0ae6dab7240`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:21.238518 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f1cef4b8-71f7-489c-a01c-7545a36e4ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:21.314709 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1153/2343] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:21.327332 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f785aee-4d71-44cc-ab4f-f29e31ccb31f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:21.329811 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6f785aee-4d71-44cc-ab4f-f29e31ccb31f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:21.409640 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f785aee-4d71-44cc-ab4f-f29e31ccb31f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:21.413810 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8f999-ae13-430e-bb7c-e65c14caafb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:21.414463 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8f999-ae13-430e-bb7c-e65c14caafb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:21.414744 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8f999-ae13-430e-bb7c-e65c14caafb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:21.415019 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8f999-ae13-430e-bb7c-e65c14caafb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:21.426930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d8f999-ae13-430e-bb7c-e65c14caafb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:21.428611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d8f999-ae13-430e-bb7c-e65c14caafb2 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:21.440868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1191/2344] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:58:21.505542 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cef4b8-71f7-489c-a01c-7545a36e4ebb None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:21.511000 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:21.572562 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cef4b8-71f7-489c-a01c-7545a36e4ebb None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:21.577268 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d1a00-fe4a-4d27-98da-73ae2a80e287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:21.578163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d1a00-fe4a-4d27-98da-73ae2a80e287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:21.578446 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d1a00-fe4a-4d27-98da-73ae2a80e287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:21.578725 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d1a00-fe4a-4d27-98da-73ae2a80e287 admin admin] PATH_INFO: `/v3/users/9dfe9ff9cf0e4865a65319e6e945982d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:21.579988 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d1a00-fe4a-4d27-98da-73ae2a80e287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dfe9ff9cf0e4865a65319e6e945982d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:21.581923 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d1a00-fe4a-4d27-98da-73ae2a80e287 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:21.633081 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4d1d1a00-fe4a-4d27-98da-73ae2a80e287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dfe9ff9cf0e4865a65319e6e945982d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:21.640793 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4d1d1a00-fe4a-4d27-98da-73ae2a80e287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dfe9ff9cf0e4865a65319e6e945982d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:21.649163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4d1d1a00-fe4a-4d27-98da-73ae2a80e287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dfe9ff9cf0e4865a65319e6e945982d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:21.661610 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4d1d1a00-fe4a-4d27-98da-73ae2a80e287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dfe9ff9cf0e4865a65319e6e945982d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:21.662354 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4d1d1a00-fe4a-4d27-98da-73ae2a80e287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dfe9ff9cf0e4865a65319e6e945982d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:21.668861 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1154/2345] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:58:21 2022] DELETE /identity/v3/users/9dfe9ff9cf0e4865a65319e6e945982d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:21.673768 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a90016-f1a6-43d7-bfa1-823c2c4bfb8b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:21.674234 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a90016-f1a6-43d7-bfa1-823c2c4bfb8b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:21.674325 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a90016-f1a6-43d7-bfa1-823c2c4bfb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:21.703191 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d5a90016-f1a6-43d7-bfa1-823c2c4bfb8b None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:21.705053 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d5a90016-f1a6-43d7-bfa1-823c2c4bfb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:21.717916 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:21.781988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1192/2346] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:21.789854 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d1a00-fe4a-4d27-98da-73ae2a80e287 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:21.791973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4d1d1a00-fe4a-4d27-98da-73ae2a80e287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:21.886273 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d1a00-fe4a-4d27-98da-73ae2a80e287 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:21.890171 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921b9da-27e9-4666-87ec-5285e89a66ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:21.890866 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921b9da-27e9-4666-87ec-5285e89a66ba service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:21.891124 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921b9da-27e9-4666-87ec-5285e89a66ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:21.891443 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921b9da-27e9-4666-87ec-5285e89a66ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:21.902421 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921b9da-27e9-4666-87ec-5285e89a66ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:21.904345 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921b9da-27e9-4666-87ec-5285e89a66ba service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:21.915766 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1155/2347] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:58:22.192129 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a90016-f1a6-43d7-bfa1-823c2c4bfb8b None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:22.193567 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d5a90016-f1a6-43d7-bfa1-823c2c4bfb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:22.210064 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a90016-f1a6-43d7-bfa1-823c2c4bfb8b None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:22.215642 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637279e7-d3a6-4a89-887e-88323705fcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:22.216676 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637279e7-d3a6-4a89-887e-88323705fcaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:22.216953 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637279e7-d3a6-4a89-887e-88323705fcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:22.217808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637279e7-d3a6-4a89-887e-88323705fcaa admin admin] PATH_INFO: `/v3/projects/61bdfa8a509f43419ee815842e1b01f8` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:22.218813 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637279e7-d3a6-4a89-887e-88323705fcaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=61bdfa8a509f43419ee815842e1b01f8)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:22.223536 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637279e7-d3a6-4a89-887e-88323705fcaa admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:22.270615 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-637279e7-d3a6-4a89-887e-88323705fcaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61bdfa8a509f43419ee815842e1b01f8', 'request_id': 'req-637279e7-d3a6-4a89-887e-88323705fcaa'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:22.276825 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-637279e7-d3a6-4a89-887e-88323705fcaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61bdfa8a509f43419ee815842e1b01f8', 'request_id': 'req-637279e7-d3a6-4a89-887e-88323705fcaa'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:22.284014 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-637279e7-d3a6-4a89-887e-88323705fcaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61bdfa8a509f43419ee815842e1b01f8', 'request_id': 'req-637279e7-d3a6-4a89-887e-88323705fcaa'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:22.299046 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-637279e7-d3a6-4a89-887e-88323705fcaa admin admin] The token cache is being invalidate because project 61bdfa8a509f43419ee815842e1b01f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:58:22.299331 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-637279e7-d3a6-4a89-887e-88323705fcaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:22.299992 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-637279e7-d3a6-4a89-887e-88323705fcaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:22.301690 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1193/2348] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:58:22 2022] DELETE /identity/v3/projects/61bdfa8a509f43419ee815842e1b01f8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:22.306004 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921b9da-27e9-4666-87ec-5285e89a66ba service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:22.316517 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921b9da-27e9-4666-87ec-5285e89a66ba service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:22.340021 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:22.377698 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4bdac-dd00-428b-a8f9-8186588fdfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:22.378502 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4bdac-dd00-428b-a8f9-8186588fdfd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:22.378779 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4bdac-dd00-428b-a8f9-8186588fdfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:22.379053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4bdac-dd00-428b-a8f9-8186588fdfd7 admin admin] PATH_INFO: `/v3/users/af3359e5f66747aebc5dc0ae6dab7240` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:22.380272 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc4bdac-dd00-428b-a8f9-8186588fdfd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af3359e5f66747aebc5dc0ae6dab7240)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:22.382207 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc4bdac-dd00-428b-a8f9-8186588fdfd7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:22.433877 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9cc4bdac-dd00-428b-a8f9-8186588fdfd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af3359e5f66747aebc5dc0ae6dab7240'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:22.441661 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9cc4bdac-dd00-428b-a8f9-8186588fdfd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af3359e5f66747aebc5dc0ae6dab7240'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:22.451462 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9cc4bdac-dd00-428b-a8f9-8186588fdfd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af3359e5f66747aebc5dc0ae6dab7240'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:22.464551 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9cc4bdac-dd00-428b-a8f9-8186588fdfd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af3359e5f66747aebc5dc0ae6dab7240'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:22.465297 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9cc4bdac-dd00-428b-a8f9-8186588fdfd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af3359e5f66747aebc5dc0ae6dab7240'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:22.472114 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1156/2349] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:58:22 2022] DELETE /identity/v3/users/af3359e5f66747aebc5dc0ae6dab7240 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:22.848932 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637279e7-d3a6-4a89-887e-88323705fcaa admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:22.850618 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-637279e7-d3a6-4a89-887e-88323705fcaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:22.869728 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637279e7-d3a6-4a89-887e-88323705fcaa admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:22.949972 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e601b25-7d04-433d-8e89-36de37e73d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:22.950255 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e601b25-7d04-433d-8e89-36de37e73d07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:22.950612 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e601b25-7d04-433d-8e89-36de37e73d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:22.950954 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e601b25-7d04-433d-8e89-36de37e73d07 admin admin] PATH_INFO: `/v3/projects/0323aa0eabaa4ffd866c96099e90862b` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:22.952843 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e601b25-7d04-433d-8e89-36de37e73d07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0323aa0eabaa4ffd866c96099e90862b)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:22.956850 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e601b25-7d04-433d-8e89-36de37e73d07 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:23.013568 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:23.024053 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6e601b25-7d04-433d-8e89-36de37e73d07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0323aa0eabaa4ffd866c96099e90862b', 'request_id': 'req-6e601b25-7d04-433d-8e89-36de37e73d07'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:23.035383 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6e601b25-7d04-433d-8e89-36de37e73d07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0323aa0eabaa4ffd866c96099e90862b', 'request_id': 'req-6e601b25-7d04-433d-8e89-36de37e73d07'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:23.049214 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6e601b25-7d04-433d-8e89-36de37e73d07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0323aa0eabaa4ffd866c96099e90862b', 'request_id': 'req-6e601b25-7d04-433d-8e89-36de37e73d07'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:23.077314 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6e601b25-7d04-433d-8e89-36de37e73d07 admin admin] The token cache is being invalidate because project 0323aa0eabaa4ffd866c96099e90862b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:58:23.077925 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6e601b25-7d04-433d-8e89-36de37e73d07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:23.078811 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6e601b25-7d04-433d-8e89-36de37e73d07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:23.080631 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1194/2350] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:58:22 2022] DELETE /identity/v3/projects/0323aa0eabaa4ffd866c96099e90862b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:23.090201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2166f-b581-48a2-81cd-26be7c8419d8 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:23.090924 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2166f-b581-48a2-81cd-26be7c8419d8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:23.091282 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2166f-b581-48a2-81cd-26be7c8419d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:23.111092 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5ae2166f-b581-48a2-81cd-26be7c8419d8 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:23.112392 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5ae2166f-b581-48a2-81cd-26be7c8419d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:23.176287 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1157/2351] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:58:23.185194 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b51e21-1e5f-4616-8c19-26a8f374b38f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:23.185693 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b51e21-1e5f-4616-8c19-26a8f374b38f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:23.186039 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b51e21-1e5f-4616-8c19-26a8f374b38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:23.205239 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-04b51e21-1e5f-4616-8c19-26a8f374b38f None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:23.206439 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-04b51e21-1e5f-4616-8c19-26a8f374b38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:23.215405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1195/2352] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:23.222127 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2166f-b581-48a2-81cd-26be7c8419d8 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:23.233084 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2166f-b581-48a2-81cd-26be7c8419d8 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:23.238399 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2eb92-47e6-4007-b829-754cb242e64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:23.239009 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2eb92-47e6-4007-b829-754cb242e64f admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:23.239318 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2eb92-47e6-4007-b829-754cb242e64f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:23.239599 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2eb92-47e6-4007-b829-754cb242e64f admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:23.240347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2eb92-47e6-4007-b829-754cb242e64f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:58:23.240654 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2eb92-47e6-4007-b829-754cb242e64f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:23.242253 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2eb92-47e6-4007-b829-754cb242e64f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:23.254199 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1158/2353] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:58:23.259054 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b51e21-1e5f-4616-8c19-26a8f374b38f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:23.276258 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b51e21-1e5f-4616-8c19-26a8f374b38f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:23.286638 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443e2fc-beaf-44cf-9ae9-fc4f76c54332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:23.287647 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443e2fc-beaf-44cf-9ae9-fc4f76c54332 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:23.287968 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443e2fc-beaf-44cf-9ae9-fc4f76c54332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:23.288405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443e2fc-beaf-44cf-9ae9-fc4f76c54332 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:23.289404 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443e2fc-beaf-44cf-9ae9-fc4f76c54332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:23.292532 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443e2fc-beaf-44cf-9ae9-fc4f76c54332 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:23.335440 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1196/2354] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:58:23 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:58:23.341444 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2eb92-47e6-4007-b829-754cb242e64f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:23.354649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2eb92-47e6-4007-b829-754cb242e64f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:23.391253 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:23.428084 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976abc01-3700-4846-ad39-5cce729790af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:23.429007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976abc01-3700-4846-ad39-5cce729790af admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:23.429392 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976abc01-3700-4846-ad39-5cce729790af admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:23.429846 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976abc01-3700-4846-ad39-5cce729790af admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:23.430886 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976abc01-3700-4846-ad39-5cce729790af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:23.434059 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976abc01-3700-4846-ad39-5cce729790af admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:23.463754 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1159/2355] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:58:23 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:58:23.469733 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443e2fc-beaf-44cf-9ae9-fc4f76c54332 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:23.485109 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443e2fc-beaf-44cf-9ae9-fc4f76c54332 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:23.490916 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7362d47-89d9-49e2-919c-e3bbfad86ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:23.491586 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7362d47-89d9-49e2-919c-e3bbfad86ffd admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:23.491897 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7362d47-89d9-49e2-919c-e3bbfad86ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:23.492178 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7362d47-89d9-49e2-919c-e3bbfad86ffd admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:23.492902 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7362d47-89d9-49e2-919c-e3bbfad86ffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:23.494549 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7362d47-89d9-49e2-919c-e3bbfad86ffd admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:23.507782 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1197/2356] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:58:23.512084 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976abc01-3700-4846-ad39-5cce729790af admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:23.522679 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976abc01-3700-4846-ad39-5cce729790af admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:23.527746 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ae72b-e005-47a6-8cbb-8c2dee39e490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:23.528443 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ae72b-e005-47a6-8cbb-8c2dee39e490 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:23.528721 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ae72b-e005-47a6-8cbb-8c2dee39e490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:23.529003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ae72b-e005-47a6-8cbb-8c2dee39e490 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:23.529738 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ae72b-e005-47a6-8cbb-8c2dee39e490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:23.531362 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ae72b-e005-47a6-8cbb-8c2dee39e490 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:23.542110 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1160/2357] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:58:23.546788 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7362d47-89d9-49e2-919c-e3bbfad86ffd admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:23.557096 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7362d47-89d9-49e2-919c-e3bbfad86ffd admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:23.562869 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391e33b-59a4-4f31-b44e-7cef5ccef666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:23.563791 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391e33b-59a4-4f31-b44e-7cef5ccef666 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:23.564100 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391e33b-59a4-4f31-b44e-7cef5ccef666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:23.564374 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391e33b-59a4-4f31-b44e-7cef5ccef666 admin admin] PATH_INFO: `/v3/projects/303b084ae7a84c4cbc7b5d7be10928bb/users/e8546a3d3b8042fa9a604daa7996decb/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:23.580868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391e33b-59a4-4f31-b44e-7cef5ccef666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=303b084ae7a84c4cbc7b5d7be10928bb, user_id=e8546a3d3b8042fa9a604daa7996decb, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:23.583641 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391e33b-59a4-4f31-b44e-7cef5ccef666 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:23.603797 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1198/2358] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:58:23 2022] PUT /identity/v3/projects/303b084ae7a84c4cbc7b5d7be10928bb/users/e8546a3d3b8042fa9a604daa7996decb/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:23.615642 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359743f-0a6e-435c-aa26-3498e5f49436 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:23.615970 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359743f-0a6e-435c-aa26-3498e5f49436 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:23.616252 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359743f-0a6e-435c-aa26-3498e5f49436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:23.643573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-7359743f-0a6e-435c-aa26-3498e5f49436 None None] MFA Rules not processed for user `e8546a3d3b8042fa9a604daa7996decb`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:23.644916 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7359743f-0a6e-435c-aa26-3498e5f49436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:23.721975 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1161/2359] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:23.736364 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391e33b-59a4-4f31-b44e-7cef5ccef666 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:23.738203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4391e33b-59a4-4f31-b44e-7cef5ccef666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:23.805050 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391e33b-59a4-4f31-b44e-7cef5ccef666 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:23.809256 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dec343-3b78-4fcd-aacc-ee083364decf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:23.809890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dec343-3b78-4fcd-aacc-ee083364decf service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:23.810177 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dec343-3b78-4fcd-aacc-ee083364decf service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:23.810557 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dec343-3b78-4fcd-aacc-ee083364decf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:23.820092 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dec343-3b78-4fcd-aacc-ee083364decf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:23.821530 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dec343-3b78-4fcd-aacc-ee083364decf service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:23.831285 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1199/2360] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:58:27.461186 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359743f-0a6e-435c-aa26-3498e5f49436 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:27.531974 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359743f-0a6e-435c-aa26-3498e5f49436 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:27.536989 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe681a0-df3d-41db-8a1e-4d0450d3896e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:27.537883 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe681a0-df3d-41db-8a1e-4d0450d3896e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:27.538168 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe681a0-df3d-41db-8a1e-4d0450d3896e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:27.538441 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe681a0-df3d-41db-8a1e-4d0450d3896e admin admin] PATH_INFO: `/v3/users/e8546a3d3b8042fa9a604daa7996decb` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:27.539634 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe681a0-df3d-41db-8a1e-4d0450d3896e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8546a3d3b8042fa9a604daa7996decb)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:27.541607 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe681a0-df3d-41db-8a1e-4d0450d3896e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:27.592149 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:27.595444 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-bfe681a0-df3d-41db-8a1e-4d0450d3896e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8546a3d3b8042fa9a604daa7996decb'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:27.605221 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-bfe681a0-df3d-41db-8a1e-4d0450d3896e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8546a3d3b8042fa9a604daa7996decb'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:27.613885 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-bfe681a0-df3d-41db-8a1e-4d0450d3896e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8546a3d3b8042fa9a604daa7996decb'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:27.625717 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-bfe681a0-df3d-41db-8a1e-4d0450d3896e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8546a3d3b8042fa9a604daa7996decb'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:27.626350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-bfe681a0-df3d-41db-8a1e-4d0450d3896e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8546a3d3b8042fa9a604daa7996decb'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:27.632423 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1162/2361] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:58:27 2022] DELETE /identity/v3/users/e8546a3d3b8042fa9a604daa7996decb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:27.637185 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cddbd-b5b7-4026-9b51-11afa126ee45 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:27.637674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cddbd-b5b7-4026-9b51-11afa126ee45 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:27.637767 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cddbd-b5b7-4026-9b51-11afa126ee45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:27.657971 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-999cddbd-b5b7-4026-9b51-11afa126ee45 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:27.659739 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-999cddbd-b5b7-4026-9b51-11afa126ee45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:27.744262 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1200/2362] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:27.754983 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe681a0-df3d-41db-8a1e-4d0450d3896e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:27.756624 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-bfe681a0-df3d-41db-8a1e-4d0450d3896e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:27.823971 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe681a0-df3d-41db-8a1e-4d0450d3896e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:27.827653 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0f77d-9949-45ef-852f-7f739c3229cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:27.828365 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0f77d-9949-45ef-852f-7f739c3229cc service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:27.828658 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0f77d-9949-45ef-852f-7f739c3229cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:27.828944 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0f77d-9949-45ef-852f-7f739c3229cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:27.839778 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0f77d-9949-45ef-852f-7f739c3229cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:27.841258 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0f77d-9949-45ef-852f-7f739c3229cc service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:27.850867 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1163/2363] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:58:28.155356 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cddbd-b5b7-4026-9b51-11afa126ee45 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:28.158665 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-999cddbd-b5b7-4026-9b51-11afa126ee45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:28.182527 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cddbd-b5b7-4026-9b51-11afa126ee45 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:28.189823 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f51d3c-5726-4c65-ab86-97ff020609d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:28.191286 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f51d3c-5726-4c65-ab86-97ff020609d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:28.191750 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f51d3c-5726-4c65-ab86-97ff020609d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:28.192249 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f51d3c-5726-4c65-ab86-97ff020609d2 admin admin] PATH_INFO: `/v3/projects/303b084ae7a84c4cbc7b5d7be10928bb` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:28.194169 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f51d3c-5726-4c65-ab86-97ff020609d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=303b084ae7a84c4cbc7b5d7be10928bb)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:28.197655 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f51d3c-5726-4c65-ab86-97ff020609d2 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:28.200251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:28.267373 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e6f51d3c-5726-4c65-ab86-97ff020609d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '303b084ae7a84c4cbc7b5d7be10928bb', 'request_id': 'req-e6f51d3c-5726-4c65-ab86-97ff020609d2'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:28.273644 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e6f51d3c-5726-4c65-ab86-97ff020609d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '303b084ae7a84c4cbc7b5d7be10928bb', 'request_id': 'req-e6f51d3c-5726-4c65-ab86-97ff020609d2'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:28.280113 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e6f51d3c-5726-4c65-ab86-97ff020609d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '303b084ae7a84c4cbc7b5d7be10928bb', 'request_id': 'req-e6f51d3c-5726-4c65-ab86-97ff020609d2'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:28.295581 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e6f51d3c-5726-4c65-ab86-97ff020609d2 admin admin] The token cache is being invalidate because project 303b084ae7a84c4cbc7b5d7be10928bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:58:28.295913 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e6f51d3c-5726-4c65-ab86-97ff020609d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:28.296559 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-e6f51d3c-5726-4c65-ab86-97ff020609d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:28.298226 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1201/2364] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:58:28 2022] DELETE /identity/v3/projects/303b084ae7a84c4cbc7b5d7be10928bb => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:58:28.303657 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8fd90-38ab-43b1-8a11-32b840e46fb8 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:28.303979 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8fd90-38ab-43b1-8a11-32b840e46fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:28.304253 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8fd90-38ab-43b1-8a11-32b840e46fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:28.322569 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f4c8fd90-38ab-43b1-8a11-32b840e46fb8 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:28.323818 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f4c8fd90-38ab-43b1-8a11-32b840e46fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:28.391263 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1164/2365] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:28.399024 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b17b02-51a8-495e-a273-39420a11fbd3 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:28.399311 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b17b02-51a8-495e-a273-39420a11fbd3 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:28.399592 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b17b02-51a8-495e-a273-39420a11fbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:28.423320 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-05b17b02-51a8-495e-a273-39420a11fbd3 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:28.424934 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-05b17b02-51a8-495e-a273-39420a11fbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:28.433853 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1202/2366] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:28.438617 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8fd90-38ab-43b1-8a11-32b840e46fb8 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:28.449062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8fd90-38ab-43b1-8a11-32b840e46fb8 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:28.460898 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d221ee88-93ae-4180-8632-3e1ab5d2f929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:28.461656 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221ee88-93ae-4180-8632-3e1ab5d2f929 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:28.462428 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221ee88-93ae-4180-8632-3e1ab5d2f929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:28.463228 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221ee88-93ae-4180-8632-3e1ab5d2f929 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:28.464025 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d221ee88-93ae-4180-8632-3e1ab5d2f929 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:58:28.464404 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d221ee88-93ae-4180-8632-3e1ab5d2f929 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:28.466380 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d221ee88-93ae-4180-8632-3e1ab5d2f929 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:28.488663 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1165/2367] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:58:28.489784 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b17b02-51a8-495e-a273-39420a11fbd3 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:28.506903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b17b02-51a8-495e-a273-39420a11fbd3 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:28.514194 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af02015-06a0-4602-ae3e-87993d497ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:28.519662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af02015-06a0-4602-ae3e-87993d497ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:28.519662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af02015-06a0-4602-ae3e-87993d497ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:28.519662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af02015-06a0-4602-ae3e-87993d497ee0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:28.519662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af02015-06a0-4602-ae3e-87993d497ee0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:28.519662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af02015-06a0-4602-ae3e-87993d497ee0 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:28.574642 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1203/2368] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:58:28 2022] POST /identity/v3/projects => generated 389 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:58:28.579541 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d221ee88-93ae-4180-8632-3e1ab5d2f929 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:28.596652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d221ee88-93ae-4180-8632-3e1ab5d2f929 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:28.653554 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:28.670966 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f63bf6-5894-456e-b378-69c73199b3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:28.675803 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f63bf6-5894-456e-b378-69c73199b3b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:28.675803 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f63bf6-5894-456e-b378-69c73199b3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:28.675803 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f63bf6-5894-456e-b378-69c73199b3b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:28.675803 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f63bf6-5894-456e-b378-69c73199b3b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:28.677299 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f63bf6-5894-456e-b378-69c73199b3b1 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:28.707933 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1166/2369] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:58:28 2022] POST /identity/v3/users => generated 295 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:58:28.710551 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af02015-06a0-4602-ae3e-87993d497ee0 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:28.726584 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af02015-06a0-4602-ae3e-87993d497ee0 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:28.732407 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39181112-c632-4bac-8329-753abbbcc707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:28.733845 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39181112-c632-4bac-8329-753abbbcc707 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:28.734125 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39181112-c632-4bac-8329-753abbbcc707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:28.734405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39181112-c632-4bac-8329-753abbbcc707 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:28.735139 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39181112-c632-4bac-8329-753abbbcc707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:28.736830 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39181112-c632-4bac-8329-753abbbcc707 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:28.748182 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1204/2370] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:58:28.752288 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f63bf6-5894-456e-b378-69c73199b3b1 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:28.764509 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f63bf6-5894-456e-b378-69c73199b3b1 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:28.770190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ea7a5-fb3c-4906-b596-57315be9731f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:28.770899 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ea7a5-fb3c-4906-b596-57315be9731f admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:28.771182 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ea7a5-fb3c-4906-b596-57315be9731f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:28.771453 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ea7a5-fb3c-4906-b596-57315be9731f admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:28.772217 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ea7a5-fb3c-4906-b596-57315be9731f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:28.773816 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ea7a5-fb3c-4906-b596-57315be9731f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:28.784855 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1167/2371] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:58:28.789275 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39181112-c632-4bac-8329-753abbbcc707 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:28.801655 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39181112-c632-4bac-8329-753abbbcc707 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:28.806592 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc3d7c-f1da-4579-a71a-d1df5de53d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:28.807705 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc3d7c-f1da-4579-a71a-d1df5de53d4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:28.808043 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc3d7c-f1da-4579-a71a-d1df5de53d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:28.808357 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc3d7c-f1da-4579-a71a-d1df5de53d4c admin admin] PATH_INFO: `/v3/projects/fd03ad6ed6e840f5ab565044bfc01789/users/a094fe1754184c35ac4059f793b08ebe/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:28.826162 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc3d7c-f1da-4579-a71a-d1df5de53d4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd03ad6ed6e840f5ab565044bfc01789, user_id=a094fe1754184c35ac4059f793b08ebe, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:28.829816 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc3d7c-f1da-4579-a71a-d1df5de53d4c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:28.843858 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1205/2372] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:58:28 2022] PUT /identity/v3/projects/fd03ad6ed6e840f5ab565044bfc01789/users/a094fe1754184c35ac4059f793b08ebe/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:28.855438 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cbaff-2279-4efc-913c-6f9f6c9516c2 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:28.855808 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cbaff-2279-4efc-913c-6f9f6c9516c2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:28.856180 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cbaff-2279-4efc-913c-6f9f6c9516c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:28.889768 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1c6cbaff-2279-4efc-913c-6f9f6c9516c2 None None] MFA Rules not processed for user `a094fe1754184c35ac4059f793b08ebe`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:28.891000 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1c6cbaff-2279-4efc-913c-6f9f6c9516c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:28.971414 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1168/2373] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:28.982449 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc3d7c-f1da-4579-a71a-d1df5de53d4c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:28.984254 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5ddc3d7c-f1da-4579-a71a-d1df5de53d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:29.052398 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc3d7c-f1da-4579-a71a-d1df5de53d4c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:29.056809 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7a117-c917-4355-a6d2-231160bbc47d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:29.056955 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7a117-c917-4355-a6d2-231160bbc47d service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:29.057211 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7a117-c917-4355-a6d2-231160bbc47d service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:29.057518 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7a117-c917-4355-a6d2-231160bbc47d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:29.067205 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7a117-c917-4355-a6d2-231160bbc47d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:29.068672 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7a117-c917-4355-a6d2-231160bbc47d service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:29.078145 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1206/2374] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:58:33.865424 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e06d2-5f7c-4ec5-9c47-f3c67bfa37e4 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:33.866294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e06d2-5f7c-4ec5-9c47-f3c67bfa37e4 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:33.866294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e06d2-5f7c-4ec5-9c47-f3c67bfa37e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:33.942825 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d98e06d2-5f7c-4ec5-9c47-f3c67bfa37e4 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:33.944070 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d98e06d2-5f7c-4ec5-9c47-f3c67bfa37e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:34.019854 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:34.057193 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1169/2375] 10.222.0.91 () {58 vars in 1016 bytes} [Thu Jun 16 14:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:34.087035 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7a117-c917-4355-a6d2-231160bbc47d service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:34.088644 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4cf7a117-c917-4355-a6d2-231160bbc47d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:34.124706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:34.241229 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7a117-c917-4355-a6d2-231160bbc47d service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:34.247463 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24049d4-b22d-48ed-a31f-6f71e13bc21d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:34.248673 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24049d4-b22d-48ed-a31f-6f71e13bc21d service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:34.248805 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24049d4-b22d-48ed-a31f-6f71e13bc21d service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:34.249022 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24049d4-b22d-48ed-a31f-6f71e13bc21d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:34.257550 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24049d4-b22d-48ed-a31f-6f71e13bc21d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:34.259141 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24049d4-b22d-48ed-a31f-6f71e13bc21d service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:34.271000 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1207/2376] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:58:41.783233 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e06d2-5f7c-4ec5-9c47-f3c67bfa37e4 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:41.785819 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d98e06d2-5f7c-4ec5-9c47-f3c67bfa37e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:41.801384 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e06d2-5f7c-4ec5-9c47-f3c67bfa37e4 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:41.806763 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46477e-9a28-4f91-a199-03102a722969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:41.807628 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46477e-9a28-4f91-a199-03102a722969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:41.807931 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46477e-9a28-4f91-a199-03102a722969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:41.808205 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46477e-9a28-4f91-a199-03102a722969 admin admin] PATH_INFO: `/v3/users/e521d781947d4e1c95461b2f901674a6` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:41.809866 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46477e-9a28-4f91-a199-03102a722969 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e521d781947d4e1c95461b2f901674a6)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:41.814324 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46477e-9a28-4f91-a199-03102a722969 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:41.865105 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4f46477e-9a28-4f91-a199-03102a722969 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e521d781947d4e1c95461b2f901674a6'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:41.872170 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4f46477e-9a28-4f91-a199-03102a722969 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e521d781947d4e1c95461b2f901674a6'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:41.881505 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4f46477e-9a28-4f91-a199-03102a722969 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e521d781947d4e1c95461b2f901674a6'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:41.895573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4f46477e-9a28-4f91-a199-03102a722969 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e521d781947d4e1c95461b2f901674a6'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:41.896230 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4f46477e-9a28-4f91-a199-03102a722969 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e521d781947d4e1c95461b2f901674a6'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:41.902753 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1170/2377] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:58:41 2022] DELETE /identity/v3/users/e521d781947d4e1c95461b2f901674a6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:42.088247 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24049d4-b22d-48ed-a31f-6f71e13bc21d service nova] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:42.101732 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24049d4-b22d-48ed-a31f-6f71e13bc21d service nova] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:42.161988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63a605-57e0-4a10-b4f6-d7f095153570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:42.162858 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63a605-57e0-4a10-b4f6-d7f095153570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:42.163170 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63a605-57e0-4a10-b4f6-d7f095153570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:42.163449 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63a605-57e0-4a10-b4f6-d7f095153570 admin admin] PATH_INFO: `/v3/projects/1c32525118c54f22978e4eba83573e9e` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:42.164660 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c63a605-57e0-4a10-b4f6-d7f095153570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c32525118c54f22978e4eba83573e9e)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:42.166618 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c63a605-57e0-4a10-b4f6-d7f095153570 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:42.216953 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2c63a605-57e0-4a10-b4f6-d7f095153570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c32525118c54f22978e4eba83573e9e', 'request_id': 'req-2c63a605-57e0-4a10-b4f6-d7f095153570'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:42.222718 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2c63a605-57e0-4a10-b4f6-d7f095153570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c32525118c54f22978e4eba83573e9e', 'request_id': 'req-2c63a605-57e0-4a10-b4f6-d7f095153570'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:42.228846 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2c63a605-57e0-4a10-b4f6-d7f095153570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c32525118c54f22978e4eba83573e9e', 'request_id': 'req-2c63a605-57e0-4a10-b4f6-d7f095153570'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:42.242060 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2c63a605-57e0-4a10-b4f6-d7f095153570 admin admin] The token cache is being invalidate because project 1c32525118c54f22978e4eba83573e9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:58:42.242472 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2c63a605-57e0-4a10-b4f6-d7f095153570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:42.243214 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-2c63a605-57e0-4a10-b4f6-d7f095153570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:42.244926 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1208/2378] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:58:42 2022] DELETE /identity/v3/projects/1c32525118c54f22978e4eba83573e9e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:42.249213 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46477e-9a28-4f91-a199-03102a722969 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:42.250774 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4f46477e-9a28-4f91-a199-03102a722969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:42.264533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46477e-9a28-4f91-a199-03102a722969 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:42.351802 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504b7ae-e05d-43cf-a75d-4395f6bf6aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:42.352714 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504b7ae-e05d-43cf-a75d-4395f6bf6aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:42.353002 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504b7ae-e05d-43cf-a75d-4395f6bf6aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:42.353344 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504b7ae-e05d-43cf-a75d-4395f6bf6aa2 admin admin] PATH_INFO: `/v3/users/cd94ad67fc1d46e9a6731ec93faa3c44` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:42.354645 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504b7ae-e05d-43cf-a75d-4395f6bf6aa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd94ad67fc1d46e9a6731ec93faa3c44)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:42.357701 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504b7ae-e05d-43cf-a75d-4395f6bf6aa2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:42.446341 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b504b7ae-e05d-43cf-a75d-4395f6bf6aa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd94ad67fc1d46e9a6731ec93faa3c44'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:42.452538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:42.455437 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b504b7ae-e05d-43cf-a75d-4395f6bf6aa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd94ad67fc1d46e9a6731ec93faa3c44'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:42.473334 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b504b7ae-e05d-43cf-a75d-4395f6bf6aa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd94ad67fc1d46e9a6731ec93faa3c44'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:42.494952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b504b7ae-e05d-43cf-a75d-4395f6bf6aa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd94ad67fc1d46e9a6731ec93faa3c44'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:42.496127 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b504b7ae-e05d-43cf-a75d-4395f6bf6aa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd94ad67fc1d46e9a6731ec93faa3c44'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:42.507725 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1171/2379] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:58:42 2022] DELETE /identity/v3/users/cd94ad67fc1d46e9a6731ec93faa3c44 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:42.899409 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63a605-57e0-4a10-b4f6-d7f095153570 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:42.901141 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2c63a605-57e0-4a10-b4f6-d7f095153570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:42.920092 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef5015-831e-43ef-b891-c3fb9decfb65 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:42.920848 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef5015-831e-43ef-b891-c3fb9decfb65 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:42.920848 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef5015-831e-43ef-b891-c3fb9decfb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:42.922792 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63a605-57e0-4a10-b4f6-d7f095153570 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:42.939483 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:42.947569 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-09ef5015-831e-43ef-b891-c3fb9decfb65 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:42.948852 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-09ef5015-831e-43ef-b891-c3fb9decfb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:42.994470 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6bdf61-8069-439a-9ea0-40324741db0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:42.995538 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bdf61-8069-439a-9ea0-40324741db0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:42.995922 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bdf61-8069-439a-9ea0-40324741db0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:42.996128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bdf61-8069-439a-9ea0-40324741db0b admin admin] PATH_INFO: `/v3/projects/6f662430268d48bcb58ea60b3d1c8458` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:42.997428 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6bdf61-8069-439a-9ea0-40324741db0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f662430268d48bcb58ea60b3d1c8458)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:42.999904 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6bdf61-8069-439a-9ea0-40324741db0b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:43.017834 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1172/2380] 10.222.0.91 () {58 vars in 1016 bytes} [Thu Jun 16 14:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:43.019156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac054f-fcce-4ab7-8252-fcfc3b30f52b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:43.019442 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac054f-fcce-4ab7-8252-fcfc3b30f52b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:43.019716 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac054f-fcce-4ab7-8252-fcfc3b30f52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:43.038287 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-daac054f-fcce-4ab7-8252-fcfc3b30f52b None None] MFA Rules not processed for user `4e10f63b54224607996ab53536ad00d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:43.039733 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-daac054f-fcce-4ab7-8252-fcfc3b30f52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:43.051845 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6b6bdf61-8069-439a-9ea0-40324741db0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f662430268d48bcb58ea60b3d1c8458', 'request_id': 'req-6b6bdf61-8069-439a-9ea0-40324741db0b'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:43.059200 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6b6bdf61-8069-439a-9ea0-40324741db0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f662430268d48bcb58ea60b3d1c8458', 'request_id': 'req-6b6bdf61-8069-439a-9ea0-40324741db0b'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:43.066185 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6b6bdf61-8069-439a-9ea0-40324741db0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f662430268d48bcb58ea60b3d1c8458', 'request_id': 'req-6b6bdf61-8069-439a-9ea0-40324741db0b'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:43.081412 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6b6bdf61-8069-439a-9ea0-40324741db0b admin admin] The token cache is being invalidate because project 6f662430268d48bcb58ea60b3d1c8458 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:58:43.081700 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6b6bdf61-8069-439a-9ea0-40324741db0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:43.082345 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6b6bdf61-8069-439a-9ea0-40324741db0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:43.083903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1209/2381] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:58:42 2022] DELETE /identity/v3/projects/6f662430268d48bcb58ea60b3d1c8458 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:43.084664 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6bdf61-8069-439a-9ea0-40324741db0b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:43.086054 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6b6bdf61-8069-439a-9ea0-40324741db0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:43.109566 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1173/2382] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:43.110903 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666be69-52da-491a-b943-006702383798 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:43.111191 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666be69-52da-491a-b943-006702383798 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:43.111466 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666be69-52da-491a-b943-006702383798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:43.130537 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4666be69-52da-491a-b943-006702383798 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:43.131667 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4666be69-52da-491a-b943-006702383798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:43.180423 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6bdf61-8069-439a-9ea0-40324741db0b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:43.188662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b9f2f-00a5-479d-ac23-2463aabab79b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:43.189327 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b9f2f-00a5-479d-ac23-2463aabab79b service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:43.189609 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b9f2f-00a5-479d-ac23-2463aabab79b service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:43.190240 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b9f2f-00a5-479d-ac23-2463aabab79b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:43.191696 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-347b9f2f-00a5-479d-ac23-2463aabab79b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:43.197507 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1174/2383] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:43.203670 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b9f2f-00a5-479d-ac23-2463aabab79b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:43.205324 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b9f2f-00a5-479d-ac23-2463aabab79b service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:43.206397 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcd552-5500-409a-bbd0-b21e7e15e0ff None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:43.206952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcd552-5500-409a-bbd0-b21e7e15e0ff None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:43.207235 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcd552-5500-409a-bbd0-b21e7e15e0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:43.215598 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1210/2384] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:58:43.234449 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-afbcd552-5500-409a-bbd0-b21e7e15e0ff None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:43.235656 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-afbcd552-5500-409a-bbd0-b21e7e15e0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:43.248045 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1175/2385] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:58:43.248476 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b9f2f-00a5-479d-ac23-2463aabab79b service nova] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:43.258811 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b9f2f-00a5-479d-ac23-2463aabab79b service nova] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:43.264250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf003fe1-1277-42ee-a590-50053a175a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:43.264901 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf003fe1-1277-42ee-a590-50053a175a5c admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:43.265182 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf003fe1-1277-42ee-a590-50053a175a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:43.265452 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf003fe1-1277-42ee-a590-50053a175a5c admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:43.266170 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf003fe1-1277-42ee-a590-50053a175a5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:58:43.266473 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf003fe1-1277-42ee-a590-50053a175a5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:43.268127 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf003fe1-1277-42ee-a590-50053a175a5c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:43.284373 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1211/2386] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:58:43.285887 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcd552-5500-409a-bbd0-b21e7e15e0ff None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:43.295983 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcd552-5500-409a-bbd0-b21e7e15e0ff None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:43.300806 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68c8fc-d71f-4a7c-804e-fe0856ce44c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:43.301858 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68c8fc-d71f-4a7c-804e-fe0856ce44c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:43.302201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68c8fc-d71f-4a7c-804e-fe0856ce44c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:43.302482 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68c8fc-d71f-4a7c-804e-fe0856ce44c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:43.303184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c68c8fc-d71f-4a7c-804e-fe0856ce44c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:43.305175 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c68c8fc-d71f-4a7c-804e-fe0856ce44c0 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:43.308819 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:43.346511 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1176/2387] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:58:43 2022] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:58:43.347883 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf003fe1-1277-42ee-a590-50053a175a5c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:43.359582 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf003fe1-1277-42ee-a590-50053a175a5c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:43.370497 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:43.422611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335a92c-c323-4826-9722-10137821c866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:43.423193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335a92c-c323-4826-9722-10137821c866 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:43.423475 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335a92c-c323-4826-9722-10137821c866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:43.423749 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335a92c-c323-4826-9722-10137821c866 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:43.424516 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335a92c-c323-4826-9722-10137821c866 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:43.426496 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335a92c-c323-4826-9722-10137821c866 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:43.456009 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1212/2388] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:58:43 2022] POST /identity/v3/users => generated 285 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:58:43.457010 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335a92c-c323-4826-9722-10137821c866 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:43.457137 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68c8fc-d71f-4a7c-804e-fe0856ce44c0 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:43.458720 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b335a92c-c323-4826-9722-10137821c866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:43.472068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335a92c-c323-4826-9722-10137821c866 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:43.472266 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68c8fc-d71f-4a7c-804e-fe0856ce44c0 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:43.478208 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd250d9-478f-47b9-87d8-71f20c06d4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:43.479217 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda98197-f01a-4cf6-aea4-c67990e6c722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:43.479355 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd250d9-478f-47b9-87d8-71f20c06d4d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:43.479505 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd250d9-478f-47b9-87d8-71f20c06d4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:43.479822 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd250d9-478f-47b9-87d8-71f20c06d4d4 admin admin] PATH_INFO: `/v3/users/a094fe1754184c35ac4059f793b08ebe` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:43.480359 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda98197-f01a-4cf6-aea4-c67990e6c722 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:43.480717 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda98197-f01a-4cf6-aea4-c67990e6c722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:43.481228 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda98197-f01a-4cf6-aea4-c67990e6c722 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:43.481457 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd250d9-478f-47b9-87d8-71f20c06d4d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a094fe1754184c35ac4059f793b08ebe)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:43.482326 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda98197-f01a-4cf6-aea4-c67990e6c722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:43.483655 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd250d9-478f-47b9-87d8-71f20c06d4d4 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:43.484415 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda98197-f01a-4cf6-aea4-c67990e6c722 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:43.496858 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1177/2389] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:58:43.500988 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda98197-f01a-4cf6-aea4-c67990e6c722 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:43.512332 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda98197-f01a-4cf6-aea4-c67990e6c722 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:43.521101 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cfa48-c3ea-458e-9c5e-28be33efc010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:43.521101 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cfa48-c3ea-458e-9c5e-28be33efc010 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:43.521101 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cfa48-c3ea-458e-9c5e-28be33efc010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:43.521101 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cfa48-c3ea-458e-9c5e-28be33efc010 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:43.521579 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8cfa48-c3ea-458e-9c5e-28be33efc010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:43.523088 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8cfa48-c3ea-458e-9c5e-28be33efc010 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:43.535250 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1178/2390] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:58:43.539729 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cfa48-c3ea-458e-9c5e-28be33efc010 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:43.551659 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7cd250d9-478f-47b9-87d8-71f20c06d4d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a094fe1754184c35ac4059f793b08ebe'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:43.552962 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cfa48-c3ea-458e-9c5e-28be33efc010 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:43.565809 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cdc877-7726-45cc-b7c0-489c9712f1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:43.566733 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdc877-7726-45cc-b7c0-489c9712f1ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:43.567017 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdc877-7726-45cc-b7c0-489c9712f1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:43.567351 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdc877-7726-45cc-b7c0-489c9712f1ba admin admin] PATH_INFO: `/v3/projects/204c2a3db453422eab59cb4ef296266f/users/2014e83c3905457d867ae23a0d7b5e71/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:43.573395 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7cd250d9-478f-47b9-87d8-71f20c06d4d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a094fe1754184c35ac4059f793b08ebe'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:43.574758 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7cd250d9-478f-47b9-87d8-71f20c06d4d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a094fe1754184c35ac4059f793b08ebe'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:43.586014 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7cd250d9-478f-47b9-87d8-71f20c06d4d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a094fe1754184c35ac4059f793b08ebe'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:43.587308 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cdc877-7726-45cc-b7c0-489c9712f1ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=204c2a3db453422eab59cb4ef296266f, user_id=2014e83c3905457d867ae23a0d7b5e71, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:43.590296 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cdc877-7726-45cc-b7c0-489c9712f1ba admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:43.594637 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7cd250d9-478f-47b9-87d8-71f20c06d4d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a094fe1754184c35ac4059f793b08ebe'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:43.601869 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1213/2391] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:58:43 2022] DELETE /identity/v3/users/a094fe1754184c35ac4059f793b08ebe => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:43.606136 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3343d78-e2e3-4ed6-8a40-43439d597610 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:43.606536 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3343d78-e2e3-4ed6-8a40-43439d597610 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:43.607430 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3343d78-e2e3-4ed6-8a40-43439d597610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:43.617037 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1179/2392] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:58:43 2022] PUT /identity/v3/projects/204c2a3db453422eab59cb4ef296266f/users/2014e83c3905457d867ae23a0d7b5e71/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:58:43.619886 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa0d7a-8eff-44a5-ae57-13eeb4155e39 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:43.620220 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa0d7a-8eff-44a5-ae57-13eeb4155e39 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:43.620509 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa0d7a-8eff-44a5-ae57-13eeb4155e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:43.629841 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b3343d78-e2e3-4ed6-8a40-43439d597610 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:43.631534 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b3343d78-e2e3-4ed6-8a40-43439d597610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:43.651007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b5aa0d7a-8eff-44a5-ae57-13eeb4155e39 None None] MFA Rules not processed for user `2014e83c3905457d867ae23a0d7b5e71`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:43.652679 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b5aa0d7a-8eff-44a5-ae57-13eeb4155e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:43.702228 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1214/2393] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:43.714451 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3343d78-e2e3-4ed6-8a40-43439d597610 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:43.716079 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b3343d78-e2e3-4ed6-8a40-43439d597610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:43.738095 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:43.743218 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1180/2394] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:43 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:43.755720 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa0d7a-8eff-44a5-ae57-13eeb4155e39 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:43.757240 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b5aa0d7a-8eff-44a5-ae57-13eeb4155e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:43.855519 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa0d7a-8eff-44a5-ae57-13eeb4155e39 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:43.856245 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3343d78-e2e3-4ed6-8a40-43439d597610 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:43.860604 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801d2da-b1b7-4b6a-9ee5-ee210b29aac7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819a7d47f644bc18e6d07a125826d76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:43.861320 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801d2da-b1b7-4b6a-9ee5-ee210b29aac7 service glance] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:43.861609 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801d2da-b1b7-4b6a-9ee5-ee210b29aac7 service glance] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:43.861885 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801d2da-b1b7-4b6a-9ee5-ee210b29aac7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:43.872299 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801d2da-b1b7-4b6a-9ee5-ee210b29aac7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:43.874395 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801d2da-b1b7-4b6a-9ee5-ee210b29aac7 service glance] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:43.875203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a84d3a-7a30-46ab-be0e-163256029ce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:43.876176 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a84d3a-7a30-46ab-be0e-163256029ce3 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:43.876615 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a84d3a-7a30-46ab-be0e-163256029ce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:43.876951 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a84d3a-7a30-46ab-be0e-163256029ce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:43.886758 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1181/2395] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:43 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:58:43.896778 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a84d3a-7a30-46ab-be0e-163256029ce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:43.898343 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a84d3a-7a30-46ab-be0e-163256029ce3 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:43.909592 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1215/2396] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:58:44.259035 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801d2da-b1b7-4b6a-9ee5-ee210b29aac7 service glance] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:44.260532 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3801d2da-b1b7-4b6a-9ee5-ee210b29aac7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:44.280829 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801d2da-b1b7-4b6a-9ee5-ee210b29aac7 service glance] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:44.286832 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897271d-531a-4d1f-a632-cbe1a59cfb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:44.287849 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897271d-531a-4d1f-a632-cbe1a59cfb62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:44.288319 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897271d-531a-4d1f-a632-cbe1a59cfb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:44.288671 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897271d-531a-4d1f-a632-cbe1a59cfb62 admin admin] PATH_INFO: `/v3/projects/fd03ad6ed6e840f5ab565044bfc01789` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:44.290157 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897271d-531a-4d1f-a632-cbe1a59cfb62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd03ad6ed6e840f5ab565044bfc01789)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:44.292455 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897271d-531a-4d1f-a632-cbe1a59cfb62 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:44.329004 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:44.348663 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4897271d-531a-4d1f-a632-cbe1a59cfb62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd03ad6ed6e840f5ab565044bfc01789', 'request_id': 'req-4897271d-531a-4d1f-a632-cbe1a59cfb62'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:44.355702 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4897271d-531a-4d1f-a632-cbe1a59cfb62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd03ad6ed6e840f5ab565044bfc01789', 'request_id': 'req-4897271d-531a-4d1f-a632-cbe1a59cfb62'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:44.365044 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4897271d-531a-4d1f-a632-cbe1a59cfb62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd03ad6ed6e840f5ab565044bfc01789', 'request_id': 'req-4897271d-531a-4d1f-a632-cbe1a59cfb62'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:44.380979 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4897271d-531a-4d1f-a632-cbe1a59cfb62 admin admin] The token cache is being invalidate because project fd03ad6ed6e840f5ab565044bfc01789 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:58:44.381396 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4897271d-531a-4d1f-a632-cbe1a59cfb62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:44.382120 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4897271d-531a-4d1f-a632-cbe1a59cfb62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:44.384153 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1182/2397] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:58:44 2022] DELETE /identity/v3/projects/fd03ad6ed6e840f5ab565044bfc01789 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:48.393598 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fb8bf-9a9b-4f65-a0ef-403fbb5493b3 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:48.394585 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fb8bf-9a9b-4f65-a0ef-403fbb5493b3 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:48.394955 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fb8bf-9a9b-4f65-a0ef-403fbb5493b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:48.432996 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-4a6fb8bf-9a9b-4f65-a0ef-403fbb5493b3 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:48.434228 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4a6fb8bf-9a9b-4f65-a0ef-403fbb5493b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:48.532016 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1216/2398] 10.222.0.91 () {58 vars in 1016 bytes} [Thu Jun 16 14:58:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:48.561294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897271d-531a-4d1f-a632-cbe1a59cfb62 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:48.563917 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4897271d-531a-4d1f-a632-cbe1a59cfb62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:48.650662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897271d-531a-4d1f-a632-cbe1a59cfb62 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:48.665061 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6cf77-d42d-47ef-afc3-a2705371c89e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:48.665061 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6cf77-d42d-47ef-afc3-a2705371c89e service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:48.665061 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6cf77-d42d-47ef-afc3-a2705371c89e service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:48.665061 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6cf77-d42d-47ef-afc3-a2705371c89e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:48.667915 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6cf77-d42d-47ef-afc3-a2705371c89e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:48.669568 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6cf77-d42d-47ef-afc3-a2705371c89e service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:48.679324 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1183/2399] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:58:53.443426 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fb8bf-9a9b-4f65-a0ef-403fbb5493b3 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:53.444949 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4a6fb8bf-9a9b-4f65-a0ef-403fbb5493b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:53.459793 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fb8bf-9a9b-4f65-a0ef-403fbb5493b3 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:53.466316 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf27027-1604-4c22-963c-75221b149c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:53.467257 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf27027-1604-4c22-963c-75221b149c7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:53.467541 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf27027-1604-4c22-963c-75221b149c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:53.467814 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf27027-1604-4c22-963c-75221b149c7b admin admin] PATH_INFO: `/v3/users/4f250b645c004e17a895a1a48dd9cede` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:53.469111 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf27027-1604-4c22-963c-75221b149c7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f250b645c004e17a895a1a48dd9cede)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:53.471025 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf27027-1604-4c22-963c-75221b149c7b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:53.541388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-abf27027-1604-4c22-963c-75221b149c7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f250b645c004e17a895a1a48dd9cede'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:53.555527 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-abf27027-1604-4c22-963c-75221b149c7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f250b645c004e17a895a1a48dd9cede'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:53.556361 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-abf27027-1604-4c22-963c-75221b149c7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f250b645c004e17a895a1a48dd9cede'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:53.569437 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-abf27027-1604-4c22-963c-75221b149c7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f250b645c004e17a895a1a48dd9cede'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:53.577164 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-abf27027-1604-4c22-963c-75221b149c7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f250b645c004e17a895a1a48dd9cede'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:53.583430 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1217/2400] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:58:53 2022] DELETE /identity/v3/users/4f250b645c004e17a895a1a48dd9cede => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:53.588309 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf1f65-7857-4da6-9f56-a22fad0d4649 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:53.588803 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf1f65-7857-4da6-9f56-a22fad0d4649 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:53.589073 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf1f65-7857-4da6-9f56-a22fad0d4649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:53.610053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-78cf1f65-7857-4da6-9f56-a22fad0d4649 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:53.611384 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-78cf1f65-7857-4da6-9f56-a22fad0d4649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:53.676275 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1184/2401] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:58:53.686499 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf27027-1604-4c22-963c-75221b149c7b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:53.688360 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-abf27027-1604-4c22-963c-75221b149c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:53.694565 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:53.755775 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf27027-1604-4c22-963c-75221b149c7b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:53.759789 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5ebae-8eac-4501-81ee-834f5648f618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:53.760502 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5ebae-8eac-4501-81ee-834f5648f618 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:53.760768 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5ebae-8eac-4501-81ee-834f5648f618 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:53.761052 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5ebae-8eac-4501-81ee-834f5648f618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:53.771209 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb5ebae-8eac-4501-81ee-834f5648f618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:53.772695 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb5ebae-8eac-4501-81ee-834f5648f618 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:53.782693 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1218/2402] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:58:54.075162 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf1f65-7857-4da6-9f56-a22fad0d4649 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:54.077461 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-78cf1f65-7857-4da6-9f56-a22fad0d4649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:54.102292 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf1f65-7857-4da6-9f56-a22fad0d4649 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:54.112589 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a17c3c-e056-4371-8cbe-9217c35404da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:54.113478 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a17c3c-e056-4371-8cbe-9217c35404da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:54.113760 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a17c3c-e056-4371-8cbe-9217c35404da admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:54.114039 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a17c3c-e056-4371-8cbe-9217c35404da admin admin] PATH_INFO: `/v3/projects/2cff91abe323475eadc0bc8a04452d46` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:54.115371 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a17c3c-e056-4371-8cbe-9217c35404da admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cff91abe323475eadc0bc8a04452d46)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:54.117854 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a17c3c-e056-4371-8cbe-9217c35404da admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:54.158145 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:54.170839 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-32a17c3c-e056-4371-8cbe-9217c35404da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cff91abe323475eadc0bc8a04452d46', 'request_id': 'req-32a17c3c-e056-4371-8cbe-9217c35404da'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:54.177430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-32a17c3c-e056-4371-8cbe-9217c35404da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cff91abe323475eadc0bc8a04452d46', 'request_id': 'req-32a17c3c-e056-4371-8cbe-9217c35404da'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:54.183285 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-32a17c3c-e056-4371-8cbe-9217c35404da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cff91abe323475eadc0bc8a04452d46', 'request_id': 'req-32a17c3c-e056-4371-8cbe-9217c35404da'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:54.198332 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-32a17c3c-e056-4371-8cbe-9217c35404da admin admin] The token cache is being invalidate because project 2cff91abe323475eadc0bc8a04452d46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:58:54.198601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-32a17c3c-e056-4371-8cbe-9217c35404da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:54.199558 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-32a17c3c-e056-4371-8cbe-9217c35404da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:58:54.201966 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1185/2403] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:58:54 2022] DELETE /identity/v3/projects/2cff91abe323475eadc0bc8a04452d46 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:54.207639 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10de90b-4c20-41c3-82d0-d0b36c9ffa62 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:54.208195 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10de90b-4c20-41c3-82d0-d0b36c9ffa62 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:54.208572 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10de90b-4c20-41c3-82d0-d0b36c9ffa62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:54.227800 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-e10de90b-4c20-41c3-82d0-d0b36c9ffa62 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:54.229265 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e10de90b-4c20-41c3-82d0-d0b36c9ffa62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:54.292325 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1219/2404] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:54.300942 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425296c-4f22-445a-b41b-f01ffc4b24ea None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:54.301321 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425296c-4f22-445a-b41b-f01ffc4b24ea None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:54.301605 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425296c-4f22-445a-b41b-f01ffc4b24ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:54.324686 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4425296c-4f22-445a-b41b-f01ffc4b24ea None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:54.326930 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4425296c-4f22-445a-b41b-f01ffc4b24ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:54.337274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1186/2405] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:54.341547 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10de90b-4c20-41c3-82d0-d0b36c9ffa62 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:54.351566 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10de90b-4c20-41c3-82d0-d0b36c9ffa62 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:54.356621 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe80555-3c10-41cc-96f2-2e5bd6d81d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:54.357315 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe80555-3c10-41cc-96f2-2e5bd6d81d3c admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:54.357573 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe80555-3c10-41cc-96f2-2e5bd6d81d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:54.357846 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe80555-3c10-41cc-96f2-2e5bd6d81d3c admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:54.358570 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe80555-3c10-41cc-96f2-2e5bd6d81d3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:58:54.358879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe80555-3c10-41cc-96f2-2e5bd6d81d3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:54.360527 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe80555-3c10-41cc-96f2-2e5bd6d81d3c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:54.372745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1220/2406] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 14:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:58:54.377475 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425296c-4f22-445a-b41b-f01ffc4b24ea None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:54.390020 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425296c-4f22-445a-b41b-f01ffc4b24ea None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:54.400410 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96344f97-f516-49c2-b765-0b0f05395dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:54.401086 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96344f97-f516-49c2-b765-0b0f05395dcf admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:54.401361 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96344f97-f516-49c2-b765-0b0f05395dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:54.401632 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96344f97-f516-49c2-b765-0b0f05395dcf admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:54.402368 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96344f97-f516-49c2-b765-0b0f05395dcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:54.404402 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96344f97-f516-49c2-b765-0b0f05395dcf admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:54.432509 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1187/2407] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:58:54 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:58:54.436859 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe80555-3c10-41cc-96f2-2e5bd6d81d3c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:54.447050 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe80555-3c10-41cc-96f2-2e5bd6d81d3c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:54.510780 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a61f1-87d2-4e2c-a909-b512ffeaf318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:54.511462 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a61f1-87d2-4e2c-a909-b512ffeaf318 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:54.511771 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a61f1-87d2-4e2c-a909-b512ffeaf318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:54.512076 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a61f1-87d2-4e2c-a909-b512ffeaf318 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:54.512783 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a61f1-87d2-4e2c-a909-b512ffeaf318 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:54.515007 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a61f1-87d2-4e2c-a909-b512ffeaf318 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:54.536477 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1221/2408] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:58:54 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:58:54.540671 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96344f97-f516-49c2-b765-0b0f05395dcf admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:54.553286 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96344f97-f516-49c2-b765-0b0f05395dcf admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:54.559690 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83e3fe-b5ea-4f63-8f41-71dece37d39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:54.560505 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83e3fe-b5ea-4f63-8f41-71dece37d39c admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:54.560892 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83e3fe-b5ea-4f63-8f41-71dece37d39c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:54.561295 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83e3fe-b5ea-4f63-8f41-71dece37d39c admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:54.562287 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f83e3fe-b5ea-4f63-8f41-71dece37d39c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:54.564010 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f83e3fe-b5ea-4f63-8f41-71dece37d39c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:54.578240 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1188/2409] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:58:54.582656 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a61f1-87d2-4e2c-a909-b512ffeaf318 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:54.600466 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a61f1-87d2-4e2c-a909-b512ffeaf318 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:54.609846 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742c5a3-c380-4d09-8b86-6c5326eff2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:54.610514 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742c5a3-c380-4d09-8b86-6c5326eff2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:54.610815 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742c5a3-c380-4d09-8b86-6c5326eff2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:54.611205 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742c5a3-c380-4d09-8b86-6c5326eff2e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:54.612138 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742c5a3-c380-4d09-8b86-6c5326eff2e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:54.613862 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742c5a3-c380-4d09-8b86-6c5326eff2e6 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:54.626727 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1222/2410] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:58:54.632629 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83e3fe-b5ea-4f63-8f41-71dece37d39c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:54.644035 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83e3fe-b5ea-4f63-8f41-71dece37d39c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:54.648982 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bdd93-7d00-49ee-b552-a931af1c6e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:54.649868 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bdd93-7d00-49ee-b552-a931af1c6e72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:54.650146 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bdd93-7d00-49ee-b552-a931af1c6e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:54.650422 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bdd93-7d00-49ee-b552-a931af1c6e72 admin admin] PATH_INFO: `/v3/projects/bef9b7a1552b4ae7b0218dcd3f5fd26c/users/571b0d0bb30042bf8be6d98c6fc8d92b/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:54.669309 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051bdd93-7d00-49ee-b552-a931af1c6e72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bef9b7a1552b4ae7b0218dcd3f5fd26c, user_id=571b0d0bb30042bf8be6d98c6fc8d92b, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:54.672110 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051bdd93-7d00-49ee-b552-a931af1c6e72 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:54.691315 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1189/2411] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:58:54 2022] PUT /identity/v3/projects/bef9b7a1552b4ae7b0218dcd3f5fd26c/users/571b0d0bb30042bf8be6d98c6fc8d92b/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:54.697378 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2ca57-2fd0-4219-a967-a61a307285df None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:54.697680 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2ca57-2fd0-4219-a967-a61a307285df None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:54.697957 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2ca57-2fd0-4219-a967-a61a307285df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:54.717523 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-16e2ca57-2fd0-4219-a967-a61a307285df None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:54.718744 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-16e2ca57-2fd0-4219-a967-a61a307285df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:54.724288 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:54.780628 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1223/2412] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:54.790741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bdd93-7d00-49ee-b552-a931af1c6e72 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:54.792698 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-051bdd93-7d00-49ee-b552-a931af1c6e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:54.855470 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bdd93-7d00-49ee-b552-a931af1c6e72 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:54.859668 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38448e5a-1825-47c3-b712-48253db465e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:54.860340 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38448e5a-1825-47c3-b712-48253db465e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:54.860619 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38448e5a-1825-47c3-b712-48253db465e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:54.860892 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38448e5a-1825-47c3-b712-48253db465e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:54.871564 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38448e5a-1825-47c3-b712-48253db465e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:54.873927 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38448e5a-1825-47c3-b712-48253db465e5 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:54.889881 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1190/2413] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:58:55.497559 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fb190-8394-4aa4-8d2d-c30c1d6ad6b0 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:55.498138 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fb190-8394-4aa4-8d2d-c30c1d6ad6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:55.498552 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fb190-8394-4aa4-8d2d-c30c1d6ad6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:55.555466 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-5e1fb190-8394-4aa4-8d2d-c30c1d6ad6b0 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:55.556752 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5e1fb190-8394-4aa4-8d2d-c30c1d6ad6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:55.584370 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1224/2414] 10.222.0.91 () {58 vars in 1016 bytes} [Thu Jun 16 14:58:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:55.607188 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38448e5a-1825-47c3-b712-48253db465e5 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:55.609378 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-38448e5a-1825-47c3-b712-48253db465e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:55.737639 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:55.822142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38448e5a-1825-47c3-b712-48253db465e5 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:55.829237 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c56c64-923a-42e3-a673-5120258e5a3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:55.829909 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c56c64-923a-42e3-a673-5120258e5a3e service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:55.830326 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c56c64-923a-42e3-a673-5120258e5a3e service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:55.830609 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c56c64-923a-42e3-a673-5120258e5a3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:55.840808 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c56c64-923a-42e3-a673-5120258e5a3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:55.843076 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c56c64-923a-42e3-a673-5120258e5a3e service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:55.856394 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1191/2415] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:58:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:58:59.113601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f46e8-9ed0-4f60-a711-10f1f61dff4c None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:59.114154 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f46e8-9ed0-4f60-a711-10f1f61dff4c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:59.114154 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f46e8-9ed0-4f60-a711-10f1f61dff4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:59.155580 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-061f46e8-9ed0-4f60-a711-10f1f61dff4c None None] MFA Rules not processed for user `571b0d0bb30042bf8be6d98c6fc8d92b`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:58:59.157273 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-061f46e8-9ed0-4f60-a711-10f1f61dff4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:58:59.281739 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1225/2416] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:58:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:58:59.288683 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c56c64-923a-42e3-a673-5120258e5a3e service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:59.305465 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c56c64-923a-42e3-a673-5120258e5a3e service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:59.317139 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4a686-24f3-4278-b249-c80f016d923d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:59.318093 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4a686-24f3-4278-b249-c80f016d923d admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:59.318543 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4a686-24f3-4278-b249-c80f016d923d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:59.318822 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4a686-24f3-4278-b249-c80f016d923d admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:59.319530 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4a686-24f3-4278-b249-c80f016d923d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:59.321505 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4a686-24f3-4278-b249-c80f016d923d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:59.355989 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1192/2417] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 14:58:59 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:58:59.359443 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f46e8-9ed0-4f60-a711-10f1f61dff4c None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:59.372404 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f46e8-9ed0-4f60-a711-10f1f61dff4c None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:59.444790 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdbc88-af5c-478e-8d2a-15cf70611982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:59.445553 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdbc88-af5c-478e-8d2a-15cf70611982 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:59.445744 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdbc88-af5c-478e-8d2a-15cf70611982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:59.446017 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdbc88-af5c-478e-8d2a-15cf70611982 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:59.446750 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bdbc88-af5c-478e-8d2a-15cf70611982 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:59.448758 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bdbc88-af5c-478e-8d2a-15cf70611982 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:59.472854 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1226/2418] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 14:58:59 2022] POST /identity/v3/users => generated 299 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:58:59.476897 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4a686-24f3-4278-b249-c80f016d923d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:59.488062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4a686-24f3-4278-b249-c80f016d923d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:59.492829 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af7d7c-d494-427d-96d0-bce93d827b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:59.493538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af7d7c-d494-427d-96d0-bce93d827b37 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:59.493823 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af7d7c-d494-427d-96d0-bce93d827b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:59.494270 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af7d7c-d494-427d-96d0-bce93d827b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:59.495008 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af7d7c-d494-427d-96d0-bce93d827b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:59.496666 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af7d7c-d494-427d-96d0-bce93d827b37 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:59.508264 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1193/2419] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:58:59.513266 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdbc88-af5c-478e-8d2a-15cf70611982 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:59.524816 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdbc88-af5c-478e-8d2a-15cf70611982 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:59.529925 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c1d66-a9d8-45db-b617-6795733b302e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:59.530837 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c1d66-a9d8-45db-b617-6795733b302e admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:59.531119 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c1d66-a9d8-45db-b617-6795733b302e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:59.531395 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c1d66-a9d8-45db-b617-6795733b302e admin admin] PATH_INFO: `/v3/projects/0421d8e9e1674413a56c01b2882a546a/users/897ea303d4874bd5b7e7f30f43776113/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:59.552708 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c1d66-a9d8-45db-b617-6795733b302e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0421d8e9e1674413a56c01b2882a546a, user_id=897ea303d4874bd5b7e7f30f43776113, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:59.556825 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c1d66-a9d8-45db-b617-6795733b302e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:59.570864 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:59.574914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1227/2420] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:58:59 2022] PUT /identity/v3/projects/0421d8e9e1674413a56c01b2882a546a/users/897ea303d4874bd5b7e7f30f43776113/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:58:59.579314 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af7d7c-d494-427d-96d0-bce93d827b37 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:59.595456 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af7d7c-d494-427d-96d0-bce93d827b37 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:59.683473 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285c564-8d11-48ea-868b-d90f2554d62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:59.684385 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285c564-8d11-48ea-868b-d90f2554d62a admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:59.684990 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285c564-8d11-48ea-868b-d90f2554d62a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:59.685579 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285c564-8d11-48ea-868b-d90f2554d62a admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:59.686602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285c564-8d11-48ea-868b-d90f2554d62a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:59.688848 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285c564-8d11-48ea-868b-d90f2554d62a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:59.701408 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1194/2421] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 14:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:58:59.705495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c1d66-a9d8-45db-b617-6795733b302e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:58:59.718964 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c1d66-a9d8-45db-b617-6795733b302e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:58:59.724985 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e1a67-ede9-4e2d-b16e-9a4d9922d325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:58:59.726025 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e1a67-ede9-4e2d-b16e-9a4d9922d325 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:58:59.726294 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e1a67-ede9-4e2d-b16e-9a4d9922d325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:58:59.726564 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e1a67-ede9-4e2d-b16e-9a4d9922d325 admin admin] PATH_INFO: `/v3/projects/0421d8e9e1674413a56c01b2882a546a/users/897ea303d4874bd5b7e7f30f43776113/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:58:59.728611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e1a67-ede9-4e2d-b16e-9a4d9922d325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0421d8e9e1674413a56c01b2882a546a, user_id=897ea303d4874bd5b7e7f30f43776113, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:58:59.731683 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e1a67-ede9-4e2d-b16e-9a4d9922d325 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:58:59.757511 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1228/2422] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 14:58:59 2022] PUT /identity/v3/projects/0421d8e9e1674413a56c01b2882a546a/users/897ea303d4874bd5b7e7f30f43776113/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:59:02.922755 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2a630-51ed-46d4-b786-34242fe409b2 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:02.923268 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2a630-51ed-46d4-b786-34242fe409b2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:02.923387 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2a630-51ed-46d4-b786-34242fe409b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:02.961785 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-06b2a630-51ed-46d4-b786-34242fe409b2 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:59:02.963543 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-06b2a630-51ed-46d4-b786-34242fe409b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:03.096852 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1195/2423] 10.222.0.91 () {58 vars in 1016 bytes} [Thu Jun 16 14:59:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:59:03.121317 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e1a67-ede9-4e2d-b16e-9a4d9922d325 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:03.272348 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e1a67-ede9-4e2d-b16e-9a4d9922d325 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:03.284312 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664eba3f-782e-44fb-b0ad-a03d8fe673b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:03.285662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664eba3f-782e-44fb-b0ad-a03d8fe673b2 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:03.286693 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664eba3f-782e-44fb-b0ad-a03d8fe673b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:03.288023 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664eba3f-782e-44fb-b0ad-a03d8fe673b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:03.300896 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664eba3f-782e-44fb-b0ad-a03d8fe673b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:03.302805 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664eba3f-782e-44fb-b0ad-a03d8fe673b2 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:03.325008 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1229/2424] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:59:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:59:04.693380 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a8d96-96c7-418b-97b9-6924bcd691dd None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:04.693899 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a8d96-96c7-418b-97b9-6924bcd691dd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:04.694010 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a8d96-96c7-418b-97b9-6924bcd691dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:04.729657 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-fd5a8d96-96c7-418b-97b9-6924bcd691dd None None] MFA Rules not processed for user `897ea303d4874bd5b7e7f30f43776113`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:59:04.732600 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fd5a8d96-96c7-418b-97b9-6924bcd691dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:04.750282 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:04.814395 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1196/2425] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:59:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:59:04.827384 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664eba3f-782e-44fb-b0ad-a03d8fe673b2 service nova] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:04.828892 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-664eba3f-782e-44fb-b0ad-a03d8fe673b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:04.891671 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664eba3f-782e-44fb-b0ad-a03d8fe673b2 service nova] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:04.895508 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19484b7c-7871-4816-a518-998518dd0a33 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819a7d47f644bc18e6d07a125826d76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:04.896347 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19484b7c-7871-4816-a518-998518dd0a33 service glance] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:04.896696 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19484b7c-7871-4816-a518-998518dd0a33 service glance] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:04.897029 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19484b7c-7871-4816-a518-998518dd0a33 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:04.964435 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19484b7c-7871-4816-a518-998518dd0a33 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:04.965930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19484b7c-7871-4816-a518-998518dd0a33 service glance] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:04.977109 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1230/2426] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:59:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:59:05.190208 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76518c36-5647-48fb-842f-ba70c2792677 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:05.191305 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76518c36-5647-48fb-842f-ba70c2792677 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:05.191683 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76518c36-5647-48fb-842f-ba70c2792677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:05.247183 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-76518c36-5647-48fb-842f-ba70c2792677 None None] MFA Rules not processed for user `db4d36e6837d4b2fa4b7ee5c7243b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:59:05.248703 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-76518c36-5647-48fb-842f-ba70c2792677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:05.323931 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1197/2427] 10.222.0.85 () {58 vars in 1009 bytes} [Thu Jun 16 14:59:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:59:05.376334 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19484b7c-7871-4816-a518-998518dd0a33 service glance] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:05.378161 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-19484b7c-7871-4816-a518-998518dd0a33 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:05.417251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:05.462659 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19484b7c-7871-4816-a518-998518dd0a33 service glance] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:05.470050 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc290edb-0d25-417e-8871-e6f886355322 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf9c39de29324b0ca6329c9a171367c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:05.470851 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc290edb-0d25-417e-8871-e6f886355322 service swift] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:05.471246 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc290edb-0d25-417e-8871-e6f886355322 service swift] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:05.471578 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc290edb-0d25-417e-8871-e6f886355322 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:05.482932 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc290edb-0d25-417e-8871-e6f886355322 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:05.484782 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc290edb-0d25-417e-8871-e6f886355322 service swift] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:05.494281 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1231/2428] 10.222.0.85 () {60 vars in 1384 bytes} [Thu Jun 16 14:59:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 14:59:09.338195 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e0147-2133-4b30-855e-c07d06f60eb5 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:09.338770 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e0147-2133-4b30-855e-c07d06f60eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:09.339098 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e0147-2133-4b30-855e-c07d06f60eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:09.367051 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5d3e0147-2133-4b30-855e-c07d06f60eb5 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:59:09.368792 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5d3e0147-2133-4b30-855e-c07d06f60eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:09.379701 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1198/2429] 10.222.0.91 () {58 vars in 1016 bytes} [Thu Jun 16 14:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:59:09.413639 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc290edb-0d25-417e-8871-e6f886355322 service swift] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:09.416051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-dc290edb-0d25-417e-8871-e6f886355322 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:09.438703 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc290edb-0d25-417e-8871-e6f886355322 service swift] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:09.452083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2d491-e1b3-407c-abd6-ac87bbb5aa68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:09.453008 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2d491-e1b3-407c-abd6-ac87bbb5aa68 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:09.453887 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2d491-e1b3-407c-abd6-ac87bbb5aa68 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:09.454615 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2d491-e1b3-407c-abd6-ac87bbb5aa68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:09.469199 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2d491-e1b3-407c-abd6-ac87bbb5aa68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:09.471326 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2d491-e1b3-407c-abd6-ac87bbb5aa68 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:09.488711 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1232/2430] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:59:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:59:14.764854 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94c244-251c-4cb7-9c9c-da2ff9007154 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:14.765452 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94c244-251c-4cb7-9c9c-da2ff9007154 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:14.765452 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94c244-251c-4cb7-9c9c-da2ff9007154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:14.789967 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ab94c244-251c-4cb7-9c9c-da2ff9007154 None None] MFA Rules not processed for user `571b0d0bb30042bf8be6d98c6fc8d92b`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:59:14.791264 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ab94c244-251c-4cb7-9c9c-da2ff9007154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:14.799505 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1199/2431] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:59:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:59:17.062145 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f2610-bae8-4345-827d-4ec705339a47 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:17.062729 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f2610-bae8-4345-827d-4ec705339a47 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:17.062729 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f2610-bae8-4345-827d-4ec705339a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:17.081237 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d98f2610-bae8-4345-827d-4ec705339a47 None None] MFA Rules not processed for user `db4d36e6837d4b2fa4b7ee5c7243b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:59:17.082723 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d98f2610-bae8-4345-827d-4ec705339a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:17.090877 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1233/2432] 10.222.0.85 () {58 vars in 1009 bytes} [Thu Jun 16 14:59:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:59:17.110387 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94c244-251c-4cb7-9c9c-da2ff9007154 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:17.127276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94c244-251c-4cb7-9c9c-da2ff9007154 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:17.133529 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431538fd-0ada-4780-a6f8-a30c90b482c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf9c39de29324b0ca6329c9a171367c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:17.134272 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431538fd-0ada-4780-a6f8-a30c90b482c7 service swift] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:17.134609 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431538fd-0ada-4780-a6f8-a30c90b482c7 service swift] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:17.134874 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431538fd-0ada-4780-a6f8-a30c90b482c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:17.144903 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431538fd-0ada-4780-a6f8-a30c90b482c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:17.146710 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431538fd-0ada-4780-a6f8-a30c90b482c7 service swift] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:17.156080 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1200/2433] 10.222.0.85 () {60 vars in 1384 bytes} [Thu Jun 16 14:59:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 14:59:23.313452 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f2610-bae8-4345-827d-4ec705339a47 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:23.315415 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d98f2610-bae8-4345-827d-4ec705339a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:23.331658 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f2610-bae8-4345-827d-4ec705339a47 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:23.337002 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c7a57-fa63-47c5-8e65-5462ab10fc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:23.337880 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c7a57-fa63-47c5-8e65-5462ab10fc59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:23.338159 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c7a57-fa63-47c5-8e65-5462ab10fc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:23.338459 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c7a57-fa63-47c5-8e65-5462ab10fc59 admin admin] PATH_INFO: `/v3/users/2014e83c3905457d867ae23a0d7b5e71` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:23.339786 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c7a57-fa63-47c5-8e65-5462ab10fc59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2014e83c3905457d867ae23a0d7b5e71)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:23.341885 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c7a57-fa63-47c5-8e65-5462ab10fc59 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:23.402815 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7e5c7a57-fa63-47c5-8e65-5462ab10fc59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2014e83c3905457d867ae23a0d7b5e71'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:23.418795 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7e5c7a57-fa63-47c5-8e65-5462ab10fc59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2014e83c3905457d867ae23a0d7b5e71'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:23.419626 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7e5c7a57-fa63-47c5-8e65-5462ab10fc59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2014e83c3905457d867ae23a0d7b5e71'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:23.430546 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7e5c7a57-fa63-47c5-8e65-5462ab10fc59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2014e83c3905457d867ae23a0d7b5e71'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:23.440388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7e5c7a57-fa63-47c5-8e65-5462ab10fc59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2014e83c3905457d867ae23a0d7b5e71'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:23.446569 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1234/2434] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 14:59:23 2022] DELETE /identity/v3/users/2014e83c3905457d867ae23a0d7b5e71 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:59:23.451371 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ad5b1-1a0e-40d2-86be-32c33440e047 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:23.452024 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ad5b1-1a0e-40d2-86be-32c33440e047 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:23.452024 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ad5b1-1a0e-40d2-86be-32c33440e047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:23.470095 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4c2ad5b1-1a0e-40d2-86be-32c33440e047 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:59:23.471320 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4c2ad5b1-1a0e-40d2-86be-32c33440e047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:23.542329 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1201/2435] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:59:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:59:23.552167 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c7a57-fa63-47c5-8e65-5462ab10fc59 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:23.553582 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7e5c7a57-fa63-47c5-8e65-5462ab10fc59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:23.616734 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c7a57-fa63-47c5-8e65-5462ab10fc59 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:23.620781 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735d0c3-b6d2-4683-b181-833e4f6dafc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:23.621495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735d0c3-b6d2-4683-b181-833e4f6dafc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:23.621780 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735d0c3-b6d2-4683-b181-833e4f6dafc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:23.622036 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735d0c3-b6d2-4683-b181-833e4f6dafc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:23.632656 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735d0c3-b6d2-4683-b181-833e4f6dafc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:23.634165 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735d0c3-b6d2-4683-b181-833e4f6dafc6 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:23.643736 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1235/2436] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:59:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:59:23.942810 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ad5b1-1a0e-40d2-86be-32c33440e047 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:23.944492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4c2ad5b1-1a0e-40d2-86be-32c33440e047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:23.960268 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ad5b1-1a0e-40d2-86be-32c33440e047 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:23.965541 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf190e8-e716-4ce5-98b8-110bd03a7fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:23.966442 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf190e8-e716-4ce5-98b8-110bd03a7fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:23.966721 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf190e8-e716-4ce5-98b8-110bd03a7fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:23.966998 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf190e8-e716-4ce5-98b8-110bd03a7fe3 admin admin] PATH_INFO: `/v3/projects/204c2a3db453422eab59cb4ef296266f` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:23.968370 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf190e8-e716-4ce5-98b8-110bd03a7fe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=204c2a3db453422eab59cb4ef296266f)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:23.970348 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf190e8-e716-4ce5-98b8-110bd03a7fe3 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:23.987895 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:24.021447 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ecf190e8-e716-4ce5-98b8-110bd03a7fe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '204c2a3db453422eab59cb4ef296266f', 'request_id': 'req-ecf190e8-e716-4ce5-98b8-110bd03a7fe3'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:24.037875 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ecf190e8-e716-4ce5-98b8-110bd03a7fe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '204c2a3db453422eab59cb4ef296266f', 'request_id': 'req-ecf190e8-e716-4ce5-98b8-110bd03a7fe3'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:24.044905 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ecf190e8-e716-4ce5-98b8-110bd03a7fe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '204c2a3db453422eab59cb4ef296266f', 'request_id': 'req-ecf190e8-e716-4ce5-98b8-110bd03a7fe3'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:24.058541 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ecf190e8-e716-4ce5-98b8-110bd03a7fe3 admin admin] The token cache is being invalidate because project 204c2a3db453422eab59cb4ef296266f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:59:24.058776 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ecf190e8-e716-4ce5-98b8-110bd03a7fe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:24.059376 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ecf190e8-e716-4ce5-98b8-110bd03a7fe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:24.061059 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1202/2437] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 14:59:23 2022] DELETE /identity/v3/projects/204c2a3db453422eab59cb4ef296266f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:59:33.639476 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=84,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:34.055519 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=18,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:40.844684 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735d0c3-b6d2-4683-b181-833e4f6dafc6 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:40.847557 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c735d0c3-b6d2-4683-b181-833e4f6dafc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:41.001473 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735d0c3-b6d2-4683-b181-833e4f6dafc6 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:41.063540 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5c329-4189-4e4d-a41f-820e7aa31707 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819ad532defb4adaa2f4fd06b47630d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:41.064234 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5c329-4189-4e4d-a41f-820e7aa31707 service placement] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:41.064515 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5c329-4189-4e4d-a41f-820e7aa31707 service placement] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:41.064789 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5c329-4189-4e4d-a41f-820e7aa31707 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:41.066712 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c6f5c329-4189-4e4d-a41f-820e7aa31707 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:41.081294 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5c329-4189-4e4d-a41f-820e7aa31707 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:41.082942 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5c329-4189-4e4d-a41f-820e7aa31707 service placement] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:41.094064 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1236/2438] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 14:59:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:59:46.193454 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b52912-2dc9-4c52-9e78-3c0c22aec210 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:46.194098 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b52912-2dc9-4c52-9e78-3c0c22aec210 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:46.194098 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b52912-2dc9-4c52-9e78-3c0c22aec210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:46.215055 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-54b52912-2dc9-4c52-9e78-3c0c22aec210 None None] MFA Rules not processed for user `acad8c96446549e3b82b0e719ac92440`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:59:46.216834 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-54b52912-2dc9-4c52-9e78-3c0c22aec210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:46.276668 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1203/2439] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 14:59:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:59:51.089479 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=67 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:56.269510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=25 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:02.270235 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5c329-4189-4e4d-a41f-820e7aa31707 service placement] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:00:02.272285 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c6f5c329-4189-4e4d-a41f-820e7aa31707 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:00:02.356516 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5c329-4189-4e4d-a41f-820e7aa31707 service placement] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:00:02.362530 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ee607-6452-4740-b3ab-c6014e9cd351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:00:02.363490 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ee607-6452-4740-b3ab-c6014e9cd351 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:00:02.363996 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ee607-6452-4740-b3ab-c6014e9cd351 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:00:02.364450 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ee607-6452-4740-b3ab-c6014e9cd351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:00:02.367843 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ac2ee607-6452-4740-b3ab-c6014e9cd351 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:00:02.454248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ee607-6452-4740-b3ab-c6014e9cd351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:00:02.455619 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ee607-6452-4740-b3ab-c6014e9cd351 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:00:02.465887 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1237/2440] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:00:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:00:04.178092 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5820f-e034-4feb-b90d-cfdf9f65ee98 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:00:04.178668 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5820f-e034-4feb-b90d-cfdf9f65ee98 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:00:04.178668 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5820f-e034-4feb-b90d-cfdf9f65ee98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:00:04.200664 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3ac5820f-e034-4feb-b90d-cfdf9f65ee98 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:00:04.201892 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3ac5820f-e034-4feb-b90d-cfdf9f65ee98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:00:04.269479 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1204/2441] 10.222.0.91 () {58 vars in 1016 bytes} [Thu Jun 16 15:00:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:00:04.316558 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ee607-6452-4740-b3ab-c6014e9cd351 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:00:04.318267 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ac2ee607-6452-4740-b3ab-c6014e9cd351 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:00:04.399106 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ee607-6452-4740-b3ab-c6014e9cd351 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:00:04.405796 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9781155-9e04-4629-baaf-b49543a3ff98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:00:04.407858 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9781155-9e04-4629-baaf-b49543a3ff98 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:00:04.407858 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9781155-9e04-4629-baaf-b49543a3ff98 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:00:04.407858 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9781155-9e04-4629-baaf-b49543a3ff98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:00:04.417304 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9781155-9e04-4629-baaf-b49543a3ff98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:00:04.418924 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9781155-9e04-4629-baaf-b49543a3ff98 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:00:04.429789 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1238/2442] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:00:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:00:08.489309 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f6039-7bcd-44aa-8324-260520c40d7c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:00:08.489905 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f6039-7bcd-44aa-8324-260520c40d7c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:00:08.490010 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f6039-7bcd-44aa-8324-260520c40d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:00:08.510682 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-600f6039-7bcd-44aa-8324-260520c40d7c None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:00:08.512676 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-600f6039-7bcd-44aa-8324-260520c40d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:00:08.522773 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1205/2443] 10.222.0.91 () {58 vars in 1016 bytes} [Thu Jun 16 15:00:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:00:08.544697 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9781155-9e04-4629-baaf-b49543a3ff98 service nova] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:00:08.556186 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9781155-9e04-4629-baaf-b49543a3ff98 service nova] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:00:08.564433 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7dccaa-e08f-4bcb-bcf5-27071a5deb8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:00:08.565097 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7dccaa-e08f-4bcb-bcf5-27071a5deb8c service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:00:08.565401 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7dccaa-e08f-4bcb-bcf5-27071a5deb8c service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:00:08.565678 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7dccaa-e08f-4bcb-bcf5-27071a5deb8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:00:08.575390 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7dccaa-e08f-4bcb-bcf5-27071a5deb8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:00:08.576679 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7dccaa-e08f-4bcb-bcf5-27071a5deb8c service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:00:08.587372 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1239/2444] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:00:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:00:10.785194 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba64bf-7bea-4f71-b92b-5cf830cf1066 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:00:10.785738 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba64bf-7bea-4f71-b92b-5cf830cf1066 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:00:10.785738 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba64bf-7bea-4f71-b92b-5cf830cf1066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:00:10.807865 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-31ba64bf-7bea-4f71-b92b-5cf830cf1066 None None] MFA Rules not processed for user `431f66d8c09d4eb194600509e7300bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:00:10.809362 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-31ba64bf-7bea-4f71-b92b-5cf830cf1066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:00:10.867954 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1206/2445] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:00:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:00:12.632472 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a09b3-1f63-4a2d-963a-c1633bfbcdc0 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:00:12.633054 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a09b3-1f63-4a2d-963a-c1633bfbcdc0 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:00:12.633301 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a09b3-1f63-4a2d-963a-c1633bfbcdc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:00:12.652303 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b27a09b3-1f63-4a2d-963a-c1633bfbcdc0 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:00:12.653650 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b27a09b3-1f63-4a2d-963a-c1633bfbcdc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:00:12.662354 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1240/2446] 10.222.0.91 () {58 vars in 1016 bytes} [Thu Jun 16 15:00:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:00:12.690963 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba64bf-7bea-4f71-b92b-5cf830cf1066 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:00:12.692645 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-31ba64bf-7bea-4f71-b92b-5cf830cf1066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:00:12.713412 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba64bf-7bea-4f71-b92b-5cf830cf1066 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:00:12.720384 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad62b23-7488-4248-947e-e22e85c04aa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:00:12.721066 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad62b23-7488-4248-947e-e22e85c04aa2 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:00:12.721355 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad62b23-7488-4248-947e-e22e85c04aa2 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:00:12.721589 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad62b23-7488-4248-947e-e22e85c04aa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:00:12.731102 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad62b23-7488-4248-947e-e22e85c04aa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:00:12.732948 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad62b23-7488-4248-947e-e22e85c04aa2 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:00:12.743463 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1207/2447] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:00:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:00:17.894278 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f563b-d995-4352-b530-8bda48463037 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:00:17.894822 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f563b-d995-4352-b530-8bda48463037 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:00:17.894822 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f563b-d995-4352-b530-8bda48463037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:00:17.918957 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-6a6f563b-d995-4352-b530-8bda48463037 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:00:17.920239 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6a6f563b-d995-4352-b530-8bda48463037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:00:17.930250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1241/2448] 10.222.0.91 () {58 vars in 1016 bytes} [Thu Jun 16 15:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:00:17.953169 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad62b23-7488-4248-947e-e22e85c04aa2 service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:00:17.965075 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad62b23-7488-4248-947e-e22e85c04aa2 service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:00:17.971980 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728b8e6-86a9-41b1-8a04-a1e3af8b6c12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:00:17.972681 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728b8e6-86a9-41b1-8a04-a1e3af8b6c12 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:00:17.973010 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728b8e6-86a9-41b1-8a04-a1e3af8b6c12 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:00:17.973416 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728b8e6-86a9-41b1-8a04-a1e3af8b6c12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:00:17.982494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f728b8e6-86a9-41b1-8a04-a1e3af8b6c12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:00:17.984104 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f728b8e6-86a9-41b1-8a04-a1e3af8b6c12 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:00:17.994311 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1208/2449] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:00:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:00:26.202990 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248576ea-c643-4826-8522-854905707ab1 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:00:26.203911 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248576ea-c643-4826-8522-854905707ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:00:26.203911 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248576ea-c643-4826-8522-854905707ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:00:26.233757 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-248576ea-c643-4826-8522-854905707ab1 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:00:26.234960 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-248576ea-c643-4826-8522-854905707ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:00:26.245979 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1242/2450] 10.222.0.91 () {58 vars in 1016 bytes} [Thu Jun 16 15:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:00:26.270095 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728b8e6-86a9-41b1-8a04-a1e3af8b6c12 service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:00:26.275789 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=68 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:26.284178 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728b8e6-86a9-41b1-8a04-a1e3af8b6c12 service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:00:26.290287 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f36820-be7a-4665-8c8b-34ed00d1fcbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:00:26.290932 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f36820-be7a-4665-8c8b-34ed00d1fcbb service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:00:26.291192 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f36820-be7a-4665-8c8b-34ed00d1fcbb service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:00:26.291668 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f36820-be7a-4665-8c8b-34ed00d1fcbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:00:26.301380 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f36820-be7a-4665-8c8b-34ed00d1fcbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:00:26.302973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f36820-be7a-4665-8c8b-34ed00d1fcbb service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:00:26.312962 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1209/2451] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:00:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:00:36.226214 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:36.308248 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=5 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:43.730895 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21c263-3466-440b-9cee-c5c38ba5da20 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:00:43.731362 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21c263-3466-440b-9cee-c5c38ba5da20 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:00:43.731472 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21c263-3466-440b-9cee-c5c38ba5da20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:00:43.790954 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-4f21c263-3466-440b-9cee-c5c38ba5da20 None None] MFA Rules not processed for user `db4d36e6837d4b2fa4b7ee5c7243b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:00:43.792229 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4f21c263-3466-440b-9cee-c5c38ba5da20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:00:43.882172 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1243/2452] 10.222.0.85 () {58 vars in 1009 bytes} [Thu Jun 16 15:00:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:00:43.931464 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f36820-be7a-4665-8c8b-34ed00d1fcbb service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:00:43.933637 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-88f36820-be7a-4665-8c8b-34ed00d1fcbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:00:44.029910 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f36820-be7a-4665-8c8b-34ed00d1fcbb service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:00:44.035761 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225de1c-bb03-4e71-8854-4a55c475176c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf9c39de29324b0ca6329c9a171367c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:00:44.036448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225de1c-bb03-4e71-8854-4a55c475176c service swift] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:00:44.036733 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225de1c-bb03-4e71-8854-4a55c475176c service swift] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:00:44.037008 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225de1c-bb03-4e71-8854-4a55c475176c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:00:44.045125 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e225de1c-bb03-4e71-8854-4a55c475176c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:00:44.046719 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e225de1c-bb03-4e71-8854-4a55c475176c service swift] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:00:44.054842 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1210/2453] 10.222.0.85 () {60 vars in 1384 bytes} [Thu Jun 16 15:00:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 15:00:53.879020 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=40 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:54.051588 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=41 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:01.389316 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f26f8-ac60-4bb4-8cb2-1b2345b30572 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:01.389924 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f26f8-ac60-4bb4-8cb2-1b2345b30572 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:01.389924 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f26f8-ac60-4bb4-8cb2-1b2345b30572 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:01.391290 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1244/2454] 10.222.0.85 () {54 vars in 921 bytes} [Thu Jun 16 15:01:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 15:01:01.398196 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00797829-91e1-4b06-9497-3c3a0adcad22 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:01.399267 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00797829-91e1-4b06-9497-3c3a0adcad22 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:01.399698 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00797829-91e1-4b06-9497-3c3a0adcad22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:01.439471 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-00797829-91e1-4b06-9497-3c3a0adcad22 None None] MFA Rules not processed for user `c74e4d1bdaa64ed280cc5f4c8e79b842`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:01:01.440784 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-00797829-91e1-4b06-9497-3c3a0adcad22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:01:01.450559 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1211/2455] 10.222.0.85 () {58 vars in 1018 bytes} [Thu Jun 16 15:01:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:01:01.462609 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f26f8-ac60-4bb4-8cb2-1b2345b30572 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:01:01.464419 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-326f26f8-ac60-4bb4-8cb2-1b2345b30572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:01:01.562801 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f26f8-ac60-4bb4-8cb2-1b2345b30572 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:01:01.566789 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831d54d-91f4-4415-8063-c051ec3e98c6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819a7d47f644bc18e6d07a125826d76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:01:01.567434 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831d54d-91f4-4415-8063-c051ec3e98c6 service glance] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:01.567715 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831d54d-91f4-4415-8063-c051ec3e98c6 service glance] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:01.568026 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831d54d-91f4-4415-8063-c051ec3e98c6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:01.579900 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2831d54d-91f4-4415-8063-c051ec3e98c6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:01:01.581700 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2831d54d-91f4-4415-8063-c051ec3e98c6 service glance] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:01:01.595322 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1245/2456] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:01:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:01:01.669942 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868ef88-fc91-4c4f-a5d7-52abb94852c1 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:01.670254 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868ef88-fc91-4c4f-a5d7-52abb94852c1 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:01.670519 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868ef88-fc91-4c4f-a5d7-52abb94852c1 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:01.671986 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1212/2457] 10.222.0.85 () {54 vars in 921 bytes} [Thu Jun 16 15:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 15:01:01.676998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e991936-cdb4-43b4-b63c-965e5cb63e81 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:01.677288 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e991936-cdb4-43b4-b63c-965e5cb63e81 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:01.677562 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e991936-cdb4-43b4-b63c-965e5cb63e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:01.697301 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-4e991936-cdb4-43b4-b63c-965e5cb63e81 None None] MFA Rules not processed for user `3d3d59fabcf94718bbc005519cec6f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:01:01.698519 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4e991936-cdb4-43b4-b63c-965e5cb63e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:01:01.705404 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1246/2458] 10.222.0.85 () {58 vars in 1018 bytes} [Thu Jun 16 15:01:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:01:01.719905 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868ef88-fc91-4c4f-a5d7-52abb94852c1 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:01:01.721985 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4868ef88-fc91-4c4f-a5d7-52abb94852c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:01:01.737909 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868ef88-fc91-4c4f-a5d7-52abb94852c1 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:01:01.742139 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28c2f6-341b-41ed-84a7-660ca7c64dee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:01:01.742832 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28c2f6-341b-41ed-84a7-660ca7c64dee service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:01.743117 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28c2f6-341b-41ed-84a7-660ca7c64dee service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:01.743394 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28c2f6-341b-41ed-84a7-660ca7c64dee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:01.751526 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28c2f6-341b-41ed-84a7-660ca7c64dee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:01:01.753034 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28c2f6-341b-41ed-84a7-660ca7c64dee service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:01:01.761212 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1213/2459] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:01:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:01:01.852633 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95cb87-dd40-46da-98dc-84491b966a83 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:01.852918 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95cb87-dd40-46da-98dc-84491b966a83 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:01.853193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95cb87-dd40-46da-98dc-84491b966a83 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:01.854604 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1247/2460] 10.222.0.85 () {54 vars in 921 bytes} [Thu Jun 16 15:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 15:01:01.859852 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56217e8c-f011-4bae-a6cf-9fa71a0d1590 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:01.860174 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56217e8c-f011-4bae-a6cf-9fa71a0d1590 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:01.860580 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56217e8c-f011-4bae-a6cf-9fa71a0d1590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:01.881802 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-56217e8c-f011-4bae-a6cf-9fa71a0d1590 None None] MFA Rules not processed for user `c74e4d1bdaa64ed280cc5f4c8e79b842`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:01:01.883076 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-56217e8c-f011-4bae-a6cf-9fa71a0d1590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:01:01.893107 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1214/2461] 10.222.0.85 () {58 vars in 1018 bytes} [Thu Jun 16 15:01:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:01:01.904467 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba95cb87-dd40-46da-98dc-84491b966a83 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:01:01.923240 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba95cb87-dd40-46da-98dc-84491b966a83 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:01:01.927666 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420a202-728f-47b6-8adc-0f1a1a844573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:01:01.928328 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420a202-728f-47b6-8adc-0f1a1a844573 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:01.928613 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420a202-728f-47b6-8adc-0f1a1a844573 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:01.928888 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420a202-728f-47b6-8adc-0f1a1a844573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:01.940107 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5420a202-728f-47b6-8adc-0f1a1a844573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:01:01.941564 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5420a202-728f-47b6-8adc-0f1a1a844573 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:01:01.953209 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1248/2462] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:01:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:01:02.736834 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56217e8c-f011-4bae-a6cf-9fa71a0d1590 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:01:02.738465 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-56217e8c-f011-4bae-a6cf-9fa71a0d1590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:01:02.753189 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56217e8c-f011-4bae-a6cf-9fa71a0d1590 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:01:02.758800 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ab2a1-c0f3-4b1a-8f3a-97b7a25d59a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:01:02.759709 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ab2a1-c0f3-4b1a-8f3a-97b7a25d59a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:02.760024 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ab2a1-c0f3-4b1a-8f3a-97b7a25d59a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:02.760309 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ab2a1-c0f3-4b1a-8f3a-97b7a25d59a4 admin admin] PATH_INFO: `/v3/users/acad8c96446549e3b82b0e719ac92440` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:02.761523 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ab2a1-c0f3-4b1a-8f3a-97b7a25d59a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acad8c96446549e3b82b0e719ac92440)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:01:02.763500 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ab2a1-c0f3-4b1a-8f3a-97b7a25d59a4 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:01:02.822475 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4d7ab2a1-c0f3-4b1a-8f3a-97b7a25d59a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acad8c96446549e3b82b0e719ac92440'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:01:02.847186 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4d7ab2a1-c0f3-4b1a-8f3a-97b7a25d59a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acad8c96446549e3b82b0e719ac92440'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:01:02.858080 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4d7ab2a1-c0f3-4b1a-8f3a-97b7a25d59a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acad8c96446549e3b82b0e719ac92440'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:01:02.876446 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4d7ab2a1-c0f3-4b1a-8f3a-97b7a25d59a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acad8c96446549e3b82b0e719ac92440'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:01:02.878759 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4d7ab2a1-c0f3-4b1a-8f3a-97b7a25d59a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acad8c96446549e3b82b0e719ac92440'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:01:02.893354 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1215/2463] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 15:01:02 2022] DELETE /identity/v3/users/acad8c96446549e3b82b0e719ac92440 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:01:03.115366 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420a202-728f-47b6-8adc-0f1a1a844573 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:01:03.127793 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420a202-728f-47b6-8adc-0f1a1a844573 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:01:03.199332 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d5bd7-26b3-4fa5-8f37-2e22ec3f7e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:01:03.200236 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d5bd7-26b3-4fa5-8f37-2e22ec3f7e66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:03.200517 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d5bd7-26b3-4fa5-8f37-2e22ec3f7e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:03.200800 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d5bd7-26b3-4fa5-8f37-2e22ec3f7e66 admin admin] PATH_INFO: `/v3/projects/8156c04aa1314508a840ba350e2a1a13` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:03.202135 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d5bd7-26b3-4fa5-8f37-2e22ec3f7e66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8156c04aa1314508a840ba350e2a1a13)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:01:03.204301 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d5bd7-26b3-4fa5-8f37-2e22ec3f7e66 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:01:03.261405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d96d5bd7-26b3-4fa5-8f37-2e22ec3f7e66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8156c04aa1314508a840ba350e2a1a13', 'request_id': 'req-d96d5bd7-26b3-4fa5-8f37-2e22ec3f7e66'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:01:03.268361 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d96d5bd7-26b3-4fa5-8f37-2e22ec3f7e66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8156c04aa1314508a840ba350e2a1a13', 'request_id': 'req-d96d5bd7-26b3-4fa5-8f37-2e22ec3f7e66'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:01:03.275385 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d96d5bd7-26b3-4fa5-8f37-2e22ec3f7e66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8156c04aa1314508a840ba350e2a1a13', 'request_id': 'req-d96d5bd7-26b3-4fa5-8f37-2e22ec3f7e66'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:01:03.278666 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:03.292522 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d96d5bd7-26b3-4fa5-8f37-2e22ec3f7e66 admin admin] The token cache is being invalidate because project 8156c04aa1314508a840ba350e2a1a13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:01:03.292812 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d96d5bd7-26b3-4fa5-8f37-2e22ec3f7e66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:01:03.293501 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-d96d5bd7-26b3-4fa5-8f37-2e22ec3f7e66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:01:03.295019 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1249/2464] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:01:03 2022] DELETE /identity/v3/projects/8156c04aa1314508a840ba350e2a1a13 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:01:05.604884 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69e571-9481-4a36-a094-1dbba71cb24f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:05.605486 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69e571-9481-4a36-a094-1dbba71cb24f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:05.605486 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69e571-9481-4a36-a094-1dbba71cb24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:05.626056 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4c69e571-9481-4a36-a094-1dbba71cb24f None None] MFA Rules not processed for user `db4d36e6837d4b2fa4b7ee5c7243b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:01:05.627384 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4c69e571-9481-4a36-a094-1dbba71cb24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:01:05.686029 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1216/2465] 10.222.0.85 () {58 vars in 1009 bytes} [Thu Jun 16 15:01:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:01:05.698513 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d5bd7-26b3-4fa5-8f37-2e22ec3f7e66 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:01:05.700076 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d96d5bd7-26b3-4fa5-8f37-2e22ec3f7e66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:01:05.777844 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d5bd7-26b3-4fa5-8f37-2e22ec3f7e66 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:01:05.784532 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858b1ac-a357-4bae-a46d-38e4673bea75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf9c39de29324b0ca6329c9a171367c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:01:05.785171 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858b1ac-a357-4bae-a46d-38e4673bea75 service swift] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:05.785452 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858b1ac-a357-4bae-a46d-38e4673bea75 service swift] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:05.785720 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858b1ac-a357-4bae-a46d-38e4673bea75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:05.793942 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858b1ac-a357-4bae-a46d-38e4673bea75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:01:05.795533 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858b1ac-a357-4bae-a46d-38e4673bea75 service swift] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:01:05.804399 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1250/2466] 10.222.0.85 () {60 vars in 1384 bytes} [Thu Jun 16 15:01:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 15:01:15.678931 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=72,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:15.801325 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:DELETE=1,keystone:SELECT=34 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:27.227299 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c69e571-9481-4a36-a094-1dbba71cb24f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:01:27.228660 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4c69e571-9481-4a36-a094-1dbba71cb24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:01:27.238346 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858b1ac-a357-4bae-a46d-38e4673bea75 service swift] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:01:27.239809 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-3858b1ac-a357-4bae-a46d-38e4673bea75 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:01:27.292685 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c69e571-9481-4a36-a094-1dbba71cb24f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:01:27.296758 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfe1c0-6e3a-4014-9092-0d1ea39197d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:01:27.297410 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfe1c0-6e3a-4014-9092-0d1ea39197d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:27.297688 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfe1c0-6e3a-4014-9092-0d1ea39197d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:27.298004 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfe1c0-6e3a-4014-9092-0d1ea39197d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:27.299969 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-19cfe1c0-6e3a-4014-9092-0d1ea39197d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:01:27.305416 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858b1ac-a357-4bae-a46d-38e4673bea75 service swift] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:01:27.309214 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd609c-aa63-4ee1-a51e-99e5cfd0d184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:01:27.309861 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd609c-aa63-4ee1-a51e-99e5cfd0d184 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:27.310142 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd609c-aa63-4ee1-a51e-99e5cfd0d184 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:27.310466 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd609c-aa63-4ee1-a51e-99e5cfd0d184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:27.312572 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-fddd609c-aa63-4ee1-a51e-99e5cfd0d184 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:01:27.384842 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cfe1c0-6e3a-4014-9092-0d1ea39197d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:01:27.386518 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cfe1c0-6e3a-4014-9092-0d1ea39197d5 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:01:27.387767 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd609c-aa63-4ee1-a51e-99e5cfd0d184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:01:27.389250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd609c-aa63-4ee1-a51e-99e5cfd0d184 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:01:27.399694 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1217/2467] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:01:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:01:27.401556 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1251/2468] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:01:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:01:30.071822 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcf547-c4d7-49fd-b24e-c4bd4cae7e85 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:30.072413 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcf547-c4d7-49fd-b24e-c4bd4cae7e85 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:30.072547 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcf547-c4d7-49fd-b24e-c4bd4cae7e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:30.090144 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3cbcf547-c4d7-49fd-b24e-c4bd4cae7e85 None None] MFA Rules not processed for user `4e10f63b54224607996ab53536ad00d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:01:30.091390 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3cbcf547-c4d7-49fd-b24e-c4bd4cae7e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:01:30.160625 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1218/2469] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:01:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:01:31.363675 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17924a-9770-423d-8fcf-9939d8d99ace None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:31.364259 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17924a-9770-423d-8fcf-9939d8d99ace None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:31.364259 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17924a-9770-423d-8fcf-9939d8d99ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:31.382347 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-5a17924a-9770-423d-8fcf-9939d8d99ace None None] MFA Rules not processed for user `db4d36e6837d4b2fa4b7ee5c7243b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:01:31.383586 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5a17924a-9770-423d-8fcf-9939d8d99ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:01:31.392280 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1252/2470] 10.222.0.85 () {58 vars in 967 bytes} [Thu Jun 16 15:01:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:01:31.405700 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcf547-c4d7-49fd-b24e-c4bd4cae7e85 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:01:31.420366 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcf547-c4d7-49fd-b24e-c4bd4cae7e85 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:01:31.427295 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff4165-0962-4ada-8176-8809c9691d9b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf9c39de29324b0ca6329c9a171367c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:01:31.428279 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff4165-0962-4ada-8176-8809c9691d9b service swift] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:31.428540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff4165-0962-4ada-8176-8809c9691d9b service swift] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:31.428827 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff4165-0962-4ada-8176-8809c9691d9b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:31.438658 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff4165-0962-4ada-8176-8809c9691d9b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:01:31.440293 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff4165-0962-4ada-8176-8809c9691d9b service swift] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:01:31.448577 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1219/2471] 10.222.0.85 () {60 vars in 1384 bytes} [Thu Jun 16 15:01:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 15:01:41.377397 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=57 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:41.445263 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=85 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:02:01.678639 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17924a-9770-423d-8fcf-9939d8d99ace None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:02:01.690119 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17924a-9770-423d-8fcf-9939d8d99ace None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:02:01.695123 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522216cd-b665-478b-bd7c-1a6903b30f4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:02:01.695913 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522216cd-b665-478b-bd7c-1a6903b30f4c service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:02:01.696265 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522216cd-b665-478b-bd7c-1a6903b30f4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:02:01.696619 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522216cd-b665-478b-bd7c-1a6903b30f4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:02:01.698908 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-522216cd-b665-478b-bd7c-1a6903b30f4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:02:01.710405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522216cd-b665-478b-bd7c-1a6903b30f4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:02:01.712015 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522216cd-b665-478b-bd7c-1a6903b30f4c service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:02:01.721955 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1253/2472] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:02:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:02:11.717707 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=6 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:02:28.648084 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff4165-0962-4ada-8176-8809c9691d9b service swift] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:02:28.649850 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-adff4165-0962-4ada-8176-8809c9691d9b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:02:28.667458 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff4165-0962-4ada-8176-8809c9691d9b service swift] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:02:28.673632 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66ce3a-93ea-420a-80a8-df9a5b9f7c31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:02:28.674279 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66ce3a-93ea-420a-80a8-df9a5b9f7c31 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:02:28.674589 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66ce3a-93ea-420a-80a8-df9a5b9f7c31 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:02:28.674866 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66ce3a-93ea-420a-80a8-df9a5b9f7c31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:02:28.676853 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-bf66ce3a-93ea-420a-80a8-df9a5b9f7c31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:02:28.740717 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66ce3a-93ea-420a-80a8-df9a5b9f7c31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:02:28.743638 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66ce3a-93ea-420a-80a8-df9a5b9f7c31 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:02:28.754228 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1220/2473] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:02:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:02:32.196297 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522216cd-b665-478b-bd7c-1a6903b30f4c service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:02:32.214025 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522216cd-b665-478b-bd7c-1a6903b30f4c service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:02:32.222076 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a66fd9-ee43-4675-a699-6182f78685bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:02:32.222957 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a66fd9-ee43-4675-a699-6182f78685bb service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:02:32.223109 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a66fd9-ee43-4675-a699-6182f78685bb service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:02:32.223246 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a66fd9-ee43-4675-a699-6182f78685bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:02:32.226791 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-74a66fd9-ee43-4675-a699-6182f78685bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:02:32.241082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a66fd9-ee43-4675-a699-6182f78685bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:02:32.242707 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a66fd9-ee43-4675-a699-6182f78685bb service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:02:32.254446 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1254/2474] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:02:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:02:38.749481 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=28 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:02:41.654846 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cd1d4-0e20-4920-b1ce-3631e380bdbe None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:02:41.655963 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cd1d4-0e20-4920-b1ce-3631e380bdbe None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:02:41.655963 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cd1d4-0e20-4920-b1ce-3631e380bdbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:02:41.673294 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f79cd1d4-0e20-4920-b1ce-3631e380bdbe None None] MFA Rules not processed for user `431f66d8c09d4eb194600509e7300bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:02:41.674518 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f79cd1d4-0e20-4920-b1ce-3631e380bdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:02:41.685969 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1221/2475] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:02:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:02:42.016030 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a66fd9-ee43-4675-a699-6182f78685bb service nova] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:02:42.027153 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a66fd9-ee43-4675-a699-6182f78685bb service nova] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:02:42.031523 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d62c2c-802b-44b9-b08c-f5c3437a6899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:02:42.032233 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d62c2c-802b-44b9-b08c-f5c3437a6899 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:02:42.032518 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d62c2c-802b-44b9-b08c-f5c3437a6899 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:02:42.032795 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d62c2c-802b-44b9-b08c-f5c3437a6899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:02:42.034781 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-73d62c2c-802b-44b9-b08c-f5c3437a6899 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:02:42.045516 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d62c2c-802b-44b9-b08c-f5c3437a6899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:02:42.046956 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d62c2c-802b-44b9-b08c-f5c3437a6899 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:02:42.055426 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1255/2476] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:02:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:02:42.388042 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cd1d4-0e20-4920-b1ce-3631e380bdbe None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:02:42.389798 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f79cd1d4-0e20-4920-b1ce-3631e380bdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:02:42.483918 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cd1d4-0e20-4920-b1ce-3631e380bdbe None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:02:42.490030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174655ee-2f08-4880-8e88-1228fd26122d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819ad532defb4adaa2f4fd06b47630d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:02:42.490692 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174655ee-2f08-4880-8e88-1228fd26122d service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:02:42.490975 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174655ee-2f08-4880-8e88-1228fd26122d service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:02:42.491249 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174655ee-2f08-4880-8e88-1228fd26122d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:02:42.493371 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-174655ee-2f08-4880-8e88-1228fd26122d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:02:42.506186 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174655ee-2f08-4880-8e88-1228fd26122d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:02:42.507806 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174655ee-2f08-4880-8e88-1228fd26122d service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:02:42.519184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1222/2477] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:02:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:02:44.239295 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d62c2c-802b-44b9-b08c-f5c3437a6899 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:02:44.241207 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-73d62c2c-802b-44b9-b08c-f5c3437a6899 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:02:44.334518 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d62c2c-802b-44b9-b08c-f5c3437a6899 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:02:44.338431 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30680f-19d1-459f-b8a4-3b08b4229a2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:02:44.339314 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30680f-19d1-459f-b8a4-3b08b4229a2b service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:02:44.339599 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30680f-19d1-459f-b8a4-3b08b4229a2b service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:02:44.339861 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30680f-19d1-459f-b8a4-3b08b4229a2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:02:44.341957 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6b30680f-19d1-459f-b8a4-3b08b4229a2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:02:44.359687 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30680f-19d1-459f-b8a4-3b08b4229a2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:02:44.359687 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30680f-19d1-459f-b8a4-3b08b4229a2b service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:02:44.367266 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1256/2478] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:02:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:02:49.162144 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174655ee-2f08-4880-8e88-1228fd26122d service placement] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:02:49.164125 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-174655ee-2f08-4880-8e88-1228fd26122d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:02:49.186379 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174655ee-2f08-4880-8e88-1228fd26122d service placement] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:02:49.196518 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ab114-289a-4bc8-ba6f-796a4116e0c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:02:49.197284 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ab114-289a-4bc8-ba6f-796a4116e0c5 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:02:49.197618 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ab114-289a-4bc8-ba6f-796a4116e0c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:02:49.197894 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ab114-289a-4bc8-ba6f-796a4116e0c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:02:49.200798 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-909ab114-289a-4bc8-ba6f-796a4116e0c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:02:49.275781 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ab114-289a-4bc8-ba6f-796a4116e0c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:02:49.277408 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ab114-289a-4bc8-ba6f-796a4116e0c5 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:02:49.286982 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1223/2479] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:02:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:02:53.943672 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30680f-19d1-459f-b8a4-3b08b4229a2b service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:02:53.968947 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30680f-19d1-459f-b8a4-3b08b4229a2b service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:02:53.976706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989c3d1-e79f-4076-b521-cf62a401e6f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:02:53.977563 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989c3d1-e79f-4076-b521-cf62a401e6f5 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:02:53.978181 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989c3d1-e79f-4076-b521-cf62a401e6f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:02:53.978610 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989c3d1-e79f-4076-b521-cf62a401e6f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:02:53.981219 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4989c3d1-e79f-4076-b521-cf62a401e6f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:02:53.998143 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989c3d1-e79f-4076-b521-cf62a401e6f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:02:54.000321 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989c3d1-e79f-4076-b521-cf62a401e6f5 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:02:54.024099 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1257/2480] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:02:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:02:59.282941 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=63 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:01.812433 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ecf76-64ee-490d-b952-901de74433de None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:01.813045 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ecf76-64ee-490d-b952-901de74433de None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:01.813045 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ecf76-64ee-490d-b952-901de74433de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:01.831711 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-530ecf76-64ee-490d-b952-901de74433de None None] MFA Rules not processed for user `74029b3845b4408bb58332e21e801ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:01.833213 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-530ecf76-64ee-490d-b952-901de74433de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:01.841125 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1224/2481] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:03:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:02.175801 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989c3d1-e79f-4076-b521-cf62a401e6f5 service nova] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:02.181265 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=54 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:02.187070 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989c3d1-e79f-4076-b521-cf62a401e6f5 service nova] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:02.192053 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d579f14-0c8e-4229-b0d1-6cceec5bda69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:02.192900 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d579f14-0c8e-4229-b0d1-6cceec5bda69 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:02.193186 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d579f14-0c8e-4229-b0d1-6cceec5bda69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:02.193459 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d579f14-0c8e-4229-b0d1-6cceec5bda69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:02.195682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-0d579f14-0c8e-4229-b0d1-6cceec5bda69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:02.207455 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d579f14-0c8e-4229-b0d1-6cceec5bda69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:02.209231 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d579f14-0c8e-4229-b0d1-6cceec5bda69 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:02.218914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1258/2482] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:11.825923 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:12.214983 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=5 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:15.735671 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ecf76-64ee-490d-b952-901de74433de None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:15.737382 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-530ecf76-64ee-490d-b952-901de74433de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:15.751521 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ecf76-64ee-490d-b952-901de74433de None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:15.755588 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03825e-609e-4d0e-9d45-9fd6ae1e0e34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:15.756269 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03825e-609e-4d0e-9d45-9fd6ae1e0e34 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:15.756533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03825e-609e-4d0e-9d45-9fd6ae1e0e34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:15.756804 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03825e-609e-4d0e-9d45-9fd6ae1e0e34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:15.758628 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2e03825e-609e-4d0e-9d45-9fd6ae1e0e34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:15.839508 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03825e-609e-4d0e-9d45-9fd6ae1e0e34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:15.841041 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03825e-609e-4d0e-9d45-9fd6ae1e0e34 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:15.851597 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1225/2483] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:19.193761 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d579f14-0c8e-4229-b0d1-6cceec5bda69 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:19.208298 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d579f14-0c8e-4229-b0d1-6cceec5bda69 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:19.215128 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be100202-fed3-43eb-94a1-d37b236f6226 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819ad532defb4adaa2f4fd06b47630d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:19.216498 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be100202-fed3-43eb-94a1-d37b236f6226 service placement] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:19.219401 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be100202-fed3-43eb-94a1-d37b236f6226 service placement] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:19.220187 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be100202-fed3-43eb-94a1-d37b236f6226 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:19.223173 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-be100202-fed3-43eb-94a1-d37b236f6226 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:19.239307 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be100202-fed3-43eb-94a1-d37b236f6226 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:19.242300 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be100202-fed3-43eb-94a1-d37b236f6226 service placement] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:19.268695 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03825e-609e-4d0e-9d45-9fd6ae1e0e34 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:19.270601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2e03825e-609e-4d0e-9d45-9fd6ae1e0e34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:19.283122 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1259/2484] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:19.284857 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03825e-609e-4d0e-9d45-9fd6ae1e0e34 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:19.290483 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2504a4-bd2b-4702-954c-0d451ce10089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:19.291612 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2504a4-bd2b-4702-954c-0d451ce10089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:19.292119 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2504a4-bd2b-4702-954c-0d451ce10089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:19.292401 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2504a4-bd2b-4702-954c-0d451ce10089 admin admin] PATH_INFO: `/v3/users/4e10f63b54224607996ab53536ad00d9` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:19.293830 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2504a4-bd2b-4702-954c-0d451ce10089 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e10f63b54224607996ab53536ad00d9)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:19.296461 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2504a4-bd2b-4702-954c-0d451ce10089 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:19.350007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cf2504a4-bd2b-4702-954c-0d451ce10089 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e10f63b54224607996ab53536ad00d9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:19.357023 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cf2504a4-bd2b-4702-954c-0d451ce10089 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e10f63b54224607996ab53536ad00d9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:19.364964 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cf2504a4-bd2b-4702-954c-0d451ce10089 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e10f63b54224607996ab53536ad00d9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:19.378796 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cf2504a4-bd2b-4702-954c-0d451ce10089 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e10f63b54224607996ab53536ad00d9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:19.379559 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cf2504a4-bd2b-4702-954c-0d451ce10089 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e10f63b54224607996ab53536ad00d9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:19.386410 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1226/2485] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 15:03:19 2022] DELETE /identity/v3/users/4e10f63b54224607996ab53536ad00d9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:19.664866 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be100202-fed3-43eb-94a1-d37b236f6226 service placement] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:19.678407 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be100202-fed3-43eb-94a1-d37b236f6226 service placement] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:19.745731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49caeb3-fdc9-4040-b6f1-37d8dc46af6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:19.746729 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49caeb3-fdc9-4040-b6f1-37d8dc46af6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:19.747014 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49caeb3-fdc9-4040-b6f1-37d8dc46af6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:19.747287 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49caeb3-fdc9-4040-b6f1-37d8dc46af6a admin admin] PATH_INFO: `/v3/projects/22dc3a026fe4422587250fa88aa14141` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:19.748551 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49caeb3-fdc9-4040-b6f1-37d8dc46af6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=22dc3a026fe4422587250fa88aa14141)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:19.751073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49caeb3-fdc9-4040-b6f1-37d8dc46af6a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:19.805053 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b49caeb3-fdc9-4040-b6f1-37d8dc46af6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22dc3a026fe4422587250fa88aa14141', 'request_id': 'req-b49caeb3-fdc9-4040-b6f1-37d8dc46af6a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:19.811282 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b49caeb3-fdc9-4040-b6f1-37d8dc46af6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22dc3a026fe4422587250fa88aa14141', 'request_id': 'req-b49caeb3-fdc9-4040-b6f1-37d8dc46af6a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:19.818893 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b49caeb3-fdc9-4040-b6f1-37d8dc46af6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22dc3a026fe4422587250fa88aa14141', 'request_id': 'req-b49caeb3-fdc9-4040-b6f1-37d8dc46af6a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:19.832339 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b49caeb3-fdc9-4040-b6f1-37d8dc46af6a admin admin] The token cache is being invalidate because project 22dc3a026fe4422587250fa88aa14141 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:03:19.832623 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b49caeb3-fdc9-4040-b6f1-37d8dc46af6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:19.833252 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b49caeb3-fdc9-4040-b6f1-37d8dc46af6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:19.835315 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1260/2486] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:03:19 2022] DELETE /identity/v3/projects/22dc3a026fe4422587250fa88aa14141 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:19.841644 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b62ee-7d93-4963-9fc6-e4e61d51fa23 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:19.841962 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b62ee-7d93-4963-9fc6-e4e61d51fa23 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:19.842239 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b62ee-7d93-4963-9fc6-e4e61d51fa23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:19.861399 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-088b62ee-7d93-4963-9fc6-e4e61d51fa23 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:19.862638 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-088b62ee-7d93-4963-9fc6-e4e61d51fa23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:19.939270 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1227/2487] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:03:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:19.948275 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6ba49-6d46-4ab6-9162-f4ee5b928531 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:19.948716 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6ba49-6d46-4ab6-9162-f4ee5b928531 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:19.949123 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6ba49-6d46-4ab6-9162-f4ee5b928531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:19.972244 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-c5c6ba49-6d46-4ab6-9162-f4ee5b928531 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:19.973488 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c5c6ba49-6d46-4ab6-9162-f4ee5b928531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:19.981980 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1261/2488] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:03:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:19.986971 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b62ee-7d93-4963-9fc6-e4e61d51fa23 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:19.997619 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b62ee-7d93-4963-9fc6-e4e61d51fa23 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:20.004686 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16250a3c-fa5e-4c3d-b1e5-b9fe078d3b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:20.005598 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16250a3c-fa5e-4c3d-b1e5-b9fe078d3b20 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:20.005878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16250a3c-fa5e-4c3d-b1e5-b9fe078d3b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:20.006152 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16250a3c-fa5e-4c3d-b1e5-b9fe078d3b20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:20.006975 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16250a3c-fa5e-4c3d-b1e5-b9fe078d3b20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:03:20.007288 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16250a3c-fa5e-4c3d-b1e5-b9fe078d3b20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:20.009016 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16250a3c-fa5e-4c3d-b1e5-b9fe078d3b20 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:20.011794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:20.026382 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1228/2489] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 15:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:03:20.031579 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6ba49-6d46-4ab6-9162-f4ee5b928531 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:20.041697 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6ba49-6d46-4ab6-9162-f4ee5b928531 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:20.048051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58709a-9247-4df4-a0d0-f0b10fdd0ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:20.048743 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58709a-9247-4df4-a0d0-f0b10fdd0ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:20.049023 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58709a-9247-4df4-a0d0-f0b10fdd0ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:20.049293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58709a-9247-4df4-a0d0-f0b10fdd0ac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:20.049999 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b58709a-9247-4df4-a0d0-f0b10fdd0ac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:20.052076 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b58709a-9247-4df4-a0d0-f0b10fdd0ac1 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:20.100147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1262/2490] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 15:03:20 2022] POST /identity/v3/projects => generated 367 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:03:20.105157 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16250a3c-fa5e-4c3d-b1e5-b9fe078d3b20 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:20.118282 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16250a3c-fa5e-4c3d-b1e5-b9fe078d3b20 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:20.186406 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6659e-0a48-4114-bcc2-d663d52a222a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:20.187135 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6659e-0a48-4114-bcc2-d663d52a222a admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:20.187421 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6659e-0a48-4114-bcc2-d663d52a222a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:20.188471 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6659e-0a48-4114-bcc2-d663d52a222a admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:20.189211 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b6659e-0a48-4114-bcc2-d663d52a222a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:20.191263 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b6659e-0a48-4114-bcc2-d663d52a222a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:20.219329 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1229/2491] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 15:03:20 2022] POST /identity/v3/users => generated 284 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:20.223628 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58709a-9247-4df4-a0d0-f0b10fdd0ac1 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:20.241017 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58709a-9247-4df4-a0d0-f0b10fdd0ac1 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:20.243359 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd78e9-f2c5-4c73-b3cf-a483ebc39cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:20.244093 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd78e9-f2c5-4c73-b3cf-a483ebc39cfb admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:20.244386 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd78e9-f2c5-4c73-b3cf-a483ebc39cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:20.244655 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd78e9-f2c5-4c73-b3cf-a483ebc39cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:20.245788 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd78e9-f2c5-4c73-b3cf-a483ebc39cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:20.247624 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd78e9-f2c5-4c73-b3cf-a483ebc39cfb admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:20.259918 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1263/2492] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:20.264575 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6659e-0a48-4114-bcc2-d663d52a222a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:20.276148 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6659e-0a48-4114-bcc2-d663d52a222a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:20.281569 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca84b3-ab22-4a4e-8e7a-d192696234d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:20.282271 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca84b3-ab22-4a4e-8e7a-d192696234d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:20.282598 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca84b3-ab22-4a4e-8e7a-d192696234d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:20.282835 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca84b3-ab22-4a4e-8e7a-d192696234d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:20.283566 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca84b3-ab22-4a4e-8e7a-d192696234d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:20.285234 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca84b3-ab22-4a4e-8e7a-d192696234d6 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:20.296637 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1230/2493] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:03:20.300714 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd78e9-f2c5-4c73-b3cf-a483ebc39cfb admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:20.311671 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd78e9-f2c5-4c73-b3cf-a483ebc39cfb admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:20.317528 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c39e7-a0f7-4a7a-b775-edbd119bb67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:20.318791 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c39e7-a0f7-4a7a-b775-edbd119bb67b admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:20.319248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c39e7-a0f7-4a7a-b775-edbd119bb67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:20.319487 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c39e7-a0f7-4a7a-b775-edbd119bb67b admin admin] PATH_INFO: `/v3/projects/a2ff9abf6c194a4a9335756b07305c7d/users/b7cbac4d7a71458eb63ed887811102e1/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:20.344071 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c39e7-a0f7-4a7a-b775-edbd119bb67b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2ff9abf6c194a4a9335756b07305c7d, user_id=b7cbac4d7a71458eb63ed887811102e1, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:20.347299 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c39e7-a0f7-4a7a-b775-edbd119bb67b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:20.363546 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1264/2494] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:20 2022] PUT /identity/v3/projects/a2ff9abf6c194a4a9335756b07305c7d/users/b7cbac4d7a71458eb63ed887811102e1/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:03:20.375333 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e0471-315c-4b8f-b771-fbc1aa5fac61 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:20.375855 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e0471-315c-4b8f-b771-fbc1aa5fac61 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:20.376402 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e0471-315c-4b8f-b771-fbc1aa5fac61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:20.415132 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e43e0471-315c-4b8f-b771-fbc1aa5fac61 None None] MFA Rules not processed for user `b7cbac4d7a71458eb63ed887811102e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:20.417293 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e43e0471-315c-4b8f-b771-fbc1aa5fac61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:20.513773 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1231/2495] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:03:20 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:20.524914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c39e7-a0f7-4a7a-b775-edbd119bb67b admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:20.526830 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-0c7c39e7-a0f7-4a7a-b775-edbd119bb67b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:20.534139 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:20.593849 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c39e7-a0f7-4a7a-b775-edbd119bb67b admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:20.597870 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aaa8c4-4beb-499c-ab0c-c06dee9778ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:20.598529 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aaa8c4-4beb-499c-ab0c-c06dee9778ea service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:20.598811 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aaa8c4-4beb-499c-ab0c-c06dee9778ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:20.599085 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aaa8c4-4beb-499c-ab0c-c06dee9778ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:20.608540 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aaa8c4-4beb-499c-ab0c-c06dee9778ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:20.610036 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aaa8c4-4beb-499c-ab0c-c06dee9778ea service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:20.619206 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1265/2496] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:20 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:25.873538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e0471-315c-4b8f-b771-fbc1aa5fac61 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:25.876760 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e43e0471-315c-4b8f-b771-fbc1aa5fac61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:26.029919 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:26.051967 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e0471-315c-4b8f-b771-fbc1aa5fac61 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:26.059011 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be849a41-4781-44ed-bfae-bbcccff9a066 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:26.059723 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be849a41-4781-44ed-bfae-bbcccff9a066 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:26.060031 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be849a41-4781-44ed-bfae-bbcccff9a066 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:26.060359 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be849a41-4781-44ed-bfae-bbcccff9a066 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:26.062281 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-be849a41-4781-44ed-bfae-bbcccff9a066 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:26.082899 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be849a41-4781-44ed-bfae-bbcccff9a066 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:26.085903 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be849a41-4781-44ed-bfae-bbcccff9a066 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:26.115817 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1232/2497] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:29.604441 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aaa8c4-4beb-499c-ab0c-c06dee9778ea service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:29.678499 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aaa8c4-4beb-499c-ab0c-c06dee9778ea service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:29.685668 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93fbd7-d160-44de-921d-e6b9c5fdf7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:29.686575 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93fbd7-d160-44de-921d-e6b9c5fdf7ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:29.686853 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93fbd7-d160-44de-921d-e6b9c5fdf7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:29.690322 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93fbd7-d160-44de-921d-e6b9c5fdf7ca admin admin] PATH_INFO: `/v3/users/b7cbac4d7a71458eb63ed887811102e1` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:29.690322 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df93fbd7-d160-44de-921d-e6b9c5fdf7ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7cbac4d7a71458eb63ed887811102e1)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:29.690551 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df93fbd7-d160-44de-921d-e6b9c5fdf7ca admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:29.766163 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-df93fbd7-d160-44de-921d-e6b9c5fdf7ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7cbac4d7a71458eb63ed887811102e1'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:29.779841 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-df93fbd7-d160-44de-921d-e6b9c5fdf7ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7cbac4d7a71458eb63ed887811102e1'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:29.781111 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-df93fbd7-d160-44de-921d-e6b9c5fdf7ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7cbac4d7a71458eb63ed887811102e1'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:29.794366 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-df93fbd7-d160-44de-921d-e6b9c5fdf7ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7cbac4d7a71458eb63ed887811102e1'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:29.805969 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-df93fbd7-d160-44de-921d-e6b9c5fdf7ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7cbac4d7a71458eb63ed887811102e1'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:29.814928 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1266/2498] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 15:03:29 2022] DELETE /identity/v3/users/b7cbac4d7a71458eb63ed887811102e1 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:29.819652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403a729-9e8d-458f-a521-d24a1985dfef None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:29.820226 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403a729-9e8d-458f-a521-d24a1985dfef None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:29.820226 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403a729-9e8d-458f-a521-d24a1985dfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:29.838951 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-6403a729-9e8d-458f-a521-d24a1985dfef None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:29.840236 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6403a729-9e8d-458f-a521-d24a1985dfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:29.910141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1233/2499] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:29.920946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93fbd7-d160-44de-921d-e6b9c5fdf7ca admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:29.922592 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-df93fbd7-d160-44de-921d-e6b9c5fdf7ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:29.963959 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:29.998591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93fbd7-d160-44de-921d-e6b9c5fdf7ca admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:30.005217 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e416569f-c16b-4a40-82ed-14370bc2205a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:30.005919 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e416569f-c16b-4a40-82ed-14370bc2205a service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:30.006324 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e416569f-c16b-4a40-82ed-14370bc2205a service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:30.006605 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e416569f-c16b-4a40-82ed-14370bc2205a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:30.018742 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e416569f-c16b-4a40-82ed-14370bc2205a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:30.020467 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e416569f-c16b-4a40-82ed-14370bc2205a service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:30.032925 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1267/2500] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:30.364044 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403a729-9e8d-458f-a521-d24a1985dfef None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:30.365662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6403a729-9e8d-458f-a521-d24a1985dfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:30.378793 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403a729-9e8d-458f-a521-d24a1985dfef None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:30.383761 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467cd3e4-e8c7-43fe-b84c-1fa1728919e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:30.384705 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cd3e4-e8c7-43fe-b84c-1fa1728919e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:30.384994 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cd3e4-e8c7-43fe-b84c-1fa1728919e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:30.385643 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cd3e4-e8c7-43fe-b84c-1fa1728919e2 admin admin] PATH_INFO: `/v3/projects/a2ff9abf6c194a4a9335756b07305c7d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:30.392410 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467cd3e4-e8c7-43fe-b84c-1fa1728919e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2ff9abf6c194a4a9335756b07305c7d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:30.394534 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467cd3e4-e8c7-43fe-b84c-1fa1728919e2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:30.449988 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-467cd3e4-e8c7-43fe-b84c-1fa1728919e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2ff9abf6c194a4a9335756b07305c7d', 'request_id': 'req-467cd3e4-e8c7-43fe-b84c-1fa1728919e2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:30.456507 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-467cd3e4-e8c7-43fe-b84c-1fa1728919e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2ff9abf6c194a4a9335756b07305c7d', 'request_id': 'req-467cd3e4-e8c7-43fe-b84c-1fa1728919e2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:30.462296 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-467cd3e4-e8c7-43fe-b84c-1fa1728919e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2ff9abf6c194a4a9335756b07305c7d', 'request_id': 'req-467cd3e4-e8c7-43fe-b84c-1fa1728919e2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:30.476128 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-467cd3e4-e8c7-43fe-b84c-1fa1728919e2 admin admin] The token cache is being invalidate because project a2ff9abf6c194a4a9335756b07305c7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:03:30.476437 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-467cd3e4-e8c7-43fe-b84c-1fa1728919e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:30.477082 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-467cd3e4-e8c7-43fe-b84c-1fa1728919e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:30.478916 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1234/2501] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:03:30 2022] DELETE /identity/v3/projects/a2ff9abf6c194a4a9335756b07305c7d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:30.484165 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7b225-28dd-4183-91d9-803135a80889 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:30.484442 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7b225-28dd-4183-91d9-803135a80889 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:30.484734 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7b225-28dd-4183-91d9-803135a80889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:30.506354 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-21c7b225-28dd-4183-91d9-803135a80889 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:30.507773 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-21c7b225-28dd-4183-91d9-803135a80889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:30.582617 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1268/2502] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:03:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:30.592865 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549738c-6a0d-4b13-9f1f-f57e061836a9 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:30.593167 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549738c-6a0d-4b13-9f1f-f57e061836a9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:30.593428 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549738c-6a0d-4b13-9f1f-f57e061836a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:30.615862 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e549738c-6a0d-4b13-9f1f-f57e061836a9 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:30.617126 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e549738c-6a0d-4b13-9f1f-f57e061836a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:30.626643 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1235/2503] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:03:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:30.631062 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7b225-28dd-4183-91d9-803135a80889 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:30.643822 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7b225-28dd-4183-91d9-803135a80889 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:30.648869 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6b070-56c9-47e6-99db-31e33a64aaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:30.649531 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6b070-56c9-47e6-99db-31e33a64aaf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:30.649815 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6b070-56c9-47e6-99db-31e33a64aaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:30.650113 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6b070-56c9-47e6-99db-31e33a64aaf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:30.650876 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b6b070-56c9-47e6-99db-31e33a64aaf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:03:30.651182 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b6b070-56c9-47e6-99db-31e33a64aaf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:30.652846 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b6b070-56c9-47e6-99db-31e33a64aaf1 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:30.666043 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1269/2504] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 15:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:03:30.671744 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e549738c-6a0d-4b13-9f1f-f57e061836a9 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:30.685392 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e549738c-6a0d-4b13-9f1f-f57e061836a9 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:30.691024 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db570a-a58c-48f9-be4d-0cf680bcf192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:30.696880 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db570a-a58c-48f9-be4d-0cf680bcf192 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:30.696880 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db570a-a58c-48f9-be4d-0cf680bcf192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:30.696880 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db570a-a58c-48f9-be4d-0cf680bcf192 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:30.696880 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db570a-a58c-48f9-be4d-0cf680bcf192 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:30.696880 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db570a-a58c-48f9-be4d-0cf680bcf192 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:30.724672 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1236/2505] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 15:03:30 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:30.730415 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6b070-56c9-47e6-99db-31e33a64aaf1 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:30.742878 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6b070-56c9-47e6-99db-31e33a64aaf1 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:30.807688 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390de2a5-32a1-4a58-bb2a-b1f527b468eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:30.808572 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390de2a5-32a1-4a58-bb2a-b1f527b468eb admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:30.808831 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390de2a5-32a1-4a58-bb2a-b1f527b468eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:30.809124 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390de2a5-32a1-4a58-bb2a-b1f527b468eb admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:30.809866 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390de2a5-32a1-4a58-bb2a-b1f527b468eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:30.811903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390de2a5-32a1-4a58-bb2a-b1f527b468eb admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:30.835378 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1270/2506] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 15:03:30 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:30.840267 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db570a-a58c-48f9-be4d-0cf680bcf192 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:30.855669 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db570a-a58c-48f9-be4d-0cf680bcf192 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:30.861917 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d37116-6f7a-4ec2-9795-c3d9e4d39883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:30.862919 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d37116-6f7a-4ec2-9795-c3d9e4d39883 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:30.863253 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d37116-6f7a-4ec2-9795-c3d9e4d39883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:30.863594 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d37116-6f7a-4ec2-9795-c3d9e4d39883 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:30.864508 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d37116-6f7a-4ec2-9795-c3d9e4d39883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:30.866128 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d37116-6f7a-4ec2-9795-c3d9e4d39883 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:30.878579 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1237/2507] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:30.882946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390de2a5-32a1-4a58-bb2a-b1f527b468eb admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:30.895123 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390de2a5-32a1-4a58-bb2a-b1f527b468eb admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:30.901406 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249fd689-aa8c-41a2-b0d8-571e7d09bd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:30.902323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fd689-aa8c-41a2-b0d8-571e7d09bd3a admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:30.902751 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fd689-aa8c-41a2-b0d8-571e7d09bd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:30.903198 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fd689-aa8c-41a2-b0d8-571e7d09bd3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:30.904648 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249fd689-aa8c-41a2-b0d8-571e7d09bd3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:30.907460 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249fd689-aa8c-41a2-b0d8-571e7d09bd3a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:30.923388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1271/2508] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:03:30.924497 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d37116-6f7a-4ec2-9795-c3d9e4d39883 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:30.940954 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d37116-6f7a-4ec2-9795-c3d9e4d39883 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:30.947043 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0fa694-40eb-4f96-9163-6864e1016584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:30.947481 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fa694-40eb-4f96-9163-6864e1016584 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:30.947899 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fa694-40eb-4f96-9163-6864e1016584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:30.948676 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fa694-40eb-4f96-9163-6864e1016584 admin admin] PATH_INFO: `/v3/projects/f0812a4613d1437cbfd3b3a340d43a8a/users/6aa044c7ec2a439f8b178d82489818c1/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:30.966537 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0fa694-40eb-4f96-9163-6864e1016584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0812a4613d1437cbfd3b3a340d43a8a, user_id=6aa044c7ec2a439f8b178d82489818c1, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:30.971075 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0fa694-40eb-4f96-9163-6864e1016584 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:30.990696 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1238/2509] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:30 2022] PUT /identity/v3/projects/f0812a4613d1437cbfd3b3a340d43a8a/users/6aa044c7ec2a439f8b178d82489818c1/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:31.002532 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c33ba-0484-4a81-b8f9-31133f568e00 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:31.002821 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c33ba-0484-4a81-b8f9-31133f568e00 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:31.003094 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c33ba-0484-4a81-b8f9-31133f568e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:31.042562 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-c75c33ba-0484-4a81-b8f9-31133f568e00 None None] MFA Rules not processed for user `6aa044c7ec2a439f8b178d82489818c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:31.044225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c75c33ba-0484-4a81-b8f9-31133f568e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:31.102506 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:31.152639 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1272/2510] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:03:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:31.160653 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0fa694-40eb-4f96-9163-6864e1016584 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:31.172003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:31.243971 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0fa694-40eb-4f96-9163-6864e1016584 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:31.249197 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cd3ea-6854-4001-aa65-3427bbb772af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:31.249880 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cd3ea-6854-4001-aa65-3427bbb772af admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:31.250159 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cd3ea-6854-4001-aa65-3427bbb772af admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:31.250433 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cd3ea-6854-4001-aa65-3427bbb772af admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:31.251138 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290cd3ea-6854-4001-aa65-3427bbb772af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:31.253203 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290cd3ea-6854-4001-aa65-3427bbb772af admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:31.283999 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1239/2511] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 15:03:31 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:31.288246 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c33ba-0484-4a81-b8f9-31133f568e00 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:31.302428 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c33ba-0484-4a81-b8f9-31133f568e00 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:31.382678 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19bb36-6472-48e6-ada0-26fb0681b4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:31.383367 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19bb36-6472-48e6-ada0-26fb0681b4e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:31.383649 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19bb36-6472-48e6-ada0-26fb0681b4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:31.383944 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19bb36-6472-48e6-ada0-26fb0681b4e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:31.384764 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f19bb36-6472-48e6-ada0-26fb0681b4e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:31.387036 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f19bb36-6472-48e6-ada0-26fb0681b4e4 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:31.413222 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1273/2512] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 15:03:31 2022] POST /identity/v3/users => generated 299 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:03:31.419433 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cd3ea-6854-4001-aa65-3427bbb772af admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:31.441766 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cd3ea-6854-4001-aa65-3427bbb772af admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:31.454783 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db876b2-e473-44c6-aff7-f1ece75494e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:31.455724 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db876b2-e473-44c6-aff7-f1ece75494e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:31.456098 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db876b2-e473-44c6-aff7-f1ece75494e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:31.456448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db876b2-e473-44c6-aff7-f1ece75494e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:31.457277 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db876b2-e473-44c6-aff7-f1ece75494e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:31.459825 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db876b2-e473-44c6-aff7-f1ece75494e3 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:31.471362 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1240/2513] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:31.476212 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19bb36-6472-48e6-ada0-26fb0681b4e4 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:31.499497 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19bb36-6472-48e6-ada0-26fb0681b4e4 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:31.505391 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d28b134-128a-4cf7-8b23-7e11eae97ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:31.506453 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28b134-128a-4cf7-8b23-7e11eae97ea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:31.506736 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28b134-128a-4cf7-8b23-7e11eae97ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:31.507018 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28b134-128a-4cf7-8b23-7e11eae97ea8 admin admin] PATH_INFO: `/v3/projects/d31b681f429a4ddeb1f46eb9c89112c0/users/b9a874731c2d48c3ab394790ce6a6b0a/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:31.539336 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d28b134-128a-4cf7-8b23-7e11eae97ea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d31b681f429a4ddeb1f46eb9c89112c0, user_id=b9a874731c2d48c3ab394790ce6a6b0a, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:31.542260 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d28b134-128a-4cf7-8b23-7e11eae97ea8 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:31.563736 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1274/2514] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:31 2022] PUT /identity/v3/projects/d31b681f429a4ddeb1f46eb9c89112c0/users/b9a874731c2d48c3ab394790ce6a6b0a/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:31.565931 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db876b2-e473-44c6-aff7-f1ece75494e3 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:31.576178 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db876b2-e473-44c6-aff7-f1ece75494e3 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:31.680401 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371f334-797e-4dd4-8656-8c5de34f39ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:31.681164 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371f334-797e-4dd4-8656-8c5de34f39ea admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:31.681547 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371f334-797e-4dd4-8656-8c5de34f39ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:31.681901 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371f334-797e-4dd4-8656-8c5de34f39ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:31.683285 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1371f334-797e-4dd4-8656-8c5de34f39ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:31.685268 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1371f334-797e-4dd4-8656-8c5de34f39ea admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:31.701126 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1241/2515] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:31.705841 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d28b134-128a-4cf7-8b23-7e11eae97ea8 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:31.719061 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d28b134-128a-4cf7-8b23-7e11eae97ea8 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:31.724453 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff81db3-cfbe-4cc2-92d5-315d85bc0998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:31.725418 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff81db3-cfbe-4cc2-92d5-315d85bc0998 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:31.725739 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff81db3-cfbe-4cc2-92d5-315d85bc0998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:31.726021 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff81db3-cfbe-4cc2-92d5-315d85bc0998 admin admin] PATH_INFO: `/v3/projects/d31b681f429a4ddeb1f46eb9c89112c0/users/b9a874731c2d48c3ab394790ce6a6b0a/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:31.728491 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff81db3-cfbe-4cc2-92d5-315d85bc0998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d31b681f429a4ddeb1f46eb9c89112c0, user_id=b9a874731c2d48c3ab394790ce6a6b0a, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:31.731499 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff81db3-cfbe-4cc2-92d5-315d85bc0998 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:31.749095 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1275/2516] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:31 2022] PUT /identity/v3/projects/d31b681f429a4ddeb1f46eb9c89112c0/users/b9a874731c2d48c3ab394790ce6a6b0a/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:31.760239 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f53f5-1084-4bd3-badd-ac78bebc23d8 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:31.760638 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f53f5-1084-4bd3-badd-ac78bebc23d8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:31.760945 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f53f5-1084-4bd3-badd-ac78bebc23d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:31.798942 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-604f53f5-1084-4bd3-badd-ac78bebc23d8 None None] MFA Rules not processed for user `b9a874731c2d48c3ab394790ce6a6b0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:31.800569 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-604f53f5-1084-4bd3-badd-ac78bebc23d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:31.886053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1242/2517] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:03:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:31.897917 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff81db3-cfbe-4cc2-92d5-315d85bc0998 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:31.899792 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-aff81db3-cfbe-4cc2-92d5-315d85bc0998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:31.987859 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff81db3-cfbe-4cc2-92d5-315d85bc0998 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:31.991791 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2adbf-efbb-4299-82b2-cb8d5cc14077 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:31.992526 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2adbf-efbb-4299-82b2-cb8d5cc14077 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:31.992800 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2adbf-efbb-4299-82b2-cb8d5cc14077 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:31.993073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2adbf-efbb-4299-82b2-cb8d5cc14077 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:32.004269 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2adbf-efbb-4299-82b2-cb8d5cc14077 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:32.009751 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2adbf-efbb-4299-82b2-cb8d5cc14077 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:32.018187 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1276/2518] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:32.048127 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f53f5-1084-4bd3-badd-ac78bebc23d8 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:32.052361 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:32.130995 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f53f5-1084-4bd3-badd-ac78bebc23d8 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:32.137118 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a40fb-f8c1-4ad2-8abc-eb86c84950fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:32.138204 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a40fb-f8c1-4ad2-8abc-eb86c84950fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:32.138326 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a40fb-f8c1-4ad2-8abc-eb86c84950fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:32.138545 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a40fb-f8c1-4ad2-8abc-eb86c84950fd admin admin] PATH_INFO: `/v3/users/6aa044c7ec2a439f8b178d82489818c1` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:32.139780 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a40fb-f8c1-4ad2-8abc-eb86c84950fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aa044c7ec2a439f8b178d82489818c1)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:32.141764 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a40fb-f8c1-4ad2-8abc-eb86c84950fd admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:32.209277 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-134a40fb-f8c1-4ad2-8abc-eb86c84950fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aa044c7ec2a439f8b178d82489818c1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:32.218287 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-134a40fb-f8c1-4ad2-8abc-eb86c84950fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aa044c7ec2a439f8b178d82489818c1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:32.230897 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-134a40fb-f8c1-4ad2-8abc-eb86c84950fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aa044c7ec2a439f8b178d82489818c1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:32.244944 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-134a40fb-f8c1-4ad2-8abc-eb86c84950fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aa044c7ec2a439f8b178d82489818c1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:32.245729 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-134a40fb-f8c1-4ad2-8abc-eb86c84950fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aa044c7ec2a439f8b178d82489818c1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:32.254068 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1243/2519] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 15:03:32 2022] DELETE /identity/v3/users/6aa044c7ec2a439f8b178d82489818c1 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:03:32.259264 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1aeb9-324a-4dc1-9b02-1f533f72a565 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:32.259673 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1aeb9-324a-4dc1-9b02-1f533f72a565 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:32.260211 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1aeb9-324a-4dc1-9b02-1f533f72a565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:32.284057 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-a0f1aeb9-324a-4dc1-9b02-1f533f72a565 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:32.285374 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a0f1aeb9-324a-4dc1-9b02-1f533f72a565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:32.303047 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:32.380187 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1277/2520] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:32.391242 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a40fb-f8c1-4ad2-8abc-eb86c84950fd admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:32.392914 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-134a40fb-f8c1-4ad2-8abc-eb86c84950fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:32.460588 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a40fb-f8c1-4ad2-8abc-eb86c84950fd admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:32.465420 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7cbec5-723d-41a7-b294-fb84a9027970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:32.466078 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7cbec5-723d-41a7-b294-fb84a9027970 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:32.466354 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7cbec5-723d-41a7-b294-fb84a9027970 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:32.466624 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7cbec5-723d-41a7-b294-fb84a9027970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:32.476893 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7cbec5-723d-41a7-b294-fb84a9027970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:32.478345 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7cbec5-723d-41a7-b294-fb84a9027970 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:32.488728 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1244/2521] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:32.785760 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1aeb9-324a-4dc1-9b02-1f533f72a565 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:32.787289 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a0f1aeb9-324a-4dc1-9b02-1f533f72a565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:32.801763 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1aeb9-324a-4dc1-9b02-1f533f72a565 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:32.807004 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ae0c8-6817-4f91-92ca-051c7177db32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:32.808638 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ae0c8-6817-4f91-92ca-051c7177db32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:32.808911 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ae0c8-6817-4f91-92ca-051c7177db32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:32.809183 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ae0c8-6817-4f91-92ca-051c7177db32 admin admin] PATH_INFO: `/v3/projects/f0812a4613d1437cbfd3b3a340d43a8a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:32.810413 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ae0c8-6817-4f91-92ca-051c7177db32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0812a4613d1437cbfd3b3a340d43a8a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:32.812463 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ae0c8-6817-4f91-92ca-051c7177db32 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:32.867911 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-ec7ae0c8-6817-4f91-92ca-051c7177db32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0812a4613d1437cbfd3b3a340d43a8a', 'request_id': 'req-ec7ae0c8-6817-4f91-92ca-051c7177db32'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:32.873933 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-ec7ae0c8-6817-4f91-92ca-051c7177db32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0812a4613d1437cbfd3b3a340d43a8a', 'request_id': 'req-ec7ae0c8-6817-4f91-92ca-051c7177db32'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:32.882586 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-ec7ae0c8-6817-4f91-92ca-051c7177db32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0812a4613d1437cbfd3b3a340d43a8a', 'request_id': 'req-ec7ae0c8-6817-4f91-92ca-051c7177db32'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:32.897295 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-ec7ae0c8-6817-4f91-92ca-051c7177db32 admin admin] The token cache is being invalidate because project f0812a4613d1437cbfd3b3a340d43a8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:03:32.897566 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-ec7ae0c8-6817-4f91-92ca-051c7177db32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:32.898302 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-ec7ae0c8-6817-4f91-92ca-051c7177db32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:32.899966 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1278/2522] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:03:32 2022] DELETE /identity/v3/projects/f0812a4613d1437cbfd3b3a340d43a8a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:32.906319 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7cbec5-723d-41a7-b294-fb84a9027970 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:32.917236 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7cbec5-723d-41a7-b294-fb84a9027970 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:32.939623 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:32.987171 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a20e6f-8d0f-4ef6-92f5-b959eb6786e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:32.988181 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a20e6f-8d0f-4ef6-92f5-b959eb6786e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:32.988466 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a20e6f-8d0f-4ef6-92f5-b959eb6786e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:32.988836 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a20e6f-8d0f-4ef6-92f5-b959eb6786e2 admin admin] PATH_INFO: `/v3/users/b9a874731c2d48c3ab394790ce6a6b0a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:32.990201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a20e6f-8d0f-4ef6-92f5-b959eb6786e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9a874731c2d48c3ab394790ce6a6b0a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:32.992170 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a20e6f-8d0f-4ef6-92f5-b959eb6786e2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:33.045380 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b5a20e6f-8d0f-4ef6-92f5-b959eb6786e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9a874731c2d48c3ab394790ce6a6b0a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:33.052845 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b5a20e6f-8d0f-4ef6-92f5-b959eb6786e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9a874731c2d48c3ab394790ce6a6b0a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:33.062831 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b5a20e6f-8d0f-4ef6-92f5-b959eb6786e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9a874731c2d48c3ab394790ce6a6b0a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:33.080315 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b5a20e6f-8d0f-4ef6-92f5-b959eb6786e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9a874731c2d48c3ab394790ce6a6b0a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:33.081285 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b5a20e6f-8d0f-4ef6-92f5-b959eb6786e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9a874731c2d48c3ab394790ce6a6b0a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:33.087601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1245/2523] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 15:03:32 2022] DELETE /identity/v3/users/b9a874731c2d48c3ab394790ce6a6b0a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:33.310731 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77025fad-5d8d-486b-a907-07b639a2f3c9 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:33.311140 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77025fad-5d8d-486b-a907-07b639a2f3c9 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:33.311595 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77025fad-5d8d-486b-a907-07b639a2f3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:33.331060 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-77025fad-5d8d-486b-a907-07b639a2f3c9 None None] MFA Rules not processed for user `db4d36e6837d4b2fa4b7ee5c7243b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:33.332313 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-77025fad-5d8d-486b-a907-07b639a2f3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:33.398339 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1279/2524] 10.222.0.85 () {58 vars in 967 bytes} [Thu Jun 16 15:03:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:33.400151 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a20e6f-8d0f-4ef6-92f5-b959eb6786e2 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:33.402861 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b5a20e6f-8d0f-4ef6-92f5-b959eb6786e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:33.458674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77025fad-5d8d-486b-a907-07b639a2f3c9 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:33.460457 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-77025fad-5d8d-486b-a907-07b639a2f3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:33.496900 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a20e6f-8d0f-4ef6-92f5-b959eb6786e2 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:33.501606 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a909e6e-12e7-4df2-af82-3c5799e2d083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:33.502495 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a909e6e-12e7-4df2-af82-3c5799e2d083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:33.502774 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a909e6e-12e7-4df2-af82-3c5799e2d083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:33.503050 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a909e6e-12e7-4df2-af82-3c5799e2d083 admin admin] PATH_INFO: `/v3/projects/d31b681f429a4ddeb1f46eb9c89112c0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:33.504650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a909e6e-12e7-4df2-af82-3c5799e2d083 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d31b681f429a4ddeb1f46eb9c89112c0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:33.506931 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a909e6e-12e7-4df2-af82-3c5799e2d083 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:33.513053 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:33.538562 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77025fad-5d8d-486b-a907-07b639a2f3c9 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:33.544379 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324fce9-0b2e-40b0-8325-2aa7b54856fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf9c39de29324b0ca6329c9a171367c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:33.545041 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324fce9-0b2e-40b0-8325-2aa7b54856fd service swift] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:33.545323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324fce9-0b2e-40b0-8325-2aa7b54856fd service swift] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:33.545596 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324fce9-0b2e-40b0-8325-2aa7b54856fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:33.561142 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324fce9-0b2e-40b0-8325-2aa7b54856fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:33.562814 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324fce9-0b2e-40b0-8325-2aa7b54856fd service swift] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:33.564076 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:33.566741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0a909e6e-12e7-4df2-af82-3c5799e2d083 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd31b681f429a4ddeb1f46eb9c89112c0', 'request_id': 'req-0a909e6e-12e7-4df2-af82-3c5799e2d083'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:33.572465 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1280/2525] 10.222.0.85 () {60 vars in 1384 bytes} [Thu Jun 16 15:03:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 15:03:33.578232 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0a909e6e-12e7-4df2-af82-3c5799e2d083 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd31b681f429a4ddeb1f46eb9c89112c0', 'request_id': 'req-0a909e6e-12e7-4df2-af82-3c5799e2d083'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:33.590418 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0a909e6e-12e7-4df2-af82-3c5799e2d083 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd31b681f429a4ddeb1f46eb9c89112c0', 'request_id': 'req-0a909e6e-12e7-4df2-af82-3c5799e2d083'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:33.610876 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0a909e6e-12e7-4df2-af82-3c5799e2d083 admin admin] The token cache is being invalidate because project d31b681f429a4ddeb1f46eb9c89112c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:03:33.611372 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0a909e6e-12e7-4df2-af82-3c5799e2d083 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:33.612411 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0a909e6e-12e7-4df2-af82-3c5799e2d083 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:33.614952 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1246/2526] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:03:33 2022] DELETE /identity/v3/projects/d31b681f429a4ddeb1f46eb9c89112c0 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:33.620277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856506b-83fc-49d8-9f6e-b661c2d42760 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:33.620842 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856506b-83fc-49d8-9f6e-b661c2d42760 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:33.621129 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856506b-83fc-49d8-9f6e-b661c2d42760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:33.640842 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-c856506b-83fc-49d8-9f6e-b661c2d42760 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:33.642859 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c856506b-83fc-49d8-9f6e-b661c2d42760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:33.723493 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1281/2527] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:03:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:33.734461 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dd65e-2b0d-4c0d-9158-83ae9a83905e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:33.734794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dd65e-2b0d-4c0d-9158-83ae9a83905e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:33.735232 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dd65e-2b0d-4c0d-9158-83ae9a83905e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:33.759259 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-8e0dd65e-2b0d-4c0d-9158-83ae9a83905e None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:33.760481 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8e0dd65e-2b0d-4c0d-9158-83ae9a83905e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:33.770340 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1247/2528] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:03:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:33.774948 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856506b-83fc-49d8-9f6e-b661c2d42760 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:33.787175 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856506b-83fc-49d8-9f6e-b661c2d42760 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:33.801222 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d21f3-faa0-4df4-b76e-db0ce8456822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:33.801910 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d21f3-faa0-4df4-b76e-db0ce8456822 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:33.802385 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d21f3-faa0-4df4-b76e-db0ce8456822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:33.802666 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d21f3-faa0-4df4-b76e-db0ce8456822 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:33.803436 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d21f3-faa0-4df4-b76e-db0ce8456822 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:03:33.803789 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d21f3-faa0-4df4-b76e-db0ce8456822 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:33.805779 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d21f3-faa0-4df4-b76e-db0ce8456822 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:33.828770 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1282/2529] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 15:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:03:33.833482 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0dd65e-2b0d-4c0d-9158-83ae9a83905e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:33.844454 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0dd65e-2b0d-4c0d-9158-83ae9a83905e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:33.850573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4c194-1ff5-4aa0-b583-63119c526efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:33.851251 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4c194-1ff5-4aa0-b583-63119c526efa admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:33.851537 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4c194-1ff5-4aa0-b583-63119c526efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:33.851818 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4c194-1ff5-4aa0-b583-63119c526efa admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:33.852553 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb4c194-1ff5-4aa0-b583-63119c526efa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:33.854805 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb4c194-1ff5-4aa0-b583-63119c526efa admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:33.886976 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1248/2530] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 15:03:33 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:03:33.891803 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d21f3-faa0-4df4-b76e-db0ce8456822 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:33.903370 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d21f3-faa0-4df4-b76e-db0ce8456822 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:33.991835 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ff727-764f-4d37-9e23-f9581f07641a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:33.992569 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ff727-764f-4d37-9e23-f9581f07641a admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:33.992864 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ff727-764f-4d37-9e23-f9581f07641a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:33.993137 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ff727-764f-4d37-9e23-f9581f07641a admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:33.993844 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ff727-764f-4d37-9e23-f9581f07641a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:33.996785 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ff727-764f-4d37-9e23-f9581f07641a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:34.032304 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1283/2531] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 15:03:33 2022] POST /identity/v3/users => generated 290 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:34.036588 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4c194-1ff5-4aa0-b583-63119c526efa admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:34.048335 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4c194-1ff5-4aa0-b583-63119c526efa admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:34.053629 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb0d01-5d31-4909-89df-a485a697fffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:34.054649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb0d01-5d31-4909-89df-a485a697fffe admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:34.054927 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb0d01-5d31-4909-89df-a485a697fffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:34.055196 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb0d01-5d31-4909-89df-a485a697fffe admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:34.055939 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb0d01-5d31-4909-89df-a485a697fffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:34.058530 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb0d01-5d31-4909-89df-a485a697fffe admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:34.069711 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1249/2532] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:34.074702 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ff727-764f-4d37-9e23-f9581f07641a admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:34.085373 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ff727-764f-4d37-9e23-f9581f07641a admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:34.090903 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d419c-7e7b-4b16-9b22-a262a5f46188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:34.091605 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d419c-7e7b-4b16-9b22-a262a5f46188 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:34.091925 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d419c-7e7b-4b16-9b22-a262a5f46188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:34.092212 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d419c-7e7b-4b16-9b22-a262a5f46188 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:34.092940 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d419c-7e7b-4b16-9b22-a262a5f46188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:34.098695 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d419c-7e7b-4b16-9b22-a262a5f46188 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:34.112688 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1284/2533] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:34.113092 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb0d01-5d31-4909-89df-a485a697fffe admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:34.129662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb0d01-5d31-4909-89df-a485a697fffe admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:34.134413 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70610511-03e7-4a91-8b7d-4b131a2ba430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:34.135413 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70610511-03e7-4a91-8b7d-4b131a2ba430 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:34.136298 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70610511-03e7-4a91-8b7d-4b131a2ba430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:34.136298 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70610511-03e7-4a91-8b7d-4b131a2ba430 admin admin] PATH_INFO: `/v3/projects/f5f8e1330ab04d5f8ac27c65b353fdf8/users/5dab856c6b584e7aa8895047f34c5050/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:34.153370 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70610511-03e7-4a91-8b7d-4b131a2ba430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5f8e1330ab04d5f8ac27c65b353fdf8, user_id=5dab856c6b584e7aa8895047f34c5050, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:34.156638 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70610511-03e7-4a91-8b7d-4b131a2ba430 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:34.177752 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1250/2534] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:34 2022] PUT /identity/v3/projects/f5f8e1330ab04d5f8ac27c65b353fdf8/users/5dab856c6b584e7aa8895047f34c5050/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:34.189120 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd9183-55b8-412e-a05b-ee01dc2ac357 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:34.189568 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd9183-55b8-412e-a05b-ee01dc2ac357 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:34.189947 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd9183-55b8-412e-a05b-ee01dc2ac357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:34.219260 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-71bd9183-55b8-412e-a05b-ee01dc2ac357 None None] MFA Rules not processed for user `5dab856c6b584e7aa8895047f34c5050`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:34.220570 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-71bd9183-55b8-412e-a05b-ee01dc2ac357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:34.259899 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:34.308163 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1285/2535] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:03:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:34.313621 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70610511-03e7-4a91-8b7d-4b131a2ba430 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:34.391923 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70610511-03e7-4a91-8b7d-4b131a2ba430 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:34.401795 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc67e49-e933-4e18-8901-66242c0fcacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:34.402490 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc67e49-e933-4e18-8901-66242c0fcacc admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:34.402777 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc67e49-e933-4e18-8901-66242c0fcacc admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:34.403062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc67e49-e933-4e18-8901-66242c0fcacc admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:34.404113 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc67e49-e933-4e18-8901-66242c0fcacc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:34.406132 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc67e49-e933-4e18-8901-66242c0fcacc admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:34.437071 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1251/2536] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 15:03:34 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:03:34.442037 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd9183-55b8-412e-a05b-ee01dc2ac357 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:34.454688 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd9183-55b8-412e-a05b-ee01dc2ac357 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:34.524476 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c560172-18e8-458f-a67f-252cb6ab9127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:34.525180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c560172-18e8-458f-a67f-252cb6ab9127 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:34.525464 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c560172-18e8-458f-a67f-252cb6ab9127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:34.526111 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c560172-18e8-458f-a67f-252cb6ab9127 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:34.527122 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c560172-18e8-458f-a67f-252cb6ab9127 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:34.529432 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c560172-18e8-458f-a67f-252cb6ab9127 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:34.551968 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1286/2537] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 15:03:34 2022] POST /identity/v3/users => generated 297 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:03:34.556100 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc67e49-e933-4e18-8901-66242c0fcacc admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:34.568360 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc67e49-e933-4e18-8901-66242c0fcacc admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:34.574373 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2f3f7-9d10-41ef-9a6b-896ecc21be59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:34.575060 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2f3f7-9d10-41ef-9a6b-896ecc21be59 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:34.575347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2f3f7-9d10-41ef-9a6b-896ecc21be59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:34.575592 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2f3f7-9d10-41ef-9a6b-896ecc21be59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:34.576379 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2f3f7-9d10-41ef-9a6b-896ecc21be59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:34.578067 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2f3f7-9d10-41ef-9a6b-896ecc21be59 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:34.592251 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1252/2538] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:34.596699 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c560172-18e8-458f-a67f-252cb6ab9127 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:34.607571 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c560172-18e8-458f-a67f-252cb6ab9127 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:34.613516 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070356ba-06c9-4d87-ade8-b5d324fd8a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:34.614482 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070356ba-06c9-4d87-ade8-b5d324fd8a1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:34.614762 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070356ba-06c9-4d87-ade8-b5d324fd8a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:34.615048 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070356ba-06c9-4d87-ade8-b5d324fd8a1c admin admin] PATH_INFO: `/v3/projects/64b834ba25df4f30a540cbd2ee427300/users/80dba0c569f840c98320f357e6d83ed2/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:34.634250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070356ba-06c9-4d87-ade8-b5d324fd8a1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b834ba25df4f30a540cbd2ee427300, user_id=80dba0c569f840c98320f357e6d83ed2, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:34.637069 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070356ba-06c9-4d87-ade8-b5d324fd8a1c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:34.654301 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1287/2539] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:34 2022] PUT /identity/v3/projects/64b834ba25df4f30a540cbd2ee427300/users/80dba0c569f840c98320f357e6d83ed2/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:34.663743 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2f3f7-9d10-41ef-9a6b-896ecc21be59 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:34.675232 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2f3f7-9d10-41ef-9a6b-896ecc21be59 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:34.727736 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:34.749028 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d848ff-8618-4eb6-96d4-2a7ca3508df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:34.749943 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d848ff-8618-4eb6-96d4-2a7ca3508df3 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:34.750233 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d848ff-8618-4eb6-96d4-2a7ca3508df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:34.750508 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d848ff-8618-4eb6-96d4-2a7ca3508df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:34.751242 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d848ff-8618-4eb6-96d4-2a7ca3508df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:34.752929 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d848ff-8618-4eb6-96d4-2a7ca3508df3 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:34.765500 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1253/2540] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:34.769946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070356ba-06c9-4d87-ade8-b5d324fd8a1c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:34.781750 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070356ba-06c9-4d87-ade8-b5d324fd8a1c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:34.786771 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a284c-2abe-4fc6-8653-7c4c04266018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:34.787705 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a284c-2abe-4fc6-8653-7c4c04266018 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:34.788349 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a284c-2abe-4fc6-8653-7c4c04266018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:34.788349 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a284c-2abe-4fc6-8653-7c4c04266018 admin admin] PATH_INFO: `/v3/projects/64b834ba25df4f30a540cbd2ee427300/users/80dba0c569f840c98320f357e6d83ed2/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:34.790791 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a284c-2abe-4fc6-8653-7c4c04266018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b834ba25df4f30a540cbd2ee427300, user_id=80dba0c569f840c98320f357e6d83ed2, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:34.793618 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a284c-2abe-4fc6-8653-7c4c04266018 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:34.805600 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1288/2541] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:34 2022] PUT /identity/v3/projects/64b834ba25df4f30a540cbd2ee427300/users/80dba0c569f840c98320f357e6d83ed2/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:34.816498 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c8858-c31f-4bf9-891a-8ee421da28fb None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:34.816842 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c8858-c31f-4bf9-891a-8ee421da28fb None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:34.817059 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c8858-c31f-4bf9-891a-8ee421da28fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:34.847488 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b29c8858-c31f-4bf9-891a-8ee421da28fb None None] MFA Rules not processed for user `80dba0c569f840c98320f357e6d83ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:34.848772 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b29c8858-c31f-4bf9-891a-8ee421da28fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:34.944548 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1254/2542] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:03:34 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:34.957277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a284c-2abe-4fc6-8653-7c4c04266018 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:34.959235 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-617a284c-2abe-4fc6-8653-7c4c04266018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:35.030156 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a284c-2abe-4fc6-8653-7c4c04266018 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:35.036525 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999b703-da66-4d2c-b654-5a3753823e89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:35.037475 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999b703-da66-4d2c-b654-5a3753823e89 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:35.037888 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999b703-da66-4d2c-b654-5a3753823e89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:35.038318 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999b703-da66-4d2c-b654-5a3753823e89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:35.052957 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999b703-da66-4d2c-b654-5a3753823e89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:35.055169 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999b703-da66-4d2c-b654-5a3753823e89 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:35.070873 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1289/2543] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:35.498409 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c8858-c31f-4bf9-891a-8ee421da28fb None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:35.509204 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c8858-c31f-4bf9-891a-8ee421da28fb None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:35.514887 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d30779-43b3-4140-aaa5-d82a7a464ed8 tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80dba0c569f840c98320f357e6d83ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64b834ba25df4f30a540cbd2ee427300', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:35.515585 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d30779-43b3-4140-aaa5-d82a7a464ed8 tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:35.515898 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d30779-43b3-4140-aaa5-d82a7a464ed8 tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:35.516191 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d30779-43b3-4140-aaa5-d82a7a464ed8 tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:35.516939 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d30779-43b3-4140-aaa5-d82a7a464ed8 tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:03:35.517258 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d30779-43b3-4140-aaa5-d82a7a464ed8 tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:35.518916 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d30779-43b3-4140-aaa5-d82a7a464ed8 tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:35.533276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1255/2544] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 15:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:03:35.537871 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999b703-da66-4d2c-b654-5a3753823e89 service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:35.548257 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999b703-da66-4d2c-b654-5a3753823e89 service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:35.553831 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb172c-36cf-4501-bc92-4b54116c8240 tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80dba0c569f840c98320f357e6d83ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64b834ba25df4f30a540cbd2ee427300', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:35.554524 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb172c-36cf-4501-bc92-4b54116c8240 tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:35.554834 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb172c-36cf-4501-bc92-4b54116c8240 tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:35.555092 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb172c-36cf-4501-bc92-4b54116c8240 tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:35.555800 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fb172c-36cf-4501-bc92-4b54116c8240 tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:35.558678 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fb172c-36cf-4501-bc92-4b54116c8240 tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:35.602376 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1290/2545] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 15:03:35 2022] POST /identity/v3/projects => generated 355 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:35.608792 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d30779-43b3-4140-aaa5-d82a7a464ed8 tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:35.620346 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d30779-43b3-4140-aaa5-d82a7a464ed8 tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:35.684946 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1d6b44-85df-4653-bcfc-92554d1e8b1b tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80dba0c569f840c98320f357e6d83ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64b834ba25df4f30a540cbd2ee427300', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:35.685730 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d6b44-85df-4653-bcfc-92554d1e8b1b tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:35.686026 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d6b44-85df-4653-bcfc-92554d1e8b1b tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:35.686297 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d6b44-85df-4653-bcfc-92554d1e8b1b tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:35.687079 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1d6b44-85df-4653-bcfc-92554d1e8b1b tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:03:35.687402 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1d6b44-85df-4653-bcfc-92554d1e8b1b tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:35.689135 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1d6b44-85df-4653-bcfc-92554d1e8b1b tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:35.703639 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1256/2546] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 15:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:03:35.747471 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb172c-36cf-4501-bc92-4b54116c8240 tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:35.758831 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb172c-36cf-4501-bc92-4b54116c8240 tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:35.766671 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a6a4b-2286-4580-a684-50f0e84de8ed tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80dba0c569f840c98320f357e6d83ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64b834ba25df4f30a540cbd2ee427300', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:35.767560 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a6a4b-2286-4580-a684-50f0e84de8ed tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:35.767838 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a6a4b-2286-4580-a684-50f0e84de8ed tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:35.768122 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a6a4b-2286-4580-a684-50f0e84de8ed tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] PATH_INFO: `/v3/projects/84435af955374978b8d9fc3101c2341f` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:35.769398 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a6a4b-2286-4580-a684-50f0e84de8ed tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] RBAC: Authorizing `identity:delete_project(project_id=84435af955374978b8d9fc3101c2341f)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:35.771332 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a6a4b-2286-4580-a684-50f0e84de8ed tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:35.773328 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:35.835646 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-bd7a6a4b-2286-4580-a684-50f0e84de8ed tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84435af955374978b8d9fc3101c2341f', 'request_id': 'req-bd7a6a4b-2286-4580-a684-50f0e84de8ed'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:35.842438 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-bd7a6a4b-2286-4580-a684-50f0e84de8ed tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84435af955374978b8d9fc3101c2341f', 'request_id': 'req-bd7a6a4b-2286-4580-a684-50f0e84de8ed'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:35.852948 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-bd7a6a4b-2286-4580-a684-50f0e84de8ed tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84435af955374978b8d9fc3101c2341f', 'request_id': 'req-bd7a6a4b-2286-4580-a684-50f0e84de8ed'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:35.869567 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-bd7a6a4b-2286-4580-a684-50f0e84de8ed tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] The token cache is being invalidate because project 84435af955374978b8d9fc3101c2341f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:03:35.870174 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-bd7a6a4b-2286-4580-a684-50f0e84de8ed tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:35.871269 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-bd7a6a4b-2286-4580-a684-50f0e84de8ed tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:35.873279 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1291/2547] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:03:35 2022] DELETE /identity/v3/projects/84435af955374978b8d9fc3101c2341f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:36.132438 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1d6b44-85df-4653-bcfc-92554d1e8b1b tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:36.134686 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ed1d6b44-85df-4653-bcfc-92554d1e8b1b tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:36.212309 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:36.237436 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1d6b44-85df-4653-bcfc-92554d1e8b1b tempest-VolumeQuotaClassesTest-2082806966 tempest-VolumeQuotaClassesTest-2082806966-project-admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:36.329434 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db683bd-7606-4514-8b07-40fab901d34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:36.330442 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db683bd-7606-4514-8b07-40fab901d34b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:36.330723 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db683bd-7606-4514-8b07-40fab901d34b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:36.330997 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db683bd-7606-4514-8b07-40fab901d34b admin admin] PATH_INFO: `/v3/users/5dab856c6b584e7aa8895047f34c5050` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:36.332339 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db683bd-7606-4514-8b07-40fab901d34b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dab856c6b584e7aa8895047f34c5050)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:36.334350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db683bd-7606-4514-8b07-40fab901d34b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:36.406330 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1db683bd-7606-4514-8b07-40fab901d34b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dab856c6b584e7aa8895047f34c5050'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:36.415796 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1db683bd-7606-4514-8b07-40fab901d34b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dab856c6b584e7aa8895047f34c5050'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:36.425433 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1db683bd-7606-4514-8b07-40fab901d34b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dab856c6b584e7aa8895047f34c5050'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:36.452419 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1db683bd-7606-4514-8b07-40fab901d34b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dab856c6b584e7aa8895047f34c5050'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:36.453431 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1db683bd-7606-4514-8b07-40fab901d34b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dab856c6b584e7aa8895047f34c5050'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:36.463211 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1257/2548] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 15:03:36 2022] DELETE /identity/v3/users/5dab856c6b584e7aa8895047f34c5050 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:36.467622 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b5f91-a319-4a40-b63a-6aec5857b5cc None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:36.467930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b5f91-a319-4a40-b63a-6aec5857b5cc None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:36.468208 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b5f91-a319-4a40-b63a-6aec5857b5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:36.488139 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-939b5f91-a319-4a40-b63a-6aec5857b5cc None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:36.489676 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-939b5f91-a319-4a40-b63a-6aec5857b5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:36.577716 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1292/2549] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:03:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:36.605468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db683bd-7606-4514-8b07-40fab901d34b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:36.608107 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1db683bd-7606-4514-8b07-40fab901d34b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:36.671670 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db683bd-7606-4514-8b07-40fab901d34b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:36.675508 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc2555-b8e6-4833-af20-00113c74c1e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:36.676185 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc2555-b8e6-4833-af20-00113c74c1e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:36.676459 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc2555-b8e6-4833-af20-00113c74c1e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:36.676726 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc2555-b8e6-4833-af20-00113c74c1e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:36.688166 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc2555-b8e6-4833-af20-00113c74c1e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:36.689625 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc2555-b8e6-4833-af20-00113c74c1e3 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:36.700350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1258/2550] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:37.455901 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b5f91-a319-4a40-b63a-6aec5857b5cc None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:37.457483 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-939b5f91-a319-4a40-b63a-6aec5857b5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:37.470464 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b5f91-a319-4a40-b63a-6aec5857b5cc None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:37.476272 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8214cf3-8cc2-4840-92d2-0ff0986623eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:37.477240 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8214cf3-8cc2-4840-92d2-0ff0986623eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:37.477527 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8214cf3-8cc2-4840-92d2-0ff0986623eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:37.477809 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8214cf3-8cc2-4840-92d2-0ff0986623eb admin admin] PATH_INFO: `/v3/projects/f5f8e1330ab04d5f8ac27c65b353fdf8` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:37.480906 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8214cf3-8cc2-4840-92d2-0ff0986623eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5f8e1330ab04d5f8ac27c65b353fdf8)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:37.482905 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8214cf3-8cc2-4840-92d2-0ff0986623eb admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:37.569116 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c8214cf3-8cc2-4840-92d2-0ff0986623eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5f8e1330ab04d5f8ac27c65b353fdf8', 'request_id': 'req-c8214cf3-8cc2-4840-92d2-0ff0986623eb'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:37.581217 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c8214cf3-8cc2-4840-92d2-0ff0986623eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5f8e1330ab04d5f8ac27c65b353fdf8', 'request_id': 'req-c8214cf3-8cc2-4840-92d2-0ff0986623eb'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:37.591969 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c8214cf3-8cc2-4840-92d2-0ff0986623eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5f8e1330ab04d5f8ac27c65b353fdf8', 'request_id': 'req-c8214cf3-8cc2-4840-92d2-0ff0986623eb'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:37.610165 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c8214cf3-8cc2-4840-92d2-0ff0986623eb admin admin] The token cache is being invalidate because project f5f8e1330ab04d5f8ac27c65b353fdf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:03:37.610949 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c8214cf3-8cc2-4840-92d2-0ff0986623eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:37.611835 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c8214cf3-8cc2-4840-92d2-0ff0986623eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:37.613676 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1293/2551] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:03:37 2022] DELETE /identity/v3/projects/f5f8e1330ab04d5f8ac27c65b353fdf8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:37.618420 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc2555-b8e6-4833-af20-00113c74c1e3 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:37.637395 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc2555-b8e6-4833-af20-00113c74c1e3 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:37.671365 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:37.745268 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895cbf2-5205-4072-a1c3-52be0fa9a547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:37.746544 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895cbf2-5205-4072-a1c3-52be0fa9a547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:37.746974 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895cbf2-5205-4072-a1c3-52be0fa9a547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:37.747393 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895cbf2-5205-4072-a1c3-52be0fa9a547 admin admin] PATH_INFO: `/v3/users/80dba0c569f840c98320f357e6d83ed2` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:37.749074 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895cbf2-5205-4072-a1c3-52be0fa9a547 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80dba0c569f840c98320f357e6d83ed2)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:37.751405 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895cbf2-5205-4072-a1c3-52be0fa9a547 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:37.827470 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6895cbf2-5205-4072-a1c3-52be0fa9a547 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80dba0c569f840c98320f357e6d83ed2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:37.835350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6895cbf2-5205-4072-a1c3-52be0fa9a547 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80dba0c569f840c98320f357e6d83ed2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:37.861280 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6895cbf2-5205-4072-a1c3-52be0fa9a547 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80dba0c569f840c98320f357e6d83ed2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:37.880443 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8214cf3-8cc2-4840-92d2-0ff0986623eb admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:37.881888 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c8214cf3-8cc2-4840-92d2-0ff0986623eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:37.888320 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6895cbf2-5205-4072-a1c3-52be0fa9a547 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80dba0c569f840c98320f357e6d83ed2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:37.889077 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6895cbf2-5205-4072-a1c3-52be0fa9a547 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80dba0c569f840c98320f357e6d83ed2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:37.896950 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1259/2552] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 15:03:37 2022] DELETE /identity/v3/users/80dba0c569f840c98320f357e6d83ed2 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:37.902537 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:37.998242 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8214cf3-8cc2-4840-92d2-0ff0986623eb admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:38.079413 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b5358-b604-4b7c-8e5c-c07db0dbaeef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819ad532defb4adaa2f4fd06b47630d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:38.080223 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b5358-b604-4b7c-8e5c-c07db0dbaeef service placement] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:38.080593 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b5358-b604-4b7c-8e5c-c07db0dbaeef service placement] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:38.080875 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b5358-b604-4b7c-8e5c-c07db0dbaeef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:38.088118 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-991b5358-b604-4b7c-8e5c-c07db0dbaeef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:38.113763 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b5358-b604-4b7c-8e5c-c07db0dbaeef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:38.115817 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b5358-b604-4b7c-8e5c-c07db0dbaeef service placement] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:38.130563 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1294/2553] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:03:38.234717 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895cbf2-5205-4072-a1c3-52be0fa9a547 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:38.236364 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6895cbf2-5205-4072-a1c3-52be0fa9a547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:38.318278 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895cbf2-5205-4072-a1c3-52be0fa9a547 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:38.323954 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc979ba1-50e9-4b6c-86f1-568099fe909b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:38.324843 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc979ba1-50e9-4b6c-86f1-568099fe909b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:38.325133 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc979ba1-50e9-4b6c-86f1-568099fe909b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:38.325398 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc979ba1-50e9-4b6c-86f1-568099fe909b admin admin] PATH_INFO: `/v3/projects/64b834ba25df4f30a540cbd2ee427300` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:38.326652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc979ba1-50e9-4b6c-86f1-568099fe909b admin admin] RBAC: Authorizing `identity:delete_project(project_id=64b834ba25df4f30a540cbd2ee427300)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:38.328628 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc979ba1-50e9-4b6c-86f1-568099fe909b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:38.379200 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:38.395572 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-dc979ba1-50e9-4b6c-86f1-568099fe909b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64b834ba25df4f30a540cbd2ee427300', 'request_id': 'req-dc979ba1-50e9-4b6c-86f1-568099fe909b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:38.403935 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-dc979ba1-50e9-4b6c-86f1-568099fe909b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64b834ba25df4f30a540cbd2ee427300', 'request_id': 'req-dc979ba1-50e9-4b6c-86f1-568099fe909b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:38.410699 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-dc979ba1-50e9-4b6c-86f1-568099fe909b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64b834ba25df4f30a540cbd2ee427300', 'request_id': 'req-dc979ba1-50e9-4b6c-86f1-568099fe909b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:38.424228 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-dc979ba1-50e9-4b6c-86f1-568099fe909b admin admin] The token cache is being invalidate because project 64b834ba25df4f30a540cbd2ee427300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:03:38.424538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-dc979ba1-50e9-4b6c-86f1-568099fe909b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:38.425216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-dc979ba1-50e9-4b6c-86f1-568099fe909b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:38.427129 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1260/2554] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:03:38 2022] DELETE /identity/v3/projects/64b834ba25df4f30a540cbd2ee427300 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:38.433658 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882f905-1ee2-4ab5-b3eb-470b155679c7 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:38.434145 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882f905-1ee2-4ab5-b3eb-470b155679c7 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:38.434611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882f905-1ee2-4ab5-b3eb-470b155679c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:38.453518 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-5882f905-1ee2-4ab5-b3eb-470b155679c7 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:38.454743 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5882f905-1ee2-4ab5-b3eb-470b155679c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:38.526186 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1295/2555] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:03:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:38.529113 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70035fd5-12f8-4591-806a-077b31afb4c9 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:38.529376 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70035fd5-12f8-4591-806a-077b31afb4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:38.529688 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70035fd5-12f8-4591-806a-077b31afb4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:38.549722 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-70035fd5-12f8-4591-806a-077b31afb4c9 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:38.550969 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-70035fd5-12f8-4591-806a-077b31afb4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:38.564567 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1261/2556] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:03:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:38.569144 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882f905-1ee2-4ab5-b3eb-470b155679c7 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:38.580245 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882f905-1ee2-4ab5-b3eb-470b155679c7 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:38.585234 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d00ce-67dc-4040-b89c-e0e79ef6539c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:38.585895 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d00ce-67dc-4040-b89c-e0e79ef6539c admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:38.586318 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d00ce-67dc-4040-b89c-e0e79ef6539c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:38.586598 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d00ce-67dc-4040-b89c-e0e79ef6539c admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:38.587323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d00ce-67dc-4040-b89c-e0e79ef6539c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:03:38.587633 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d00ce-67dc-4040-b89c-e0e79ef6539c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:38.589681 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d00ce-67dc-4040-b89c-e0e79ef6539c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:38.601751 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1296/2557] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 15:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:03:38.606290 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70035fd5-12f8-4591-806a-077b31afb4c9 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:38.615797 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70035fd5-12f8-4591-806a-077b31afb4c9 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:38.620740 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21e8cd-b2c3-4229-9c8a-ddde723c3d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:38.621405 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21e8cd-b2c3-4229-9c8a-ddde723c3d1d admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:38.621687 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21e8cd-b2c3-4229-9c8a-ddde723c3d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:38.622599 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21e8cd-b2c3-4229-9c8a-ddde723c3d1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:38.623312 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21e8cd-b2c3-4229-9c8a-ddde723c3d1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:38.625289 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21e8cd-b2c3-4229-9c8a-ddde723c3d1d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:38.655531 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1262/2558] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 15:03:38 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:03:38.659892 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d00ce-67dc-4040-b89c-e0e79ef6539c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:38.670671 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d00ce-67dc-4040-b89c-e0e79ef6539c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:38.705846 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=100 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:38.736429 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7fa0e4-a37d-4123-81ef-6b6664e2f506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:38.737115 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fa0e4-a37d-4123-81ef-6b6664e2f506 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:38.737393 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fa0e4-a37d-4123-81ef-6b6664e2f506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:38.737666 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fa0e4-a37d-4123-81ef-6b6664e2f506 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:38.738370 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7fa0e4-a37d-4123-81ef-6b6664e2f506 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:38.740354 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7fa0e4-a37d-4123-81ef-6b6664e2f506 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:38.762590 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1297/2559] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 15:03:38 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:03:38.767115 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21e8cd-b2c3-4229-9c8a-ddde723c3d1d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:38.778528 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21e8cd-b2c3-4229-9c8a-ddde723c3d1d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:38.785512 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41bbf5-3742-4dd4-afba-9deabe1d55cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:38.786151 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41bbf5-3742-4dd4-afba-9deabe1d55cc admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:38.786478 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41bbf5-3742-4dd4-afba-9deabe1d55cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:38.786754 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41bbf5-3742-4dd4-afba-9deabe1d55cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:38.787643 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41bbf5-3742-4dd4-afba-9deabe1d55cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:38.789461 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41bbf5-3742-4dd4-afba-9deabe1d55cc admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:38.801693 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1263/2560] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:38.805480 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7fa0e4-a37d-4123-81ef-6b6664e2f506 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:38.818303 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7fa0e4-a37d-4123-81ef-6b6664e2f506 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:38.824034 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb1750-adfe-4ff6-bc59-1c36efe3f2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:38.824849 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb1750-adfe-4ff6-bc59-1c36efe3f2b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:38.825116 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb1750-adfe-4ff6-bc59-1c36efe3f2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:38.825397 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb1750-adfe-4ff6-bc59-1c36efe3f2b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:38.826165 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb1750-adfe-4ff6-bc59-1c36efe3f2b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:38.827829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb1750-adfe-4ff6-bc59-1c36efe3f2b7 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:38.842153 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1298/2561] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:38.843467 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41bbf5-3742-4dd4-afba-9deabe1d55cc admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:38.854356 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41bbf5-3742-4dd4-afba-9deabe1d55cc admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:38.859471 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383b8bc-ccec-446c-8d27-d1f3a833a12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:38.860488 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383b8bc-ccec-446c-8d27-d1f3a833a12d admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:38.860768 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383b8bc-ccec-446c-8d27-d1f3a833a12d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:38.861039 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383b8bc-ccec-446c-8d27-d1f3a833a12d admin admin] PATH_INFO: `/v3/projects/8ac51578b7074314b10cff312be561b8/users/33fb317453b74f1392bd0ac5046fe668/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:38.879079 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383b8bc-ccec-446c-8d27-d1f3a833a12d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ac51578b7074314b10cff312be561b8, user_id=33fb317453b74f1392bd0ac5046fe668, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:38.881976 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383b8bc-ccec-446c-8d27-d1f3a833a12d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:38.896665 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1264/2562] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:38 2022] PUT /identity/v3/projects/8ac51578b7074314b10cff312be561b8/users/33fb317453b74f1392bd0ac5046fe668/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:38.907421 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653af58-d6ee-4f10-8b46-b74685e019b0 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:38.907727 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653af58-d6ee-4f10-8b46-b74685e019b0 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:38.908112 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653af58-d6ee-4f10-8b46-b74685e019b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:38.946007 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d653af58-d6ee-4f10-8b46-b74685e019b0 None None] MFA Rules not processed for user `33fb317453b74f1392bd0ac5046fe668`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:38.947432 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d653af58-d6ee-4f10-8b46-b74685e019b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:39.027936 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1299/2563] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:03:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:39.032783 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383b8bc-ccec-446c-8d27-d1f3a833a12d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:39.108941 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383b8bc-ccec-446c-8d27-d1f3a833a12d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:39.113674 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4413c9-b9c9-40ec-be19-15637e52f14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:39.114341 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4413c9-b9c9-40ec-be19-15637e52f14c admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:39.114625 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4413c9-b9c9-40ec-be19-15637e52f14c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:39.114935 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4413c9-b9c9-40ec-be19-15637e52f14c admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:39.115647 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4413c9-b9c9-40ec-be19-15637e52f14c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:39.117649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4413c9-b9c9-40ec-be19-15637e52f14c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:39.145409 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1265/2564] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 15:03:39 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:39.149083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653af58-d6ee-4f10-8b46-b74685e019b0 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:39.160411 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653af58-d6ee-4f10-8b46-b74685e019b0 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:39.246994 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49930fcd-f068-4f1d-a155-316ea450fca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:39.247691 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49930fcd-f068-4f1d-a155-316ea450fca5 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:39.248028 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49930fcd-f068-4f1d-a155-316ea450fca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:39.248359 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49930fcd-f068-4f1d-a155-316ea450fca5 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:39.249046 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49930fcd-f068-4f1d-a155-316ea450fca5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:39.251547 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49930fcd-f068-4f1d-a155-316ea450fca5 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:39.273873 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1300/2565] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 15:03:39 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:39.278135 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4413c9-b9c9-40ec-be19-15637e52f14c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:39.291351 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4413c9-b9c9-40ec-be19-15637e52f14c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:39.300048 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94230769-a616-469a-b255-3f35841d990d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:39.300815 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94230769-a616-469a-b255-3f35841d990d admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:39.301093 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94230769-a616-469a-b255-3f35841d990d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:39.301367 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94230769-a616-469a-b255-3f35841d990d admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:39.302103 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94230769-a616-469a-b255-3f35841d990d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:39.303725 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94230769-a616-469a-b255-3f35841d990d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:39.319160 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1266/2566] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:39.320873 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49930fcd-f068-4f1d-a155-316ea450fca5 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:39.332162 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49930fcd-f068-4f1d-a155-316ea450fca5 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:39.338360 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbecbf1-67ae-4aa1-ab18-122ced1ad1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:39.339253 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbecbf1-67ae-4aa1-ab18-122ced1ad1cd admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:39.339694 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbecbf1-67ae-4aa1-ab18-122ced1ad1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:39.340154 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbecbf1-67ae-4aa1-ab18-122ced1ad1cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:39.341683 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbecbf1-67ae-4aa1-ab18-122ced1ad1cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:39.343810 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbecbf1-67ae-4aa1-ab18-122ced1ad1cd admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:39.357685 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1301/2567] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:39.361945 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94230769-a616-469a-b255-3f35841d990d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:39.373370 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94230769-a616-469a-b255-3f35841d990d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:39.378565 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e2889-f6a9-49a5-9095-368104faa107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:39.379561 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e2889-f6a9-49a5-9095-368104faa107 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:39.379848 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e2889-f6a9-49a5-9095-368104faa107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:39.380152 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e2889-f6a9-49a5-9095-368104faa107 admin admin] PATH_INFO: `/v3/projects/f0e892f312d248919154e97a1af35135/users/083213b675374b34bd857aca9ec66838/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:39.397006 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e2889-f6a9-49a5-9095-368104faa107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0e892f312d248919154e97a1af35135, user_id=083213b675374b34bd857aca9ec66838, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:39.399732 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e2889-f6a9-49a5-9095-368104faa107 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:39.415366 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1267/2568] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:39 2022] PUT /identity/v3/projects/f0e892f312d248919154e97a1af35135/users/083213b675374b34bd857aca9ec66838/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:39.427568 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719c128-d890-46ff-a1ef-4dbd3ed1d1b1 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:39.427985 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719c128-d890-46ff-a1ef-4dbd3ed1d1b1 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:39.428284 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719c128-d890-46ff-a1ef-4dbd3ed1d1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:39.460252 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-2719c128-d890-46ff-a1ef-4dbd3ed1d1b1 None None] MFA Rules not processed for user `083213b675374b34bd857aca9ec66838`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:39.460252 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-2719c128-d890-46ff-a1ef-4dbd3ed1d1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:39.469066 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:39.546567 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1302/2569] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:03:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:39.548479 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e2889-f6a9-49a5-9095-368104faa107 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:39.566889 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:39.627104 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e2889-f6a9-49a5-9095-368104faa107 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:39.632889 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246ff28-9dc9-40f0-9983-8b70d189f446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:39.633635 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246ff28-9dc9-40f0-9983-8b70d189f446 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:39.634065 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246ff28-9dc9-40f0-9983-8b70d189f446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:39.634376 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246ff28-9dc9-40f0-9983-8b70d189f446 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:39.635218 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246ff28-9dc9-40f0-9983-8b70d189f446 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:39.637413 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246ff28-9dc9-40f0-9983-8b70d189f446 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:39.671974 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1268/2570] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 15:03:39 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:39.673228 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719c128-d890-46ff-a1ef-4dbd3ed1d1b1 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:39.686515 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719c128-d890-46ff-a1ef-4dbd3ed1d1b1 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:39.755751 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedf534-20b2-42ef-bec5-39ef73b07dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:39.756477 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedf534-20b2-42ef-bec5-39ef73b07dad admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:39.756755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedf534-20b2-42ef-bec5-39ef73b07dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:39.757026 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedf534-20b2-42ef-bec5-39ef73b07dad admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:39.757744 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bedf534-20b2-42ef-bec5-39ef73b07dad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:39.759721 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bedf534-20b2-42ef-bec5-39ef73b07dad admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:39.785414 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1303/2571] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 15:03:39 2022] POST /identity/v3/users => generated 296 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:39.789325 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246ff28-9dc9-40f0-9983-8b70d189f446 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:39.801468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246ff28-9dc9-40f0-9983-8b70d189f446 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:39.806669 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e65ac3-a426-48b2-b23d-eeeb85383d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:39.808193 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e65ac3-a426-48b2-b23d-eeeb85383d61 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:39.808508 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e65ac3-a426-48b2-b23d-eeeb85383d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:39.808787 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e65ac3-a426-48b2-b23d-eeeb85383d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:39.809540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e65ac3-a426-48b2-b23d-eeeb85383d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:39.811221 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e65ac3-a426-48b2-b23d-eeeb85383d61 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:39.828942 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1269/2572] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:39.831272 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedf534-20b2-42ef-bec5-39ef73b07dad admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:39.844795 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedf534-20b2-42ef-bec5-39ef73b07dad admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:39.850589 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3987999-707d-4183-9554-ee2aa80e9e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:39.851670 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3987999-707d-4183-9554-ee2aa80e9e2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:39.852075 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3987999-707d-4183-9554-ee2aa80e9e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:39.852445 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3987999-707d-4183-9554-ee2aa80e9e2d admin admin] PATH_INFO: `/v3/projects/90ae3b0b65324951b5fefa3f188a6f0b/users/0fd48340d8d146fe91c2e97fa533f909/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:39.870358 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3987999-707d-4183-9554-ee2aa80e9e2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=90ae3b0b65324951b5fefa3f188a6f0b, user_id=0fd48340d8d146fe91c2e97fa533f909, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:39.873299 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3987999-707d-4183-9554-ee2aa80e9e2d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:39.893507 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1304/2573] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:39 2022] PUT /identity/v3/projects/90ae3b0b65324951b5fefa3f188a6f0b/users/0fd48340d8d146fe91c2e97fa533f909/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:39.895295 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e65ac3-a426-48b2-b23d-eeeb85383d61 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:39.906298 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e65ac3-a426-48b2-b23d-eeeb85383d61 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:39.973399 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5c4d2-0638-4e14-b942-fc5f7f66a052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:39.974191 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5c4d2-0638-4e14-b942-fc5f7f66a052 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:39.974478 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5c4d2-0638-4e14-b942-fc5f7f66a052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:39.974757 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5c4d2-0638-4e14-b942-fc5f7f66a052 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:39.975762 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5c4d2-0638-4e14-b942-fc5f7f66a052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:39.977608 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5c4d2-0638-4e14-b942-fc5f7f66a052 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:39.993180 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1270/2574] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:39.994586 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3987999-707d-4183-9554-ee2aa80e9e2d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:40.006022 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3987999-707d-4183-9554-ee2aa80e9e2d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:40.011860 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cb312-d8b4-40c8-a2b5-5a892661e52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:40.012827 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cb312-d8b4-40c8-a2b5-5a892661e52d admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:40.013112 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cb312-d8b4-40c8-a2b5-5a892661e52d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:40.013392 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cb312-d8b4-40c8-a2b5-5a892661e52d admin admin] PATH_INFO: `/v3/projects/90ae3b0b65324951b5fefa3f188a6f0b/users/0fd48340d8d146fe91c2e97fa533f909/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:40.015593 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118cb312-d8b4-40c8-a2b5-5a892661e52d admin admin] RBAC: Authorizing `identity:create_grant(project_id=90ae3b0b65324951b5fefa3f188a6f0b, user_id=0fd48340d8d146fe91c2e97fa533f909, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:40.018661 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118cb312-d8b4-40c8-a2b5-5a892661e52d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:40.031926 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1305/2575] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:39 2022] PUT /identity/v3/projects/90ae3b0b65324951b5fefa3f188a6f0b/users/0fd48340d8d146fe91c2e97fa533f909/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:40.042257 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91e02b-d721-4995-b9cd-13f25ed79b8e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:40.042621 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91e02b-d721-4995-b9cd-13f25ed79b8e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:40.042818 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91e02b-d721-4995-b9cd-13f25ed79b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:40.079354 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-0b91e02b-d721-4995-b9cd-13f25ed79b8e None None] MFA Rules not processed for user `0fd48340d8d146fe91c2e97fa533f909`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:40.081138 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0b91e02b-d721-4995-b9cd-13f25ed79b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:40.167995 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1271/2576] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:03:40 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:40.179356 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cb312-d8b4-40c8-a2b5-5a892661e52d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:40.181807 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-118cb312-d8b4-40c8-a2b5-5a892661e52d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:40.242307 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cb312-d8b4-40c8-a2b5-5a892661e52d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:40.246450 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff09a3a-a5a5-4939-9248-c52ef94693ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:40.247119 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff09a3a-a5a5-4939-9248-c52ef94693ba service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:40.247429 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff09a3a-a5a5-4939-9248-c52ef94693ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:40.247818 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff09a3a-a5a5-4939-9248-c52ef94693ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:40.258467 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff09a3a-a5a5-4939-9248-c52ef94693ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:40.260131 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff09a3a-a5a5-4939-9248-c52ef94693ba service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:40.271130 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1306/2577] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:40 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:40.315254 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91e02b-d721-4995-b9cd-13f25ed79b8e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:40.316878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0b91e02b-d721-4995-b9cd-13f25ed79b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:40.330533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91e02b-d721-4995-b9cd-13f25ed79b8e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:40.334240 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375d851-a626-404b-a75d-b2636edb2906 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:40.334902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375d851-a626-404b-a75d-b2636edb2906 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:40.335195 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375d851-a626-404b-a75d-b2636edb2906 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:40.335458 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375d851-a626-404b-a75d-b2636edb2906 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:40.340082 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:40.397971 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375d851-a626-404b-a75d-b2636edb2906 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:40.399369 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375d851-a626-404b-a75d-b2636edb2906 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:40.409070 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1272/2578] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:41.138875 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff09a3a-a5a5-4939-9248-c52ef94693ba service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:41.141065 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-bff09a3a-a5a5-4939-9248-c52ef94693ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:41.149428 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:41.250697 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff09a3a-a5a5-4939-9248-c52ef94693ba service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:41.259099 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc8ac4-4b8b-422b-b416-466bde82fabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:41.260083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc8ac4-4b8b-422b-b416-466bde82fabe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:41.260550 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc8ac4-4b8b-422b-b416-466bde82fabe admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:41.260643 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc8ac4-4b8b-422b-b416-466bde82fabe admin admin] PATH_INFO: `/v3/users/571b0d0bb30042bf8be6d98c6fc8d92b` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:41.266425 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc8ac4-4b8b-422b-b416-466bde82fabe admin admin] RBAC: Authorizing `identity:delete_user(user_id=571b0d0bb30042bf8be6d98c6fc8d92b)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:41.268658 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc8ac4-4b8b-422b-b416-466bde82fabe admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:41.329887 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-67dc8ac4-4b8b-422b-b416-466bde82fabe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '571b0d0bb30042bf8be6d98c6fc8d92b'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:41.347096 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-67dc8ac4-4b8b-422b-b416-466bde82fabe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '571b0d0bb30042bf8be6d98c6fc8d92b'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:41.347973 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-67dc8ac4-4b8b-422b-b416-466bde82fabe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '571b0d0bb30042bf8be6d98c6fc8d92b'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:41.357722 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-67dc8ac4-4b8b-422b-b416-466bde82fabe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '571b0d0bb30042bf8be6d98c6fc8d92b'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:41.367907 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-67dc8ac4-4b8b-422b-b416-466bde82fabe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '571b0d0bb30042bf8be6d98c6fc8d92b'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:41.374659 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1307/2579] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 15:03:41 2022] DELETE /identity/v3/users/571b0d0bb30042bf8be6d98c6fc8d92b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:41.574997 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375d851-a626-404b-a75d-b2636edb2906 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:41.587711 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375d851-a626-404b-a75d-b2636edb2906 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:41.656595 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f36777-1210-427d-9ffc-89f93bbaee94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:41.657511 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f36777-1210-427d-9ffc-89f93bbaee94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:41.657819 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f36777-1210-427d-9ffc-89f93bbaee94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:41.658131 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f36777-1210-427d-9ffc-89f93bbaee94 admin admin] PATH_INFO: `/v3/projects/bef9b7a1552b4ae7b0218dcd3f5fd26c` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:41.659389 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f36777-1210-427d-9ffc-89f93bbaee94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bef9b7a1552b4ae7b0218dcd3f5fd26c)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:41.661480 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f36777-1210-427d-9ffc-89f93bbaee94 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:41.727603 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-00f36777-1210-427d-9ffc-89f93bbaee94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bef9b7a1552b4ae7b0218dcd3f5fd26c', 'request_id': 'req-00f36777-1210-427d-9ffc-89f93bbaee94'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:41.735187 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-00f36777-1210-427d-9ffc-89f93bbaee94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bef9b7a1552b4ae7b0218dcd3f5fd26c', 'request_id': 'req-00f36777-1210-427d-9ffc-89f93bbaee94'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:41.741127 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-00f36777-1210-427d-9ffc-89f93bbaee94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bef9b7a1552b4ae7b0218dcd3f5fd26c', 'request_id': 'req-00f36777-1210-427d-9ffc-89f93bbaee94'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:41.755307 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-00f36777-1210-427d-9ffc-89f93bbaee94 admin admin] The token cache is being invalidate because project bef9b7a1552b4ae7b0218dcd3f5fd26c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:03:41.755596 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-00f36777-1210-427d-9ffc-89f93bbaee94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:41.756330 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-00f36777-1210-427d-9ffc-89f93bbaee94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:41.757960 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1273/2580] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:03:41 2022] DELETE /identity/v3/projects/bef9b7a1552b4ae7b0218dcd3f5fd26c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:41.762173 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc8ac4-4b8b-422b-b416-466bde82fabe admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:41.763722 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-67dc8ac4-4b8b-422b-b416-466bde82fabe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:41.777800 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc8ac4-4b8b-422b-b416-466bde82fabe admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:41.857941 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b13ac-7f02-4015-b1cf-e6d2d8eb6d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:41.858830 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b13ac-7f02-4015-b1cf-e6d2d8eb6d90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:41.859161 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b13ac-7f02-4015-b1cf-e6d2d8eb6d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:41.859368 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b13ac-7f02-4015-b1cf-e6d2d8eb6d90 admin admin] PATH_INFO: `/v3/users/897ea303d4874bd5b7e7f30f43776113` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:41.860593 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b13ac-7f02-4015-b1cf-e6d2d8eb6d90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=897ea303d4874bd5b7e7f30f43776113)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:41.862560 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b13ac-7f02-4015-b1cf-e6d2d8eb6d90 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:41.901433 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:41.924051 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7c4b13ac-7f02-4015-b1cf-e6d2d8eb6d90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '897ea303d4874bd5b7e7f30f43776113'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:41.938153 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7c4b13ac-7f02-4015-b1cf-e6d2d8eb6d90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '897ea303d4874bd5b7e7f30f43776113'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:41.938976 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7c4b13ac-7f02-4015-b1cf-e6d2d8eb6d90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '897ea303d4874bd5b7e7f30f43776113'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:41.946672 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7c4b13ac-7f02-4015-b1cf-e6d2d8eb6d90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '897ea303d4874bd5b7e7f30f43776113'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:41.955168 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7c4b13ac-7f02-4015-b1cf-e6d2d8eb6d90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '897ea303d4874bd5b7e7f30f43776113'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:41.961751 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1308/2581] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 15:03:41 2022] DELETE /identity/v3/users/897ea303d4874bd5b7e7f30f43776113 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:42.149561 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f36777-1210-427d-9ffc-89f93bbaee94 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:42.151584 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-00f36777-1210-427d-9ffc-89f93bbaee94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:42.174511 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f36777-1210-427d-9ffc-89f93bbaee94 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:42.213088 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:42.243767 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c3efb-cb0f-461c-bfe6-0ef61f27d357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:42.243767 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c3efb-cb0f-461c-bfe6-0ef61f27d357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:42.243767 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c3efb-cb0f-461c-bfe6-0ef61f27d357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:42.243767 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c3efb-cb0f-461c-bfe6-0ef61f27d357 admin admin] PATH_INFO: `/v3/projects/0421d8e9e1674413a56c01b2882a546a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:42.247068 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c3efb-cb0f-461c-bfe6-0ef61f27d357 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0421d8e9e1674413a56c01b2882a546a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:42.249013 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c3efb-cb0f-461c-bfe6-0ef61f27d357 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:42.306255 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-031c3efb-cb0f-461c-bfe6-0ef61f27d357 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0421d8e9e1674413a56c01b2882a546a', 'request_id': 'req-031c3efb-cb0f-461c-bfe6-0ef61f27d357'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:42.312681 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-031c3efb-cb0f-461c-bfe6-0ef61f27d357 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0421d8e9e1674413a56c01b2882a546a', 'request_id': 'req-031c3efb-cb0f-461c-bfe6-0ef61f27d357'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:42.318246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-031c3efb-cb0f-461c-bfe6-0ef61f27d357 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0421d8e9e1674413a56c01b2882a546a', 'request_id': 'req-031c3efb-cb0f-461c-bfe6-0ef61f27d357'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:42.332349 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-031c3efb-cb0f-461c-bfe6-0ef61f27d357 admin admin] The token cache is being invalidate because project 0421d8e9e1674413a56c01b2882a546a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:03:42.332644 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-031c3efb-cb0f-461c-bfe6-0ef61f27d357 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:42.333753 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-031c3efb-cb0f-461c-bfe6-0ef61f27d357 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:42.335893 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1274/2582] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:03:42 2022] DELETE /identity/v3/projects/0421d8e9e1674413a56c01b2882a546a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:43.402535 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b13ac-7f02-4015-b1cf-e6d2d8eb6d90 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:43.410375 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-7c4b13ac-7f02-4015-b1cf-e6d2d8eb6d90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:43.427730 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b13ac-7f02-4015-b1cf-e6d2d8eb6d90 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:43.497543 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22a1d1-bb70-4a56-877e-8407ccc0ebb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:43.498442 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22a1d1-bb70-4a56-877e-8407ccc0ebb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:43.498733 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22a1d1-bb70-4a56-877e-8407ccc0ebb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:43.499006 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22a1d1-bb70-4a56-877e-8407ccc0ebb6 admin admin] PATH_INFO: `/v3/users/33fb317453b74f1392bd0ac5046fe668` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:43.500300 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22a1d1-bb70-4a56-877e-8407ccc0ebb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33fb317453b74f1392bd0ac5046fe668)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:43.502335 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22a1d1-bb70-4a56-877e-8407ccc0ebb6 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:43.563403 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8b22a1d1-bb70-4a56-877e-8407ccc0ebb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33fb317453b74f1392bd0ac5046fe668'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:43.577045 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8b22a1d1-bb70-4a56-877e-8407ccc0ebb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33fb317453b74f1392bd0ac5046fe668'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:43.577766 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8b22a1d1-bb70-4a56-877e-8407ccc0ebb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33fb317453b74f1392bd0ac5046fe668'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:43.586610 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8b22a1d1-bb70-4a56-877e-8407ccc0ebb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33fb317453b74f1392bd0ac5046fe668'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:43.594610 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8b22a1d1-bb70-4a56-877e-8407ccc0ebb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33fb317453b74f1392bd0ac5046fe668'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:43.600863 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1309/2583] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 15:03:43 2022] DELETE /identity/v3/users/33fb317453b74f1392bd0ac5046fe668 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:43.606751 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edf747-5b05-4c5e-9c81-91c2c201de60 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:43.607274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edf747-5b05-4c5e-9c81-91c2c201de60 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:43.607274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edf747-5b05-4c5e-9c81-91c2c201de60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:43.625962 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d6edf747-5b05-4c5e-9c81-91c2c201de60 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:43.627178 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d6edf747-5b05-4c5e-9c81-91c2c201de60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:43.691050 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1275/2584] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:43.701091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22a1d1-bb70-4a56-877e-8407ccc0ebb6 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:43.702670 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8b22a1d1-bb70-4a56-877e-8407ccc0ebb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:43.729926 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:43.765076 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22a1d1-bb70-4a56-877e-8407ccc0ebb6 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:43.769267 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380381bb-377b-4e9a-919b-794feef49fac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:43.769917 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380381bb-377b-4e9a-919b-794feef49fac service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:43.770207 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380381bb-377b-4e9a-919b-794feef49fac service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:43.770483 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380381bb-377b-4e9a-919b-794feef49fac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:43.780598 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380381bb-377b-4e9a-919b-794feef49fac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:43.782041 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380381bb-377b-4e9a-919b-794feef49fac service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:43.792236 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1310/2585] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:44.093713 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6edf747-5b05-4c5e-9c81-91c2c201de60 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:44.095228 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d6edf747-5b05-4c5e-9c81-91c2c201de60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:44.115691 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6edf747-5b05-4c5e-9c81-91c2c201de60 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:44.120876 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14037437-9b0c-445d-9a19-6bffc34239a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:44.121637 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14037437-9b0c-445d-9a19-6bffc34239a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:44.121898 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14037437-9b0c-445d-9a19-6bffc34239a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:44.122166 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14037437-9b0c-445d-9a19-6bffc34239a5 admin admin] PATH_INFO: `/v3/projects/8ac51578b7074314b10cff312be561b8` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:44.123415 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14037437-9b0c-445d-9a19-6bffc34239a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ac51578b7074314b10cff312be561b8)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:44.125384 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14037437-9b0c-445d-9a19-6bffc34239a5 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:44.179583 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-14037437-9b0c-445d-9a19-6bffc34239a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ac51578b7074314b10cff312be561b8', 'request_id': 'req-14037437-9b0c-445d-9a19-6bffc34239a5'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:44.188080 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-14037437-9b0c-445d-9a19-6bffc34239a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ac51578b7074314b10cff312be561b8', 'request_id': 'req-14037437-9b0c-445d-9a19-6bffc34239a5'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:44.192873 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:44.194173 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-14037437-9b0c-445d-9a19-6bffc34239a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ac51578b7074314b10cff312be561b8', 'request_id': 'req-14037437-9b0c-445d-9a19-6bffc34239a5'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:44.207919 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-14037437-9b0c-445d-9a19-6bffc34239a5 admin admin] The token cache is being invalidate because project 8ac51578b7074314b10cff312be561b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:03:44.208210 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-14037437-9b0c-445d-9a19-6bffc34239a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:44.208830 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-14037437-9b0c-445d-9a19-6bffc34239a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:44.210463 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1276/2586] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:03:44 2022] DELETE /identity/v3/projects/8ac51578b7074314b10cff312be561b8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:44.214706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380381bb-377b-4e9a-919b-794feef49fac service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:44.228078 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380381bb-377b-4e9a-919b-794feef49fac service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:44.286481 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af52f7-2367-459a-906e-98c14981c076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:44.287372 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af52f7-2367-459a-906e-98c14981c076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:44.287655 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af52f7-2367-459a-906e-98c14981c076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:44.287961 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af52f7-2367-459a-906e-98c14981c076 admin admin] PATH_INFO: `/v3/users/083213b675374b34bd857aca9ec66838` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:44.289213 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af52f7-2367-459a-906e-98c14981c076 admin admin] RBAC: Authorizing `identity:delete_user(user_id=083213b675374b34bd857aca9ec66838)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:44.291194 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af52f7-2367-459a-906e-98c14981c076 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:44.340852 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-98af52f7-2367-459a-906e-98c14981c076 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '083213b675374b34bd857aca9ec66838'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:44.353120 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-98af52f7-2367-459a-906e-98c14981c076 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '083213b675374b34bd857aca9ec66838'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:44.353844 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-98af52f7-2367-459a-906e-98c14981c076 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '083213b675374b34bd857aca9ec66838'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:44.362066 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-98af52f7-2367-459a-906e-98c14981c076 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '083213b675374b34bd857aca9ec66838'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:44.369405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-98af52f7-2367-459a-906e-98c14981c076 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '083213b675374b34bd857aca9ec66838'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:44.375522 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1311/2587] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 15:03:44 2022] DELETE /identity/v3/users/083213b675374b34bd857aca9ec66838 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:44.660879 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14037437-9b0c-445d-9a19-6bffc34239a5 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:44.662446 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-14037437-9b0c-445d-9a19-6bffc34239a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:44.676878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14037437-9b0c-445d-9a19-6bffc34239a5 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:44.739797 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b73b40-92de-4387-a39e-854b7ef968c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:44.740750 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b73b40-92de-4387-a39e-854b7ef968c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:44.741026 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b73b40-92de-4387-a39e-854b7ef968c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:44.741322 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b73b40-92de-4387-a39e-854b7ef968c3 admin admin] PATH_INFO: `/v3/projects/f0e892f312d248919154e97a1af35135` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:44.742543 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b73b40-92de-4387-a39e-854b7ef968c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0e892f312d248919154e97a1af35135)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:44.744538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b73b40-92de-4387-a39e-854b7ef968c3 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:44.804097 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-57b73b40-92de-4387-a39e-854b7ef968c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0e892f312d248919154e97a1af35135', 'request_id': 'req-57b73b40-92de-4387-a39e-854b7ef968c3'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:44.804097 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-57b73b40-92de-4387-a39e-854b7ef968c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0e892f312d248919154e97a1af35135', 'request_id': 'req-57b73b40-92de-4387-a39e-854b7ef968c3'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:44.811087 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-57b73b40-92de-4387-a39e-854b7ef968c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0e892f312d248919154e97a1af35135', 'request_id': 'req-57b73b40-92de-4387-a39e-854b7ef968c3'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:44.825792 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-57b73b40-92de-4387-a39e-854b7ef968c3 admin admin] The token cache is being invalidate because project f0e892f312d248919154e97a1af35135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:03:44.826081 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-57b73b40-92de-4387-a39e-854b7ef968c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:44.826722 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-57b73b40-92de-4387-a39e-854b7ef968c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:44.828331 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1277/2588] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:03:44 2022] DELETE /identity/v3/projects/f0e892f312d248919154e97a1af35135 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:44.832530 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af52f7-2367-459a-906e-98c14981c076 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:44.834151 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-98af52f7-2367-459a-906e-98c14981c076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:44.848108 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af52f7-2367-459a-906e-98c14981c076 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:44.900780 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:44.919154 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829692a3-1926-45fe-accf-aadceefeb1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:44.920072 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829692a3-1926-45fe-accf-aadceefeb1b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:44.920349 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829692a3-1926-45fe-accf-aadceefeb1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:44.920607 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829692a3-1926-45fe-accf-aadceefeb1b4 admin admin] PATH_INFO: `/v3/users/0fd48340d8d146fe91c2e97fa533f909` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:44.921818 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829692a3-1926-45fe-accf-aadceefeb1b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fd48340d8d146fe91c2e97fa533f909)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:44.923743 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829692a3-1926-45fe-accf-aadceefeb1b4 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:44.987662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-829692a3-1926-45fe-accf-aadceefeb1b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fd48340d8d146fe91c2e97fa533f909'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:45.000816 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-829692a3-1926-45fe-accf-aadceefeb1b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fd48340d8d146fe91c2e97fa533f909'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:45.001594 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-829692a3-1926-45fe-accf-aadceefeb1b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fd48340d8d146fe91c2e97fa533f909'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:45.012451 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-829692a3-1926-45fe-accf-aadceefeb1b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fd48340d8d146fe91c2e97fa533f909'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:45.025816 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-829692a3-1926-45fe-accf-aadceefeb1b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fd48340d8d146fe91c2e97fa533f909'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:45.032977 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1312/2589] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 15:03:44 2022] DELETE /identity/v3/users/0fd48340d8d146fe91c2e97fa533f909 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:45.325885 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b73b40-92de-4387-a39e-854b7ef968c3 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:45.327448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-57b73b40-92de-4387-a39e-854b7ef968c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:45.348592 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b73b40-92de-4387-a39e-854b7ef968c3 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:45.413450 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff97e97-5faf-4e29-8667-0c8880cfd553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:45.414340 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff97e97-5faf-4e29-8667-0c8880cfd553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:45.414625 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff97e97-5faf-4e29-8667-0c8880cfd553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:45.414901 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff97e97-5faf-4e29-8667-0c8880cfd553 admin admin] PATH_INFO: `/v3/projects/90ae3b0b65324951b5fefa3f188a6f0b` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:45.416235 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff97e97-5faf-4e29-8667-0c8880cfd553 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90ae3b0b65324951b5fefa3f188a6f0b)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:45.418166 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff97e97-5faf-4e29-8667-0c8880cfd553 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:45.442088 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:45.467489 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7ff97e97-5faf-4e29-8667-0c8880cfd553 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90ae3b0b65324951b5fefa3f188a6f0b', 'request_id': 'req-7ff97e97-5faf-4e29-8667-0c8880cfd553'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:45.474187 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7ff97e97-5faf-4e29-8667-0c8880cfd553 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90ae3b0b65324951b5fefa3f188a6f0b', 'request_id': 'req-7ff97e97-5faf-4e29-8667-0c8880cfd553'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:45.480776 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7ff97e97-5faf-4e29-8667-0c8880cfd553 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90ae3b0b65324951b5fefa3f188a6f0b', 'request_id': 'req-7ff97e97-5faf-4e29-8667-0c8880cfd553'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:45.496450 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7ff97e97-5faf-4e29-8667-0c8880cfd553 admin admin] The token cache is being invalidate because project 90ae3b0b65324951b5fefa3f188a6f0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:03:45.496738 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7ff97e97-5faf-4e29-8667-0c8880cfd553 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:45.497393 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7ff97e97-5faf-4e29-8667-0c8880cfd553 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:45.498979 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1278/2590] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:03:45 2022] DELETE /identity/v3/projects/90ae3b0b65324951b5fefa3f188a6f0b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:45.504988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef5574-5a21-46c2-99ea-887288714756 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:45.505278 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef5574-5a21-46c2-99ea-887288714756 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:45.505558 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef5574-5a21-46c2-99ea-887288714756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:45.526609 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d1ef5574-5a21-46c2-99ea-887288714756 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:45.527760 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d1ef5574-5a21-46c2-99ea-887288714756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:45.591814 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1313/2591] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:45.600849 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c8456-5480-4b09-bab5-5e9c96cddfa5 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:45.601132 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c8456-5480-4b09-bab5-5e9c96cddfa5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:45.601404 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c8456-5480-4b09-bab5-5e9c96cddfa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:45.623362 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-841c8456-5480-4b09-bab5-5e9c96cddfa5 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:45.624613 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-841c8456-5480-4b09-bab5-5e9c96cddfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:45.634238 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1279/2592] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:45.639289 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef5574-5a21-46c2-99ea-887288714756 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:45.653040 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef5574-5a21-46c2-99ea-887288714756 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:45.663388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265a518-1d24-4531-9f37-0718be583809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:45.664490 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265a518-1d24-4531-9f37-0718be583809 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:45.664979 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265a518-1d24-4531-9f37-0718be583809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:45.665428 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265a518-1d24-4531-9f37-0718be583809 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:45.666789 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265a518-1d24-4531-9f37-0718be583809 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:03:45.667204 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265a518-1d24-4531-9f37-0718be583809 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:45.668884 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265a518-1d24-4531-9f37-0718be583809 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:45.682314 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1314/2593] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 15:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:03:45.686968 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c8456-5480-4b09-bab5-5e9c96cddfa5 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:45.696626 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c8456-5480-4b09-bab5-5e9c96cddfa5 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:45.703012 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e48f39-cfc9-45a0-b3d8-cf71d16710a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:45.703714 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e48f39-cfc9-45a0-b3d8-cf71d16710a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:45.704031 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e48f39-cfc9-45a0-b3d8-cf71d16710a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:45.704307 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e48f39-cfc9-45a0-b3d8-cf71d16710a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:45.705001 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e48f39-cfc9-45a0-b3d8-cf71d16710a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:45.706916 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e48f39-cfc9-45a0-b3d8-cf71d16710a4 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:45.735099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1280/2594] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 15:03:45 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:45.739544 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265a518-1d24-4531-9f37-0718be583809 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:45.750901 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265a518-1d24-4531-9f37-0718be583809 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:45.801445 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:45.813076 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28787281-91a8-4ea1-81c0-2fc85bdcee06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:45.813755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28787281-91a8-4ea1-81c0-2fc85bdcee06 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:45.814036 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28787281-91a8-4ea1-81c0-2fc85bdcee06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:45.814310 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28787281-91a8-4ea1-81c0-2fc85bdcee06 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:45.815003 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28787281-91a8-4ea1-81c0-2fc85bdcee06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:45.817011 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28787281-91a8-4ea1-81c0-2fc85bdcee06 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:45.839605 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1315/2595] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 15:03:45 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:45.844572 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e48f39-cfc9-45a0-b3d8-cf71d16710a4 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:45.855800 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e48f39-cfc9-45a0-b3d8-cf71d16710a4 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:45.860829 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e8993-5788-4cf1-9a6a-6378dc9eabd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:45.861498 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e8993-5788-4cf1-9a6a-6378dc9eabd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:45.861810 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e8993-5788-4cf1-9a6a-6378dc9eabd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:45.862085 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e8993-5788-4cf1-9a6a-6378dc9eabd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:45.862809 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e8993-5788-4cf1-9a6a-6378dc9eabd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:45.864506 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e8993-5788-4cf1-9a6a-6378dc9eabd2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:45.875698 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1281/2596] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:45.879927 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28787281-91a8-4ea1-81c0-2fc85bdcee06 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:45.890709 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28787281-91a8-4ea1-81c0-2fc85bdcee06 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:45.896258 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7ea6c-e6d1-4836-9008-790c3f1f0c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:45.896923 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7ea6c-e6d1-4836-9008-790c3f1f0c2b admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:45.897208 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7ea6c-e6d1-4836-9008-790c3f1f0c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:45.897486 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7ea6c-e6d1-4836-9008-790c3f1f0c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:45.898217 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7ea6c-e6d1-4836-9008-790c3f1f0c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:45.899990 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7ea6c-e6d1-4836-9008-790c3f1f0c2b admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:45.912341 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1316/2597] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:45.916984 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e8993-5788-4cf1-9a6a-6378dc9eabd2 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:45.927101 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e8993-5788-4cf1-9a6a-6378dc9eabd2 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:45.932324 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647aa988-0488-4675-8376-921e473f1e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:45.932803 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647aa988-0488-4675-8376-921e473f1e38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:45.933088 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647aa988-0488-4675-8376-921e473f1e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:45.933364 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647aa988-0488-4675-8376-921e473f1e38 admin admin] PATH_INFO: `/v3/projects/5bd154070be44e88a3035f7351b7ab6f/users/2706d58221fe4c71a79cae1589a9e471/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:45.949620 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647aa988-0488-4675-8376-921e473f1e38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bd154070be44e88a3035f7351b7ab6f, user_id=2706d58221fe4c71a79cae1589a9e471, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:45.952352 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647aa988-0488-4675-8376-921e473f1e38 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:45.968520 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1282/2598] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:45 2022] PUT /identity/v3/projects/5bd154070be44e88a3035f7351b7ab6f/users/2706d58221fe4c71a79cae1589a9e471/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:03:45.981160 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd40ee-a91b-48cc-b2ab-b4118df7bb61 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:45.981421 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd40ee-a91b-48cc-b2ab-b4118df7bb61 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:45.981704 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd40ee-a91b-48cc-b2ab-b4118df7bb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:46.011248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-4fbd40ee-a91b-48cc-b2ab-b4118df7bb61 None None] MFA Rules not processed for user `2706d58221fe4c71a79cae1589a9e471`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:46.012507 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4fbd40ee-a91b-48cc-b2ab-b4118df7bb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:46.082896 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1317/2599] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:03:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:03:46.095513 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647aa988-0488-4675-8376-921e473f1e38 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:46.104977 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-647aa988-0488-4675-8376-921e473f1e38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:46.177607 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647aa988-0488-4675-8376-921e473f1e38 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:46.182981 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412840b-7e82-4bcf-bd56-b6bfa0906732 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:46.183724 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412840b-7e82-4bcf-bd56-b6bfa0906732 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:46.184077 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412840b-7e82-4bcf-bd56-b6bfa0906732 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:46.184375 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412840b-7e82-4bcf-bd56-b6bfa0906732 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:46.198497 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412840b-7e82-4bcf-bd56-b6bfa0906732 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:46.199992 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412840b-7e82-4bcf-bd56-b6bfa0906732 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:46.209869 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1283/2600] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:47.579690 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140143e9-0046-499d-9750-4ef511e0ca9f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:47.580313 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140143e9-0046-499d-9750-4ef511e0ca9f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:47.580433 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140143e9-0046-499d-9750-4ef511e0ca9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:47.600018 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-140143e9-0046-499d-9750-4ef511e0ca9f None None] MFA Rules not processed for user `2706d58221fe4c71a79cae1589a9e471`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:47.601257 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-140143e9-0046-499d-9750-4ef511e0ca9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:47.609871 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1318/2601] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:03:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:56.205344 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:DELETE=7,keystone:SELECT=68,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:57.594007 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=46,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:03.903602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dd85e-f29d-4b0e-99ad-b8411b015668 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:03.904158 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dd85e-f29d-4b0e-99ad-b8411b015668 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:03.904267 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dd85e-f29d-4b0e-99ad-b8411b015668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:03.923082 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-332dd85e-f29d-4b0e-99ad-b8411b015668 None None] MFA Rules not processed for user `db4d36e6837d4b2fa4b7ee5c7243b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:03.924473 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-332dd85e-f29d-4b0e-99ad-b8411b015668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:03.985099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1284/2602] 10.222.0.85 () {58 vars in 1009 bytes} [Thu Jun 16 15:04:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:03.999389 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140143e9-0046-499d-9750-4ef511e0ca9f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:04.001132 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-140143e9-0046-499d-9750-4ef511e0ca9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:04.081387 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140143e9-0046-499d-9750-4ef511e0ca9f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:04.089282 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478030a-7c97-4d8f-b912-f7d3e8b442cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf9c39de29324b0ca6329c9a171367c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:04.089935 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478030a-7c97-4d8f-b912-f7d3e8b442cd service swift] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:04.090212 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478030a-7c97-4d8f-b912-f7d3e8b442cd service swift] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:04.090485 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478030a-7c97-4d8f-b912-f7d3e8b442cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:04.099339 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478030a-7c97-4d8f-b912-f7d3e8b442cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:04.100980 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478030a-7c97-4d8f-b912-f7d3e8b442cd service swift] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:04.109606 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1319/2603] 10.222.0.85 () {60 vars in 1384 bytes} [Thu Jun 16 15:04:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 15:04:04.696653 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ef7cd-af8e-4c28-bd9b-20d48ea42ad0 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:04.696944 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ef7cd-af8e-4c28-bd9b-20d48ea42ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:04.697222 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ef7cd-af8e-4c28-bd9b-20d48ea42ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:04.716118 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d83ef7cd-af8e-4c28-bd9b-20d48ea42ad0 None None] MFA Rules not processed for user `db4d36e6837d4b2fa4b7ee5c7243b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:04.717330 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d83ef7cd-af8e-4c28-bd9b-20d48ea42ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:04.725521 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1285/2604] 10.222.0.85 () {58 vars in 967 bytes} [Thu Jun 16 15:04:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:04.738535 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478030a-7c97-4d8f-b912-f7d3e8b442cd service swift] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:04.752607 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478030a-7c97-4d8f-b912-f7d3e8b442cd service swift] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:04.759067 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e555fa-71fe-41eb-859a-63d4306e069c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf9c39de29324b0ca6329c9a171367c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:04.759839 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e555fa-71fe-41eb-859a-63d4306e069c service swift] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:04.760202 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e555fa-71fe-41eb-859a-63d4306e069c service swift] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:04.761238 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e555fa-71fe-41eb-859a-63d4306e069c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:04.770109 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e555fa-71fe-41eb-859a-63d4306e069c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:04.771693 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e555fa-71fe-41eb-859a-63d4306e069c service swift] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:04.780399 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1320/2605] 10.222.0.85 () {60 vars in 1384 bytes} [Thu Jun 16 15:04:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 15:04:04.991457 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c348aaa-3056-4c26-93dc-03b90cd61146 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:04.992072 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c348aaa-3056-4c26-93dc-03b90cd61146 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:04.992072 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c348aaa-3056-4c26-93dc-03b90cd61146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:05.010660 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-6c348aaa-3056-4c26-93dc-03b90cd61146 None None] MFA Rules not processed for user `db4d36e6837d4b2fa4b7ee5c7243b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:05.012090 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6c348aaa-3056-4c26-93dc-03b90cd61146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:05.020816 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1286/2606] 10.222.0.85 () {58 vars in 1009 bytes} [Thu Jun 16 15:04:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:05.033515 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e555fa-71fe-41eb-859a-63d4306e069c service swift] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:05.045256 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e555fa-71fe-41eb-859a-63d4306e069c service swift] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:05.051209 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a2e5c-54f6-40c6-8af1-86f1fdadf281 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf9c39de29324b0ca6329c9a171367c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:05.051844 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a2e5c-54f6-40c6-8af1-86f1fdadf281 service swift] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:05.052181 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a2e5c-54f6-40c6-8af1-86f1fdadf281 service swift] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:05.052457 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a2e5c-54f6-40c6-8af1-86f1fdadf281 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:05.061709 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a2e5c-54f6-40c6-8af1-86f1fdadf281 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:05.063386 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a2e5c-54f6-40c6-8af1-86f1fdadf281 service swift] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:05.071887 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1321/2607] 10.222.0.85 () {60 vars in 1384 bytes} [Thu Jun 16 15:04:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 15:04:05.417559 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949aeada-d29e-4598-aed1-7d97681bb885 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:05.417865 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949aeada-d29e-4598-aed1-7d97681bb885 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:05.418140 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949aeada-d29e-4598-aed1-7d97681bb885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:05.437513 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-949aeada-d29e-4598-aed1-7d97681bb885 None None] MFA Rules not processed for user `db4d36e6837d4b2fa4b7ee5c7243b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:05.438653 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-949aeada-d29e-4598-aed1-7d97681bb885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:05.446798 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1287/2608] 10.222.0.85 () {58 vars in 967 bytes} [Thu Jun 16 15:04:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:05.459422 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a2e5c-54f6-40c6-8af1-86f1fdadf281 service swift] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:05.471426 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a2e5c-54f6-40c6-8af1-86f1fdadf281 service swift] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:05.477289 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f953ed9-563f-4833-82d7-f8bd0cef0cbc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf9c39de29324b0ca6329c9a171367c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:05.477928 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f953ed9-563f-4833-82d7-f8bd0cef0cbc service swift] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:05.478212 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f953ed9-563f-4833-82d7-f8bd0cef0cbc service swift] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:05.478491 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f953ed9-563f-4833-82d7-f8bd0cef0cbc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:05.487645 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f953ed9-563f-4833-82d7-f8bd0cef0cbc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:05.489267 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f953ed9-563f-4833-82d7-f8bd0cef0cbc service swift] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:05.497937 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1322/2609] 10.222.0.85 () {60 vars in 1384 bytes} [Thu Jun 16 15:04:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 15:04:07.695791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949aeada-d29e-4598-aed1-7d97681bb885 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:07.763142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949aeada-d29e-4598-aed1-7d97681bb885 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:07.769337 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae8578-a37f-4e26-896c-b497f474107e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:07.770235 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae8578-a37f-4e26-896c-b497f474107e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:07.770522 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae8578-a37f-4e26-896c-b497f474107e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:07.771327 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae8578-a37f-4e26-896c-b497f474107e admin admin] PATH_INFO: `/v3/users/2706d58221fe4c71a79cae1589a9e471` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:07.772216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae8578-a37f-4e26-896c-b497f474107e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2706d58221fe4c71a79cae1589a9e471)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:07.774307 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae8578-a37f-4e26-896c-b497f474107e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:07.839774 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-09ae8578-a37f-4e26-896c-b497f474107e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2706d58221fe4c71a79cae1589a9e471'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:07.847586 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-09ae8578-a37f-4e26-896c-b497f474107e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2706d58221fe4c71a79cae1589a9e471'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:07.857298 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-09ae8578-a37f-4e26-896c-b497f474107e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2706d58221fe4c71a79cae1589a9e471'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:07.870885 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-09ae8578-a37f-4e26-896c-b497f474107e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2706d58221fe4c71a79cae1589a9e471'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:07.871566 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-09ae8578-a37f-4e26-896c-b497f474107e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2706d58221fe4c71a79cae1589a9e471'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:07.877620 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1288/2610] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 15:04:07 2022] DELETE /identity/v3/users/2706d58221fe4c71a79cae1589a9e471 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:07.882414 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e087a-b3f5-4e0c-9005-b7531e0c6040 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:07.882906 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e087a-b3f5-4e0c-9005-b7531e0c6040 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:07.883008 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e087a-b3f5-4e0c-9005-b7531e0c6040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:07.902214 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-a82e087a-b3f5-4e0c-9005-b7531e0c6040 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:07.903735 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a82e087a-b3f5-4e0c-9005-b7531e0c6040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:07.967283 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1323/2611] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:04:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:07.977467 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae8578-a37f-4e26-896c-b497f474107e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:07.979040 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-09ae8578-a37f-4e26-896c-b497f474107e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:07.986537 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:08.056920 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae8578-a37f-4e26-896c-b497f474107e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:08.061817 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24beac90-ca13-432d-a2b6-9aafbb0d86ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:08.062514 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24beac90-ca13-432d-a2b6-9aafbb0d86ac service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:08.062823 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24beac90-ca13-432d-a2b6-9aafbb0d86ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:08.063101 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24beac90-ca13-432d-a2b6-9aafbb0d86ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:08.075506 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24beac90-ca13-432d-a2b6-9aafbb0d86ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:08.077346 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24beac90-ca13-432d-a2b6-9aafbb0d86ac service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:08.088698 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1289/2612] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:04:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:04:08.266606 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e087a-b3f5-4e0c-9005-b7531e0c6040 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:08.268334 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a82e087a-b3f5-4e0c-9005-b7531e0c6040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:08.281420 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e087a-b3f5-4e0c-9005-b7531e0c6040 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:08.287401 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68320c-8b24-4c09-bedb-037b2bf0c73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:08.288313 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68320c-8b24-4c09-bedb-037b2bf0c73a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:08.288594 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68320c-8b24-4c09-bedb-037b2bf0c73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:08.288863 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68320c-8b24-4c09-bedb-037b2bf0c73a admin admin] PATH_INFO: `/v3/projects/5bd154070be44e88a3035f7351b7ab6f` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:08.290216 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68320c-8b24-4c09-bedb-037b2bf0c73a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bd154070be44e88a3035f7351b7ab6f)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:08.292273 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68320c-8b24-4c09-bedb-037b2bf0c73a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:08.342123 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:08.346693 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8a68320c-8b24-4c09-bedb-037b2bf0c73a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bd154070be44e88a3035f7351b7ab6f', 'request_id': 'req-8a68320c-8b24-4c09-bedb-037b2bf0c73a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:08.353110 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8a68320c-8b24-4c09-bedb-037b2bf0c73a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bd154070be44e88a3035f7351b7ab6f', 'request_id': 'req-8a68320c-8b24-4c09-bedb-037b2bf0c73a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:08.360388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8a68320c-8b24-4c09-bedb-037b2bf0c73a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bd154070be44e88a3035f7351b7ab6f', 'request_id': 'req-8a68320c-8b24-4c09-bedb-037b2bf0c73a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:08.375819 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8a68320c-8b24-4c09-bedb-037b2bf0c73a admin admin] The token cache is being invalidate because project 5bd154070be44e88a3035f7351b7ab6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:04:08.376383 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8a68320c-8b24-4c09-bedb-037b2bf0c73a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:08.377391 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-8a68320c-8b24-4c09-bedb-037b2bf0c73a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:08.380105 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1324/2613] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:04:08 2022] DELETE /identity/v3/projects/5bd154070be44e88a3035f7351b7ab6f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:08.386065 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd081d8-635e-4c51-a4af-d310e75dd642 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:08.386329 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd081d8-635e-4c51-a4af-d310e75dd642 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:08.386706 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd081d8-635e-4c51-a4af-d310e75dd642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:08.410273 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-8fd081d8-635e-4c51-a4af-d310e75dd642 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:08.411594 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8fd081d8-635e-4c51-a4af-d310e75dd642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:08.478910 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1290/2614] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:04:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:08.488081 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47eff7c-22a0-4c29-b3aa-5dbbb8e96a0a None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:08.488337 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47eff7c-22a0-4c29-b3aa-5dbbb8e96a0a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:08.488646 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47eff7c-22a0-4c29-b3aa-5dbbb8e96a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:08.512440 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b47eff7c-22a0-4c29-b3aa-5dbbb8e96a0a None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:08.513668 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b47eff7c-22a0-4c29-b3aa-5dbbb8e96a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:08.522568 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1325/2615] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:04:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:08.527454 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd081d8-635e-4c51-a4af-d310e75dd642 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:08.538835 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd081d8-635e-4c51-a4af-d310e75dd642 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:08.545122 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027d4fe-f21d-4336-8f4b-60c40c34d802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:08.545796 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027d4fe-f21d-4336-8f4b-60c40c34d802 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:08.546076 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027d4fe-f21d-4336-8f4b-60c40c34d802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:08.546353 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027d4fe-f21d-4336-8f4b-60c40c34d802 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:08.547142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027d4fe-f21d-4336-8f4b-60c40c34d802 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:04:08.547456 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027d4fe-f21d-4336-8f4b-60c40c34d802 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:08.549225 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027d4fe-f21d-4336-8f4b-60c40c34d802 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:08.566717 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1291/2616] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 15:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:04:08.571907 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47eff7c-22a0-4c29-b3aa-5dbbb8e96a0a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:08.584015 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47eff7c-22a0-4c29-b3aa-5dbbb8e96a0a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:08.589634 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23055a5d-4e57-42d7-9ecf-fd24bf0b57f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:08.589991 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23055a5d-4e57-42d7-9ecf-fd24bf0b57f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:08.590275 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23055a5d-4e57-42d7-9ecf-fd24bf0b57f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:08.590577 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23055a5d-4e57-42d7-9ecf-fd24bf0b57f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:08.592203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23055a5d-4e57-42d7-9ecf-fd24bf0b57f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:08.593253 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23055a5d-4e57-42d7-9ecf-fd24bf0b57f9 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:08.625632 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1326/2617] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 15:04:08 2022] POST /identity/v3/projects => generated 399 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:08.630322 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027d4fe-f21d-4336-8f4b-60c40c34d802 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:08.641532 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027d4fe-f21d-4336-8f4b-60c40c34d802 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:08.706668 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a75a1-3fbe-4c91-b170-894336313613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:08.707694 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a75a1-3fbe-4c91-b170-894336313613 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:08.708113 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a75a1-3fbe-4c91-b170-894336313613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:08.708572 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a75a1-3fbe-4c91-b170-894336313613 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:08.709581 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a75a1-3fbe-4c91-b170-894336313613 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:08.712198 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a75a1-3fbe-4c91-b170-894336313613 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:08.736669 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1292/2618] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 15:04:08 2022] POST /identity/v3/users => generated 300 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:08.741307 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23055a5d-4e57-42d7-9ecf-fd24bf0b57f9 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:08.753554 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23055a5d-4e57-42d7-9ecf-fd24bf0b57f9 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:08.759463 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0a201-22fa-4c7a-a30f-c6f5a57ac7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:08.760204 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0a201-22fa-4c7a-a30f-c6f5a57ac7df admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:08.760762 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0a201-22fa-4c7a-a30f-c6f5a57ac7df admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:08.761492 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0a201-22fa-4c7a-a30f-c6f5a57ac7df admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:08.762227 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0a201-22fa-4c7a-a30f-c6f5a57ac7df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:08.763895 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0a201-22fa-4c7a-a30f-c6f5a57ac7df admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:08.775604 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1327/2619] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:08.781006 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a75a1-3fbe-4c91-b170-894336313613 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:08.793089 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a75a1-3fbe-4c91-b170-894336313613 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:08.798306 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342dc91-315e-42bf-91c6-cf0dafb714d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:08.799013 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342dc91-315e-42bf-91c6-cf0dafb714d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:08.799301 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342dc91-315e-42bf-91c6-cf0dafb714d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:08.799562 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342dc91-315e-42bf-91c6-cf0dafb714d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:08.800355 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f342dc91-315e-42bf-91c6-cf0dafb714d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:08.802017 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f342dc91-315e-42bf-91c6-cf0dafb714d7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:08.813301 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1293/2620] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:08.817846 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0a201-22fa-4c7a-a30f-c6f5a57ac7df admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:08.831449 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0a201-22fa-4c7a-a30f-c6f5a57ac7df admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:08.836568 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843da3e5-9475-494a-9302-d597f7bd3595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:08.837504 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843da3e5-9475-494a-9302-d597f7bd3595 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:08.837762 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843da3e5-9475-494a-9302-d597f7bd3595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:08.838030 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843da3e5-9475-494a-9302-d597f7bd3595 admin admin] PATH_INFO: `/v3/projects/0498ae2390f743deab06fd3680862d3d/users/ce23cd53b05f483894597aab40ac8fb2/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:08.855509 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843da3e5-9475-494a-9302-d597f7bd3595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0498ae2390f743deab06fd3680862d3d, user_id=ce23cd53b05f483894597aab40ac8fb2, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:08.858503 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843da3e5-9475-494a-9302-d597f7bd3595 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:08.878376 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1328/2621] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:04:08 2022] PUT /identity/v3/projects/0498ae2390f743deab06fd3680862d3d/users/ce23cd53b05f483894597aab40ac8fb2/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:08.889984 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218d4f1-e6fd-4e39-85b1-f6ba09462e97 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:08.890274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218d4f1-e6fd-4e39-85b1-f6ba09462e97 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:08.890550 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218d4f1-e6fd-4e39-85b1-f6ba09462e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:08.917168 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:08.920924 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-7218d4f1-e6fd-4e39-85b1-f6ba09462e97 None None] MFA Rules not processed for user `ce23cd53b05f483894597aab40ac8fb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:08.923495 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7218d4f1-e6fd-4e39-85b1-f6ba09462e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:08.998800 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1294/2622] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:04:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:09.010902 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843da3e5-9475-494a-9302-d597f7bd3595 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:09.012785 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-843da3e5-9475-494a-9302-d597f7bd3595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:09.079058 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843da3e5-9475-494a-9302-d597f7bd3595 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:09.083755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e78e9c-77b1-4c92-ad0e-f4522258c0e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:09.084659 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e78e9c-77b1-4c92-ad0e-f4522258c0e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:09.085092 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e78e9c-77b1-4c92-ad0e-f4522258c0e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:09.085526 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e78e9c-77b1-4c92-ad0e-f4522258c0e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:09.095326 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e78e9c-77b1-4c92-ad0e-f4522258c0e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:09.096847 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e78e9c-77b1-4c92-ad0e-f4522258c0e5 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:09.107328 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1329/2623] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:04:09 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:04:14.174932 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7218d4f1-e6fd-4e39-85b1-f6ba09462e97 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:14.251865 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7218d4f1-e6fd-4e39-85b1-f6ba09462e97 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:14.257351 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3cf90d-45f7-4e8a-b941-b8404af6617a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:14.258231 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cf90d-45f7-4e8a-b941-b8404af6617a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:14.258520 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cf90d-45f7-4e8a-b941-b8404af6617a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:14.258801 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cf90d-45f7-4e8a-b941-b8404af6617a admin admin] PATH_INFO: `/v3/users/ce23cd53b05f483894597aab40ac8fb2` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:14.260041 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3cf90d-45f7-4e8a-b941-b8404af6617a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce23cd53b05f483894597aab40ac8fb2)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:14.262122 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3cf90d-45f7-4e8a-b941-b8404af6617a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:14.314225 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8f3cf90d-45f7-4e8a-b941-b8404af6617a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce23cd53b05f483894597aab40ac8fb2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:14.321368 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8f3cf90d-45f7-4e8a-b941-b8404af6617a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce23cd53b05f483894597aab40ac8fb2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:14.330253 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8f3cf90d-45f7-4e8a-b941-b8404af6617a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce23cd53b05f483894597aab40ac8fb2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:14.342800 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8f3cf90d-45f7-4e8a-b941-b8404af6617a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce23cd53b05f483894597aab40ac8fb2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:14.343496 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8f3cf90d-45f7-4e8a-b941-b8404af6617a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce23cd53b05f483894597aab40ac8fb2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:14.349546 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1295/2624] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 15:04:14 2022] DELETE /identity/v3/users/ce23cd53b05f483894597aab40ac8fb2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:14.354160 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c3ccb-b7a8-44c4-8a14-8d006f55253f None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:14.354762 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c3ccb-b7a8-44c4-8a14-8d006f55253f None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:14.354951 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c3ccb-b7a8-44c4-8a14-8d006f55253f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:14.374444 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-9f7c3ccb-b7a8-44c4-8a14-8d006f55253f None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:14.375670 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9f7c3ccb-b7a8-44c4-8a14-8d006f55253f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:14.448582 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1330/2625] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:04:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:14.458657 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3cf90d-45f7-4e8a-b941-b8404af6617a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:14.460290 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8f3cf90d-45f7-4e8a-b941-b8404af6617a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:14.489302 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:14.523224 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3cf90d-45f7-4e8a-b941-b8404af6617a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:14.527353 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab106a0-4ba0-440d-a79f-3412fb7a6330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:14.528338 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab106a0-4ba0-440d-a79f-3412fb7a6330 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:14.528645 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab106a0-4ba0-440d-a79f-3412fb7a6330 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:14.528912 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab106a0-4ba0-440d-a79f-3412fb7a6330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:14.539148 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab106a0-4ba0-440d-a79f-3412fb7a6330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:14.540654 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab106a0-4ba0-440d-a79f-3412fb7a6330 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:14.552292 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1296/2626] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:04:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:04:14.842853 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c3ccb-b7a8-44c4-8a14-8d006f55253f None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:14.844658 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9f7c3ccb-b7a8-44c4-8a14-8d006f55253f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:14.858879 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c3ccb-b7a8-44c4-8a14-8d006f55253f None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:14.864663 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558cfa71-e523-45ec-945c-89a086febc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:14.865661 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cfa71-e523-45ec-945c-89a086febc8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:14.866624 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cfa71-e523-45ec-945c-89a086febc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:14.866624 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cfa71-e523-45ec-945c-89a086febc8c admin admin] PATH_INFO: `/v3/projects/0498ae2390f743deab06fd3680862d3d` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:14.867682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558cfa71-e523-45ec-945c-89a086febc8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0498ae2390f743deab06fd3680862d3d)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:14.870198 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558cfa71-e523-45ec-945c-89a086febc8c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:14.879946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:14.927333 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-558cfa71-e523-45ec-945c-89a086febc8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0498ae2390f743deab06fd3680862d3d', 'request_id': 'req-558cfa71-e523-45ec-945c-89a086febc8c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:14.933310 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-558cfa71-e523-45ec-945c-89a086febc8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0498ae2390f743deab06fd3680862d3d', 'request_id': 'req-558cfa71-e523-45ec-945c-89a086febc8c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:14.940018 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-558cfa71-e523-45ec-945c-89a086febc8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0498ae2390f743deab06fd3680862d3d', 'request_id': 'req-558cfa71-e523-45ec-945c-89a086febc8c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:14.953580 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-558cfa71-e523-45ec-945c-89a086febc8c admin admin] The token cache is being invalidate because project 0498ae2390f743deab06fd3680862d3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:04:14.953952 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-558cfa71-e523-45ec-945c-89a086febc8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:14.954531 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-558cfa71-e523-45ec-945c-89a086febc8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:14.956279 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1331/2627] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:04:14 2022] DELETE /identity/v3/projects/0498ae2390f743deab06fd3680862d3d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:24.546558 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=16 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:24.950348 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:43.792742 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91fcea-082b-4a6c-9fee-cd9035b6f20f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:43.793314 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91fcea-082b-4a6c-9fee-cd9035b6f20f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:43.793314 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91fcea-082b-4a6c-9fee-cd9035b6f20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:43.811503 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-de91fcea-082b-4a6c-9fee-cd9035b6f20f None None] MFA Rules not processed for user `431f66d8c09d4eb194600509e7300bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:43.812841 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-de91fcea-082b-4a6c-9fee-cd9035b6f20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:43.888626 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1297/2628] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:04:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:45.018140 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558cfa71-e523-45ec-945c-89a086febc8c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:45.019682 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-558cfa71-e523-45ec-945c-89a086febc8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:45.100754 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558cfa71-e523-45ec-945c-89a086febc8c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:45.106018 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10dc77a-28f2-46b7-b305-4ea5a691725e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819ad532defb4adaa2f4fd06b47630d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:45.106734 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dc77a-28f2-46b7-b305-4ea5a691725e service placement] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:45.107438 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dc77a-28f2-46b7-b305-4ea5a691725e service placement] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:45.107561 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dc77a-28f2-46b7-b305-4ea5a691725e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:45.109525 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a10dc77a-28f2-46b7-b305-4ea5a691725e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:45.121772 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10dc77a-28f2-46b7-b305-4ea5a691725e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:45.123395 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10dc77a-28f2-46b7-b305-4ea5a691725e service placement] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:45.133965 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1332/2629] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:04:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:04:53.880860 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=25 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:55.129737 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=32 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:18.073167 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccb69b-507f-416d-bb80-a5c7fabec66e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:18.073670 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccb69b-507f-416d-bb80-a5c7fabec66e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:18.073766 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccb69b-507f-416d-bb80-a5c7fabec66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:18.092365 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5cccb69b-507f-416d-bb80-a5c7fabec66e None None] MFA Rules not processed for user `db4d36e6837d4b2fa4b7ee5c7243b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:18.093494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5cccb69b-507f-416d-bb80-a5c7fabec66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:18.152348 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1298/2630] 10.222.0.85 () {58 vars in 1009 bytes} [Thu Jun 16 15:05:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:18.203225 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10dc77a-28f2-46b7-b305-4ea5a691725e service placement] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:18.205002 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a10dc77a-28f2-46b7-b305-4ea5a691725e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:18.279248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10dc77a-28f2-46b7-b305-4ea5a691725e service placement] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:18.285310 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8600b9-6060-43c7-b0d3-81d965b64e7c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf9c39de29324b0ca6329c9a171367c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:18.285961 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8600b9-6060-43c7-b0d3-81d965b64e7c service swift] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:18.286236 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8600b9-6060-43c7-b0d3-81d965b64e7c service swift] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:18.286511 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8600b9-6060-43c7-b0d3-81d965b64e7c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:18.295166 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8600b9-6060-43c7-b0d3-81d965b64e7c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:18.296791 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8600b9-6060-43c7-b0d3-81d965b64e7c service swift] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:18.305289 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1333/2631] 10.222.0.85 () {60 vars in 1384 bytes} [Thu Jun 16 15:05:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 15:05:28.143297 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=25 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:28.302149 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=32 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:34.882569 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7353a-4333-40ea-95bb-1c63b993abcd None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:34.883232 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7353a-4333-40ea-95bb-1c63b993abcd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:34.883756 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7353a-4333-40ea-95bb-1c63b993abcd None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:34.886623 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1299/2632] 10.222.0.85 () {54 vars in 921 bytes} [Thu Jun 16 15:05:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 15:05:34.893431 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986e441-fbcc-4b93-9e65-31fcb57ed979 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:34.894347 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986e441-fbcc-4b93-9e65-31fcb57ed979 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:34.894824 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986e441-fbcc-4b93-9e65-31fcb57ed979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:34.916208 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d986e441-fbcc-4b93-9e65-31fcb57ed979 None None] MFA Rules not processed for user `c74e4d1bdaa64ed280cc5f4c8e79b842`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:34.918071 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d986e441-fbcc-4b93-9e65-31fcb57ed979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:35.004433 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1334/2633] 10.222.0.85 () {58 vars in 1018 bytes} [Thu Jun 16 15:05:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:35.018226 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7353a-4333-40ea-95bb-1c63b993abcd None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:35.021022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-83c7353a-4333-40ea-95bb-1c63b993abcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:35.092832 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7353a-4333-40ea-95bb-1c63b993abcd None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:35.096382 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f7327-7b0e-40e6-8d87-a4ade728c5a8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819a7d47f644bc18e6d07a125826d76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:35.097109 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f7327-7b0e-40e6-8d87-a4ade728c5a8 service glance] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:35.097411 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f7327-7b0e-40e6-8d87-a4ade728c5a8 service glance] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:35.097742 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f7327-7b0e-40e6-8d87-a4ade728c5a8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:35.108300 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f7327-7b0e-40e6-8d87-a4ade728c5a8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:35.109772 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f7327-7b0e-40e6-8d87-a4ade728c5a8 service glance] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:35.120926 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1300/2634] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:05:35.205484 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b63e27-4fb1-42f2-a371-d0374362b5a4 None None] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:35.205720 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b63e27-4fb1-42f2-a371-d0374362b5a4 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:35.205936 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b63e27-4fb1-42f2-a371-d0374362b5a4 None None] PATH_INFO: `/` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:35.207979 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1335/2635] 10.222.0.85 () {54 vars in 921 bytes} [Thu Jun 16 15:05:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 15:05:35.214086 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb85a4-c23d-4e05-bf5d-46cf645a4c94 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:35.214376 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb85a4-c23d-4e05-bf5d-46cf645a4c94 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:35.214658 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb85a4-c23d-4e05-bf5d-46cf645a4c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:35.247197 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f3fb85a4-c23d-4e05-bf5d-46cf645a4c94 None None] MFA Rules not processed for user `3d3d59fabcf94718bbc005519cec6f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:35.248542 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f3fb85a4-c23d-4e05-bf5d-46cf645a4c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:35.309681 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1301/2636] 10.222.0.85 () {58 vars in 1018 bytes} [Thu Jun 16 15:05:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:35.321641 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b63e27-4fb1-42f2-a371-d0374362b5a4 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:35.323471 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-63b63e27-4fb1-42f2-a371-d0374362b5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:35.341351 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b63e27-4fb1-42f2-a371-d0374362b5a4 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:35.345504 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a8c06-307d-45e2-b7cc-0a0393ee2992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:35.346143 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a8c06-307d-45e2-b7cc-0a0393ee2992 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:35.346426 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a8c06-307d-45e2-b7cc-0a0393ee2992 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:35.346725 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a8c06-307d-45e2-b7cc-0a0393ee2992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:35.355214 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a8c06-307d-45e2-b7cc-0a0393ee2992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:35.356703 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a8c06-307d-45e2-b7cc-0a0393ee2992 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:35.366021 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1336/2637] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:05:35.459309 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b74929-2089-46e6-96fa-3406cf194b0c None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:35.459562 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b74929-2089-46e6-96fa-3406cf194b0c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:35.459839 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b74929-2089-46e6-96fa-3406cf194b0c None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:35.461299 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1302/2638] 10.222.0.85 () {54 vars in 921 bytes} [Thu Jun 16 15:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 15:05:35.468730 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c164df8-f20d-4773-8c89-a5d736242baf None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:35.469258 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c164df8-f20d-4773-8c89-a5d736242baf None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:35.469791 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c164df8-f20d-4773-8c89-a5d736242baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:35.491345 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-4c164df8-f20d-4773-8c89-a5d736242baf None None] MFA Rules not processed for user `c74e4d1bdaa64ed280cc5f4c8e79b842`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:35.492625 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4c164df8-f20d-4773-8c89-a5d736242baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:35.503028 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1337/2639] 10.222.0.85 () {58 vars in 1018 bytes} [Thu Jun 16 15:05:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:35.515228 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b74929-2089-46e6-96fa-3406cf194b0c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:35.533955 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b74929-2089-46e6-96fa-3406cf194b0c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:35.539377 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73efc67-259a-4c05-9dfb-e2800473a529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:35.540500 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73efc67-259a-4c05-9dfb-e2800473a529 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:35.541001 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73efc67-259a-4c05-9dfb-e2800473a529 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:35.541486 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73efc67-259a-4c05-9dfb-e2800473a529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:35.556699 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73efc67-259a-4c05-9dfb-e2800473a529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:35.558673 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73efc67-259a-4c05-9dfb-e2800473a529 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:35.573520 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1303/2640] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:05:37.285524 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920d63c-8171-4b06-836a-feb4d22b1cd3 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:37.286070 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920d63c-8171-4b06-836a-feb4d22b1cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:37.286070 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920d63c-8171-4b06-836a-feb4d22b1cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:37.304959 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-1920d63c-8171-4b06-836a-feb4d22b1cd3 None None] MFA Rules not processed for user `db4d36e6837d4b2fa4b7ee5c7243b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:37.306255 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1920d63c-8171-4b06-836a-feb4d22b1cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:37.314010 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1338/2641] 10.222.0.85 () {58 vars in 1009 bytes} [Thu Jun 16 15:05:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:37.326298 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73efc67-259a-4c05-9dfb-e2800473a529 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:37.338698 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73efc67-259a-4c05-9dfb-e2800473a529 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:37.345192 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451e41f-7938-45b3-b47c-4fb7fbee91c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf9c39de29324b0ca6329c9a171367c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:37.345785 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451e41f-7938-45b3-b47c-4fb7fbee91c6 service swift] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:37.346204 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451e41f-7938-45b3-b47c-4fb7fbee91c6 service swift] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:37.346486 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451e41f-7938-45b3-b47c-4fb7fbee91c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:37.355842 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451e41f-7938-45b3-b47c-4fb7fbee91c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:37.357495 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451e41f-7938-45b3-b47c-4fb7fbee91c6 service swift] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:37.366192 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1304/2642] 10.222.0.85 () {60 vars in 1384 bytes} [Thu Jun 16 15:05:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 15:05:47.299012 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=43 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:47.362599 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=61 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:59.225919 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f5d06-678c-4e26-a9b0-8d04f3b1d954 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:59.226461 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f5d06-678c-4e26-a9b0-8d04f3b1d954 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:59.226461 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f5d06-678c-4e26-a9b0-8d04f3b1d954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:59.245567 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-967f5d06-678c-4e26-a9b0-8d04f3b1d954 None None] MFA Rules not processed for user `db4d36e6837d4b2fa4b7ee5c7243b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:59.246786 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-967f5d06-678c-4e26-a9b0-8d04f3b1d954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:59.255588 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1339/2643] 10.222.0.85 () {58 vars in 967 bytes} [Thu Jun 16 15:05:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:59.271490 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451e41f-7938-45b3-b47c-4fb7fbee91c6 service swift] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:59.283089 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451e41f-7938-45b3-b47c-4fb7fbee91c6 service swift] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:59.289494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2c387-e1a9-4f92-963b-368aa1463337 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf9c39de29324b0ca6329c9a171367c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:59.290131 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2c387-e1a9-4f92-963b-368aa1463337 service swift] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:59.290412 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2c387-e1a9-4f92-963b-368aa1463337 service swift] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:59.290687 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2c387-e1a9-4f92-963b-368aa1463337 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:59.299349 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2c387-e1a9-4f92-963b-368aa1463337 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:59.300965 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2c387-e1a9-4f92-963b-368aa1463337 service swift] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:59.309251 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1305/2644] 10.222.0.85 () {60 vars in 1384 bytes} [Thu Jun 16 15:05:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 15:06:09.239562 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:09.306022 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=6 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:27.754361 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f5d06-678c-4e26-a9b0-8d04f3b1d954 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:27.755972 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-967f5d06-678c-4e26-a9b0-8d04f3b1d954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:27.819223 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f5d06-678c-4e26-a9b0-8d04f3b1d954 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:27.824661 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17d9f4-77fd-43bf-9f56-ec7efdb4a0db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:27.825305 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17d9f4-77fd-43bf-9f56-ec7efdb4a0db service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:27.825651 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17d9f4-77fd-43bf-9f56-ec7efdb4a0db service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:27.826013 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17d9f4-77fd-43bf-9f56-ec7efdb4a0db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:27.828054 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-bc17d9f4-77fd-43bf-9f56-ec7efdb4a0db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:27.846983 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17d9f4-77fd-43bf-9f56-ec7efdb4a0db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:27.849046 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17d9f4-77fd-43bf-9f56-ec7efdb4a0db service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:27.861349 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1340/2645] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:06:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:06:30.526791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2c387-e1a9-4f92-963b-368aa1463337 service swift] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:30.529216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-caf2c387-e1a9-4f92-963b-368aa1463337 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:30.548327 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2c387-e1a9-4f92-963b-368aa1463337 service swift] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:30.552714 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d8bb4-c178-4d3e-a8da-cf8a234e09ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:30.553361 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d8bb4-c178-4d3e-a8da-cf8a234e09ed service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:30.553623 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d8bb4-c178-4d3e-a8da-cf8a234e09ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:30.553963 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d8bb4-c178-4d3e-a8da-cf8a234e09ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:30.556057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-857d8bb4-c178-4d3e-a8da-cf8a234e09ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:30.572429 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d8bb4-c178-4d3e-a8da-cf8a234e09ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:30.573960 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d8bb4-c178-4d3e-a8da-cf8a234e09ed service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:30.587017 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1306/2646] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:06:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:06:37.855603 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=26 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:40.580968 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=6 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:41.202425 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17d9f4-77fd-43bf-9f56-ec7efdb4a0db service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:41.216124 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17d9f4-77fd-43bf-9f56-ec7efdb4a0db service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:41.220041 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334b349-81a0-4259-95a2-21b14d8c8352 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:41.220687 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334b349-81a0-4259-95a2-21b14d8c8352 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:41.220971 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334b349-81a0-4259-95a2-21b14d8c8352 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:41.221249 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334b349-81a0-4259-95a2-21b14d8c8352 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:41.223071 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e334b349-81a0-4259-95a2-21b14d8c8352 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:41.297000 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334b349-81a0-4259-95a2-21b14d8c8352 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:41.298484 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334b349-81a0-4259-95a2-21b14d8c8352 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:41.308801 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1341/2647] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:06:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:06:44.587016 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d8bb4-c178-4d3e-a8da-cf8a234e09ed service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:44.589104 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-857d8bb4-c178-4d3e-a8da-cf8a234e09ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:44.608619 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d8bb4-c178-4d3e-a8da-cf8a234e09ed service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:44.613173 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdcd4bf-f41f-4507-9a4a-66d4f54fa364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:44.614085 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcd4bf-f41f-4507-9a4a-66d4f54fa364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:44.614364 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcd4bf-f41f-4507-9a4a-66d4f54fa364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:44.614637 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcd4bf-f41f-4507-9a4a-66d4f54fa364 admin admin] PATH_INFO: `/v3/users/431f66d8c09d4eb194600509e7300bc2` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:44.630171 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdcd4bf-f41f-4507-9a4a-66d4f54fa364 admin admin] RBAC: Authorizing `identity:delete_user(user_id=431f66d8c09d4eb194600509e7300bc2)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:44.632139 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdcd4bf-f41f-4507-9a4a-66d4f54fa364 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:44.681068 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7bdcd4bf-f41f-4507-9a4a-66d4f54fa364 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '431f66d8c09d4eb194600509e7300bc2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:44.687793 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7bdcd4bf-f41f-4507-9a4a-66d4f54fa364 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '431f66d8c09d4eb194600509e7300bc2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:44.697551 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7bdcd4bf-f41f-4507-9a4a-66d4f54fa364 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '431f66d8c09d4eb194600509e7300bc2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:44.710065 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7bdcd4bf-f41f-4507-9a4a-66d4f54fa364 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '431f66d8c09d4eb194600509e7300bc2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:44.710850 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7bdcd4bf-f41f-4507-9a4a-66d4f54fa364 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '431f66d8c09d4eb194600509e7300bc2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:44.717045 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1307/2648] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 15:06:44 2022] DELETE /identity/v3/users/431f66d8c09d4eb194600509e7300bc2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:06:44.897685 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334b349-81a0-4259-95a2-21b14d8c8352 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:44.908333 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334b349-81a0-4259-95a2-21b14d8c8352 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:44.968728 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d29cf5-f103-455b-ab9c-0348192d7703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:44.969691 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d29cf5-f103-455b-ab9c-0348192d7703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:44.970031 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d29cf5-f103-455b-ab9c-0348192d7703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:44.970373 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d29cf5-f103-455b-ab9c-0348192d7703 admin admin] PATH_INFO: `/v3/projects/9dff4d873f8e4f2fb3f632f1a9fd8526` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:44.981854 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d29cf5-f103-455b-ab9c-0348192d7703 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dff4d873f8e4f2fb3f632f1a9fd8526)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:44.983793 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d29cf5-f103-455b-ab9c-0348192d7703 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:45.034428 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-15d29cf5-f103-455b-ab9c-0348192d7703 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dff4d873f8e4f2fb3f632f1a9fd8526', 'request_id': 'req-15d29cf5-f103-455b-ab9c-0348192d7703'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:45.042485 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-15d29cf5-f103-455b-ab9c-0348192d7703 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dff4d873f8e4f2fb3f632f1a9fd8526', 'request_id': 'req-15d29cf5-f103-455b-ab9c-0348192d7703'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:45.052774 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-15d29cf5-f103-455b-ab9c-0348192d7703 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dff4d873f8e4f2fb3f632f1a9fd8526', 'request_id': 'req-15d29cf5-f103-455b-ab9c-0348192d7703'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:45.066534 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-15d29cf5-f103-455b-ab9c-0348192d7703 admin admin] The token cache is being invalidate because project 9dff4d873f8e4f2fb3f632f1a9fd8526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:06:45.066822 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-15d29cf5-f103-455b-ab9c-0348192d7703 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:45.067573 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-15d29cf5-f103-455b-ab9c-0348192d7703 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:45.069332 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1342/2649] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:06:44 2022] DELETE /identity/v3/projects/9dff4d873f8e4f2fb3f632f1a9fd8526 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:06:45.075402 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533382a-1c5c-4d54-aa15-2cb0c93c5930 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:45.075673 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533382a-1c5c-4d54-aa15-2cb0c93c5930 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:45.075988 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533382a-1c5c-4d54-aa15-2cb0c93c5930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:45.094580 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3533382a-1c5c-4d54-aa15-2cb0c93c5930 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:45.095912 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3533382a-1c5c-4d54-aa15-2cb0c93c5930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:45.160849 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1308/2650] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:06:45.169297 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3effedf-a907-4531-8212-d5637b8757ea None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:45.169545 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3effedf-a907-4531-8212-d5637b8757ea None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:45.169850 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3effedf-a907-4531-8212-d5637b8757ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:45.188733 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-a3effedf-a907-4531-8212-d5637b8757ea None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:45.189975 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a3effedf-a907-4531-8212-d5637b8757ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:45.202901 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1343/2651] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:06:45.207994 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533382a-1c5c-4d54-aa15-2cb0c93c5930 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:45.220918 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533382a-1c5c-4d54-aa15-2cb0c93c5930 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:45.225946 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d240bad-8333-4f7f-958e-28b102c935a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:45.226647 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d240bad-8333-4f7f-958e-28b102c935a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:45.226965 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d240bad-8333-4f7f-958e-28b102c935a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:45.227462 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d240bad-8333-4f7f-958e-28b102c935a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:45.228566 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d240bad-8333-4f7f-958e-28b102c935a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:06:45.228881 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d240bad-8333-4f7f-958e-28b102c935a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:45.230492 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d240bad-8333-4f7f-958e-28b102c935a8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:45.243633 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1309/2652] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 15:06:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:06:45.249293 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3effedf-a907-4531-8212-d5637b8757ea None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:45.260093 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3effedf-a907-4531-8212-d5637b8757ea None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:45.265630 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537105f4-04c4-45da-877a-5fd94d82f51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:45.266317 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537105f4-04c4-45da-877a-5fd94d82f51c admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:45.266599 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537105f4-04c4-45da-877a-5fd94d82f51c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:45.266871 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537105f4-04c4-45da-877a-5fd94d82f51c admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:45.267609 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537105f4-04c4-45da-877a-5fd94d82f51c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:45.269582 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537105f4-04c4-45da-877a-5fd94d82f51c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:45.274888 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:45.310599 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1344/2653] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 15:06:45 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:06:45.315104 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d240bad-8333-4f7f-958e-28b102c935a8 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:45.325769 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d240bad-8333-4f7f-958e-28b102c935a8 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:45.375069 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:45.390531 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482945a-360d-4a4e-a34b-b47fe098d621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:45.391278 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482945a-360d-4a4e-a34b-b47fe098d621 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:45.392510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482945a-360d-4a4e-a34b-b47fe098d621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:45.392510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482945a-360d-4a4e-a34b-b47fe098d621 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:45.392726 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8482945a-360d-4a4e-a34b-b47fe098d621 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:45.394467 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8482945a-360d-4a4e-a34b-b47fe098d621 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:45.415904 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1310/2654] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 15:06:45 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:06:45.420352 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537105f4-04c4-45da-877a-5fd94d82f51c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:45.431148 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537105f4-04c4-45da-877a-5fd94d82f51c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:45.436071 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcedd323-ee46-4337-8a7e-79b31de497c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:45.436781 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcedd323-ee46-4337-8a7e-79b31de497c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:45.437061 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcedd323-ee46-4337-8a7e-79b31de497c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:45.437330 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcedd323-ee46-4337-8a7e-79b31de497c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:45.438112 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcedd323-ee46-4337-8a7e-79b31de497c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:45.439721 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcedd323-ee46-4337-8a7e-79b31de497c3 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:45.450304 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1345/2655] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:06:45.454578 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482945a-360d-4a4e-a34b-b47fe098d621 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:45.464705 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482945a-360d-4a4e-a34b-b47fe098d621 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:45.469706 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe1204-af3c-49f9-aefa-daadd8895a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:45.470383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe1204-af3c-49f9-aefa-daadd8895a10 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:45.470666 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe1204-af3c-49f9-aefa-daadd8895a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:45.470951 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe1204-af3c-49f9-aefa-daadd8895a10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:45.471664 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe1204-af3c-49f9-aefa-daadd8895a10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:45.473296 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe1204-af3c-49f9-aefa-daadd8895a10 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:45.484077 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1311/2656] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:06:45.488634 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcedd323-ee46-4337-8a7e-79b31de497c3 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:45.499671 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcedd323-ee46-4337-8a7e-79b31de497c3 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:45.504990 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8fed1-20e0-416c-a2c8-f810e94cf5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:45.505876 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8fed1-20e0-416c-a2c8-f810e94cf5fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:45.506162 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8fed1-20e0-416c-a2c8-f810e94cf5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:45.506439 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8fed1-20e0-416c-a2c8-f810e94cf5fc admin admin] PATH_INFO: `/v3/projects/c8dfdde581f944deba2d48776c418d9a/users/0d161662e5254d16904d3d4e422a26ae/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:45.523255 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8fed1-20e0-416c-a2c8-f810e94cf5fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8dfdde581f944deba2d48776c418d9a, user_id=0d161662e5254d16904d3d4e422a26ae, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:45.526479 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8fed1-20e0-416c-a2c8-f810e94cf5fc admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:45.541594 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1346/2657] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:06:45 2022] PUT /identity/v3/projects/c8dfdde581f944deba2d48776c418d9a/users/0d161662e5254d16904d3d4e422a26ae/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:06:45.552450 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93083432-726e-431f-aa01-3e7d588c5ebd None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:45.552867 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93083432-726e-431f-aa01-3e7d588c5ebd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:45.553156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93083432-726e-431f-aa01-3e7d588c5ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:45.590747 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-93083432-726e-431f-aa01-3e7d588c5ebd None None] MFA Rules not processed for user `0d161662e5254d16904d3d4e422a26ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:45.592685 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-93083432-726e-431f-aa01-3e7d588c5ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:45.683260 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1312/2658] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:06:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:06:45.687925 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8fed1-20e0-416c-a2c8-f810e94cf5fc admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:45.755361 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8fed1-20e0-416c-a2c8-f810e94cf5fc admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:45.764483 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a37a1-2f35-4b61-b31e-25fba6fa4049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:45.765419 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a37a1-2f35-4b61-b31e-25fba6fa4049 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:45.765764 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a37a1-2f35-4b61-b31e-25fba6fa4049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:45.765965 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a37a1-2f35-4b61-b31e-25fba6fa4049 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:45.766776 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a37a1-2f35-4b61-b31e-25fba6fa4049 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:45.769276 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a37a1-2f35-4b61-b31e-25fba6fa4049 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:45.802913 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1347/2659] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 15:06:45 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:06:45.806920 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93083432-726e-431f-aa01-3e7d588c5ebd None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:45.818581 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93083432-726e-431f-aa01-3e7d588c5ebd None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:45.878330 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca69d4-c40a-49a1-9832-13196f09c3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:45.879004 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca69d4-c40a-49a1-9832-13196f09c3a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:45.879287 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca69d4-c40a-49a1-9832-13196f09c3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:45.879669 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca69d4-c40a-49a1-9832-13196f09c3a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:45.880407 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca69d4-c40a-49a1-9832-13196f09c3a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:45.882352 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca69d4-c40a-49a1-9832-13196f09c3a1 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:45.909011 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1313/2660] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 15:06:45 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:06:45.912865 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a37a1-2f35-4b61-b31e-25fba6fa4049 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:45.924163 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a37a1-2f35-4b61-b31e-25fba6fa4049 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:45.930155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0616628-01ac-4daf-99ca-6f8bf52cd418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:45.930859 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0616628-01ac-4daf-99ca-6f8bf52cd418 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:45.931142 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0616628-01ac-4daf-99ca-6f8bf52cd418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:45.931414 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0616628-01ac-4daf-99ca-6f8bf52cd418 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:45.932218 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0616628-01ac-4daf-99ca-6f8bf52cd418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:45.933984 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0616628-01ac-4daf-99ca-6f8bf52cd418 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:45.945366 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1348/2661] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:06:45.949718 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca69d4-c40a-49a1-9832-13196f09c3a1 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:45.959910 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca69d4-c40a-49a1-9832-13196f09c3a1 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:45.965634 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1063a98-54d6-4336-8560-b43fc54bd11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:45.966534 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1063a98-54d6-4336-8560-b43fc54bd11b admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:45.966817 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1063a98-54d6-4336-8560-b43fc54bd11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:45.967099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1063a98-54d6-4336-8560-b43fc54bd11b admin admin] PATH_INFO: `/v3/projects/1355a2ac7ba740fe86dc8a653b896591/users/8a8f96e670304e77a9c4bedae27e3fee/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:45.984561 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1063a98-54d6-4336-8560-b43fc54bd11b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1355a2ac7ba740fe86dc8a653b896591, user_id=8a8f96e670304e77a9c4bedae27e3fee, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:45.987237 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1063a98-54d6-4336-8560-b43fc54bd11b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:46.002685 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1314/2662] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:06:45 2022] PUT /identity/v3/projects/1355a2ac7ba740fe86dc8a653b896591/users/8a8f96e670304e77a9c4bedae27e3fee/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:06:46.006792 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0616628-01ac-4daf-99ca-6f8bf52cd418 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:46.017223 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0616628-01ac-4daf-99ca-6f8bf52cd418 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:46.078357 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0149e7-5684-400f-b928-7ae653246cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:46.079022 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0149e7-5684-400f-b928-7ae653246cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:46.079306 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0149e7-5684-400f-b928-7ae653246cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:46.079584 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0149e7-5684-400f-b928-7ae653246cb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:46.080349 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0149e7-5684-400f-b928-7ae653246cb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:46.082061 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0149e7-5684-400f-b928-7ae653246cb8 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:46.092521 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1349/2663] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:06:46.099120 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1063a98-54d6-4336-8560-b43fc54bd11b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:46.111139 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1063a98-54d6-4336-8560-b43fc54bd11b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:46.117089 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb904b0-c4e7-42a5-a41a-ea1bb6cfc2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:46.118036 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb904b0-c4e7-42a5-a41a-ea1bb6cfc2b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:46.118355 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb904b0-c4e7-42a5-a41a-ea1bb6cfc2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:46.118632 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb904b0-c4e7-42a5-a41a-ea1bb6cfc2b9 admin admin] PATH_INFO: `/v3/projects/1355a2ac7ba740fe86dc8a653b896591/users/8a8f96e670304e77a9c4bedae27e3fee/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:46.120748 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb904b0-c4e7-42a5-a41a-ea1bb6cfc2b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1355a2ac7ba740fe86dc8a653b896591, user_id=8a8f96e670304e77a9c4bedae27e3fee, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:46.123775 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb904b0-c4e7-42a5-a41a-ea1bb6cfc2b9 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:46.135679 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1315/2664] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:06:46 2022] PUT /identity/v3/projects/1355a2ac7ba740fe86dc8a653b896591/users/8a8f96e670304e77a9c4bedae27e3fee/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:06:46.147537 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13398e-bab2-484f-92e1-5a913ffd3cff None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:46.147797 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13398e-bab2-484f-92e1-5a913ffd3cff None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:46.148141 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13398e-bab2-484f-92e1-5a913ffd3cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:46.177355 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-fd13398e-bab2-484f-92e1-5a913ffd3cff None None] MFA Rules not processed for user `8a8f96e670304e77a9c4bedae27e3fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:46.178573 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-fd13398e-bab2-484f-92e1-5a913ffd3cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:46.188502 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:46.250772 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1350/2665] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:06:46 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:06:46.263275 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb904b0-c4e7-42a5-a41a-ea1bb6cfc2b9 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:46.265332 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-adb904b0-c4e7-42a5-a41a-ea1bb6cfc2b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:46.277974 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:46.332175 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb904b0-c4e7-42a5-a41a-ea1bb6cfc2b9 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:46.336541 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9347753-49c1-4a6b-9942-6d82b29b43b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:46.337197 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9347753-49c1-4a6b-9942-6d82b29b43b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:46.337482 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9347753-49c1-4a6b-9942-6d82b29b43b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:46.337750 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9347753-49c1-4a6b-9942-6d82b29b43b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:46.394204 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9347753-49c1-4a6b-9942-6d82b29b43b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:46.395676 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9347753-49c1-4a6b-9942-6d82b29b43b1 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:46.405863 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1316/2666] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:06:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:06:48.997794 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13398e-bab2-484f-92e1-5a913ffd3cff None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:49.013277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13398e-bab2-484f-92e1-5a913ffd3cff None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:49.019465 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdf231-90d3-4f74-b22e-7a2f63107df2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:49.020601 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdf231-90d3-4f74-b22e-7a2f63107df2 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:49.020954 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdf231-90d3-4f74-b22e-7a2f63107df2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:49.021329 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdf231-90d3-4f74-b22e-7a2f63107df2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:49.034446 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fdf231-90d3-4f74-b22e-7a2f63107df2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:49.035934 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fdf231-90d3-4f74-b22e-7a2f63107df2 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:49.045799 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1351/2667] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:06:48 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:06:56.401244 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=44 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:59.041335 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=30 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:01.729502 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9347753-49c1-4a6b-9942-6d82b29b43b1 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:01.797385 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9347753-49c1-4a6b-9942-6d82b29b43b1 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:01.802091 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993679b1-9ece-4de5-9bdb-5e6365d6e359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:01.802991 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993679b1-9ece-4de5-9bdb-5e6365d6e359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:01.803403 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993679b1-9ece-4de5-9bdb-5e6365d6e359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:01.803682 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993679b1-9ece-4de5-9bdb-5e6365d6e359 admin admin] PATH_INFO: `/v3/users/0d161662e5254d16904d3d4e422a26ae` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:01.805178 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993679b1-9ece-4de5-9bdb-5e6365d6e359 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d161662e5254d16904d3d4e422a26ae)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:01.807444 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993679b1-9ece-4de5-9bdb-5e6365d6e359 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:01.862417 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-993679b1-9ece-4de5-9bdb-5e6365d6e359 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d161662e5254d16904d3d4e422a26ae'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:01.869789 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-993679b1-9ece-4de5-9bdb-5e6365d6e359 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d161662e5254d16904d3d4e422a26ae'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:01.879484 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-993679b1-9ece-4de5-9bdb-5e6365d6e359 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d161662e5254d16904d3d4e422a26ae'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:01.899070 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-993679b1-9ece-4de5-9bdb-5e6365d6e359 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d161662e5254d16904d3d4e422a26ae'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:01.900097 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-993679b1-9ece-4de5-9bdb-5e6365d6e359 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d161662e5254d16904d3d4e422a26ae'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:01.906203 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1317/2668] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 15:07:01 2022] DELETE /identity/v3/users/0d161662e5254d16904d3d4e422a26ae => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:01.910847 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43f9b2-3900-4671-9955-9b9ca4416af0 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:01.911323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43f9b2-3900-4671-9955-9b9ca4416af0 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:01.911450 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43f9b2-3900-4671-9955-9b9ca4416af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:01.929594 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-4c43f9b2-3900-4671-9955-9b9ca4416af0 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:01.930851 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4c43f9b2-3900-4671-9955-9b9ca4416af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:01.991612 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1352/2669] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:02.002988 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993679b1-9ece-4de5-9bdb-5e6365d6e359 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:02.004902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-993679b1-9ece-4de5-9bdb-5e6365d6e359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:02.068040 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993679b1-9ece-4de5-9bdb-5e6365d6e359 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:02.072529 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127f8d7-66cd-444e-931a-1ef0b93a4c87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:02.073180 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127f8d7-66cd-444e-931a-1ef0b93a4c87 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:02.073464 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127f8d7-66cd-444e-931a-1ef0b93a4c87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:02.073742 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127f8d7-66cd-444e-931a-1ef0b93a4c87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:02.083634 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127f8d7-66cd-444e-931a-1ef0b93a4c87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:02.085109 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127f8d7-66cd-444e-931a-1ef0b93a4c87 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:02.095084 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1318/2670] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:02.373387 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43f9b2-3900-4671-9955-9b9ca4416af0 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:02.374975 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4c43f9b2-3900-4671-9955-9b9ca4416af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:02.387896 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43f9b2-3900-4671-9955-9b9ca4416af0 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:02.393505 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c65632-1f50-47aa-948a-0e17057ff1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:02.395201 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c65632-1f50-47aa-948a-0e17057ff1a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:02.395201 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c65632-1f50-47aa-948a-0e17057ff1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:02.395435 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c65632-1f50-47aa-948a-0e17057ff1a6 admin admin] PATH_INFO: `/v3/projects/c8dfdde581f944deba2d48776c418d9a` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:02.396505 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c65632-1f50-47aa-948a-0e17057ff1a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8dfdde581f944deba2d48776c418d9a)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:02.398592 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c65632-1f50-47aa-948a-0e17057ff1a6 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:02.458552 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-20c65632-1f50-47aa-948a-0e17057ff1a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8dfdde581f944deba2d48776c418d9a', 'request_id': 'req-20c65632-1f50-47aa-948a-0e17057ff1a6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:02.465108 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-20c65632-1f50-47aa-948a-0e17057ff1a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8dfdde581f944deba2d48776c418d9a', 'request_id': 'req-20c65632-1f50-47aa-948a-0e17057ff1a6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:02.471439 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-20c65632-1f50-47aa-948a-0e17057ff1a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8dfdde581f944deba2d48776c418d9a', 'request_id': 'req-20c65632-1f50-47aa-948a-0e17057ff1a6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:02.485989 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-20c65632-1f50-47aa-948a-0e17057ff1a6 admin admin] The token cache is being invalidate because project c8dfdde581f944deba2d48776c418d9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:07:02.486275 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-20c65632-1f50-47aa-948a-0e17057ff1a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:02.486901 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-20c65632-1f50-47aa-948a-0e17057ff1a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:02.488504 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1353/2671] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:07:02 2022] DELETE /identity/v3/projects/c8dfdde581f944deba2d48776c418d9a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:02.494859 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127f8d7-66cd-444e-931a-1ef0b93a4c87 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:02.505698 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127f8d7-66cd-444e-931a-1ef0b93a4c87 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:02.526789 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:02.576010 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda97ee8-ff67-49ac-98f9-aaeb93d082ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:02.576951 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda97ee8-ff67-49ac-98f9-aaeb93d082ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:02.577249 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda97ee8-ff67-49ac-98f9-aaeb93d082ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:02.577534 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda97ee8-ff67-49ac-98f9-aaeb93d082ba admin admin] PATH_INFO: `/v3/users/8a8f96e670304e77a9c4bedae27e3fee` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:02.578928 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda97ee8-ff67-49ac-98f9-aaeb93d082ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a8f96e670304e77a9c4bedae27e3fee)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:02.580970 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda97ee8-ff67-49ac-98f9-aaeb93d082ba admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:02.630145 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-eda97ee8-ff67-49ac-98f9-aaeb93d082ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a8f96e670304e77a9c4bedae27e3fee'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:02.637344 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-eda97ee8-ff67-49ac-98f9-aaeb93d082ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a8f96e670304e77a9c4bedae27e3fee'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:02.644871 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-eda97ee8-ff67-49ac-98f9-aaeb93d082ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a8f96e670304e77a9c4bedae27e3fee'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:02.657629 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-eda97ee8-ff67-49ac-98f9-aaeb93d082ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a8f96e670304e77a9c4bedae27e3fee'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:02.658320 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-eda97ee8-ff67-49ac-98f9-aaeb93d082ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a8f96e670304e77a9c4bedae27e3fee'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:02.665060 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1319/2672] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 15:07:02 2022] DELETE /identity/v3/users/8a8f96e670304e77a9c4bedae27e3fee => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:02.949841 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c65632-1f50-47aa-948a-0e17057ff1a6 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:02.951675 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-20c65632-1f50-47aa-948a-0e17057ff1a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:02.971689 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c65632-1f50-47aa-948a-0e17057ff1a6 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:03.038699 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a104f2d-47c3-42a6-99d5-59a127fa6668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:03.039746 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a104f2d-47c3-42a6-99d5-59a127fa6668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:03.040064 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a104f2d-47c3-42a6-99d5-59a127fa6668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:03.040342 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a104f2d-47c3-42a6-99d5-59a127fa6668 admin admin] PATH_INFO: `/v3/projects/1355a2ac7ba740fe86dc8a653b896591` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:03.041597 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a104f2d-47c3-42a6-99d5-59a127fa6668 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1355a2ac7ba740fe86dc8a653b896591)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:03.043560 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a104f2d-47c3-42a6-99d5-59a127fa6668 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:03.078258 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:03.097818 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7a104f2d-47c3-42a6-99d5-59a127fa6668 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1355a2ac7ba740fe86dc8a653b896591', 'request_id': 'req-7a104f2d-47c3-42a6-99d5-59a127fa6668'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:03.103618 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7a104f2d-47c3-42a6-99d5-59a127fa6668 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1355a2ac7ba740fe86dc8a653b896591', 'request_id': 'req-7a104f2d-47c3-42a6-99d5-59a127fa6668'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:03.110367 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7a104f2d-47c3-42a6-99d5-59a127fa6668 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1355a2ac7ba740fe86dc8a653b896591', 'request_id': 'req-7a104f2d-47c3-42a6-99d5-59a127fa6668'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:03.124090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7a104f2d-47c3-42a6-99d5-59a127fa6668 admin admin] The token cache is being invalidate because project 1355a2ac7ba740fe86dc8a653b896591 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:07:03.124399 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7a104f2d-47c3-42a6-99d5-59a127fa6668 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:03.125031 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-7a104f2d-47c3-42a6-99d5-59a127fa6668 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:03.126618 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1354/2673] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:07:02 2022] DELETE /identity/v3/projects/1355a2ac7ba740fe86dc8a653b896591 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:03.133789 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0236d8-5184-4253-a6b9-070210dce5b7 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:03.134313 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0236d8-5184-4253-a6b9-070210dce5b7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:03.134313 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0236d8-5184-4253-a6b9-070210dce5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:03.153090 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-7a0236d8-5184-4253-a6b9-070210dce5b7 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:03.154312 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7a0236d8-5184-4253-a6b9-070210dce5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:03.217233 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1320/2674] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:07:03.225529 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838acef-d2ee-40b8-8a83-57f877ada257 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:03.225880 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838acef-d2ee-40b8-8a83-57f877ada257 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:03.226245 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838acef-d2ee-40b8-8a83-57f877ada257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:03.247557 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-8838acef-d2ee-40b8-8a83-57f877ada257 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:03.248791 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-8838acef-d2ee-40b8-8a83-57f877ada257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:03.257658 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1355/2675] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:03.262379 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0236d8-5184-4253-a6b9-070210dce5b7 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:03.272209 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0236d8-5184-4253-a6b9-070210dce5b7 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:03.278047 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725ecff-7564-4174-ba84-9e688b0aea5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:03.278676 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725ecff-7564-4174-ba84-9e688b0aea5b admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:03.278956 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725ecff-7564-4174-ba84-9e688b0aea5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:03.279251 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725ecff-7564-4174-ba84-9e688b0aea5b admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:03.280031 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4725ecff-7564-4174-ba84-9e688b0aea5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:07:03.280293 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4725ecff-7564-4174-ba84-9e688b0aea5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:03.281905 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4725ecff-7564-4174-ba84-9e688b0aea5b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:03.294421 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1321/2676] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 15:07:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:07:03.298992 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838acef-d2ee-40b8-8a83-57f877ada257 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:03.313156 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838acef-d2ee-40b8-8a83-57f877ada257 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:03.321125 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25825ce-dd2b-40db-a5ef-67bc069114c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:03.322186 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25825ce-dd2b-40db-a5ef-67bc069114c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:03.322664 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25825ce-dd2b-40db-a5ef-67bc069114c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:03.323141 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25825ce-dd2b-40db-a5ef-67bc069114c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:03.324390 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25825ce-dd2b-40db-a5ef-67bc069114c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:03.327967 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25825ce-dd2b-40db-a5ef-67bc069114c1 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:03.368530 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1356/2677] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 15:07:03 2022] POST /identity/v3/projects => generated 381 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:07:03.372750 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725ecff-7564-4174-ba84-9e688b0aea5b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:03.383465 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725ecff-7564-4174-ba84-9e688b0aea5b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:03.411816 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:03.448537 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68f603-b138-4dda-89e2-f8672638c7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:03.449223 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68f603-b138-4dda-89e2-f8672638c7b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:03.449511 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68f603-b138-4dda-89e2-f8672638c7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:03.449789 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68f603-b138-4dda-89e2-f8672638c7b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:03.450499 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c68f603-b138-4dda-89e2-f8672638c7b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:03.452469 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c68f603-b138-4dda-89e2-f8672638c7b5 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:03.475482 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1322/2678] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 15:07:03 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:07:03.480560 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25825ce-dd2b-40db-a5ef-67bc069114c1 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:03.491479 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25825ce-dd2b-40db-a5ef-67bc069114c1 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:03.497625 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a2454-a7cf-496a-a5de-0e286c2a8956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:03.498345 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a2454-a7cf-496a-a5de-0e286c2a8956 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:03.498626 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a2454-a7cf-496a-a5de-0e286c2a8956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:03.498884 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a2454-a7cf-496a-a5de-0e286c2a8956 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:03.499623 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a2454-a7cf-496a-a5de-0e286c2a8956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:03.501340 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a2454-a7cf-496a-a5de-0e286c2a8956 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:03.513000 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1357/2679] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:07:03.517983 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68f603-b138-4dda-89e2-f8672638c7b5 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:03.530962 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68f603-b138-4dda-89e2-f8672638c7b5 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:03.536916 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547776e8-b57f-4349-bddb-76fd0932a46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:03.537616 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547776e8-b57f-4349-bddb-76fd0932a46f admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:03.537914 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547776e8-b57f-4349-bddb-76fd0932a46f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:03.538168 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547776e8-b57f-4349-bddb-76fd0932a46f admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:03.539027 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547776e8-b57f-4349-bddb-76fd0932a46f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:03.541023 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547776e8-b57f-4349-bddb-76fd0932a46f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:03.552041 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1323/2680] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:07:03.556715 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a2454-a7cf-496a-a5de-0e286c2a8956 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:03.567825 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a2454-a7cf-496a-a5de-0e286c2a8956 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:03.573402 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f3a03-e0d6-44fd-aaa2-590ffb4b1b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:03.574300 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f3a03-e0d6-44fd-aaa2-590ffb4b1b10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:03.574585 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f3a03-e0d6-44fd-aaa2-590ffb4b1b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:03.574850 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f3a03-e0d6-44fd-aaa2-590ffb4b1b10 admin admin] PATH_INFO: `/v3/projects/258dbd3ee8eb441a988d19b5d31647a3/users/63c5acad33054e0cb190251dd4ef7b1d/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:03.590639 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f3a03-e0d6-44fd-aaa2-590ffb4b1b10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=258dbd3ee8eb441a988d19b5d31647a3, user_id=63c5acad33054e0cb190251dd4ef7b1d, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:03.593339 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f3a03-e0d6-44fd-aaa2-590ffb4b1b10 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:03.608003 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1358/2681] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:07:03 2022] PUT /identity/v3/projects/258dbd3ee8eb441a988d19b5d31647a3/users/63c5acad33054e0cb190251dd4ef7b1d/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:03.619434 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a06fc-c4a0-4f12-bbee-6bda3e5a6ad6 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:03.619752 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a06fc-c4a0-4f12-bbee-6bda3e5a6ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:03.620063 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a06fc-c4a0-4f12-bbee-6bda3e5a6ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:03.649128 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-894a06fc-c4a0-4f12-bbee-6bda3e5a6ad6 None None] MFA Rules not processed for user `63c5acad33054e0cb190251dd4ef7b1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:03.650740 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-894a06fc-c4a0-4f12-bbee-6bda3e5a6ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:03.719059 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1324/2682] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:07:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:03.724096 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f3a03-e0d6-44fd-aaa2-590ffb4b1b10 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:03.791078 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f3a03-e0d6-44fd-aaa2-590ffb4b1b10 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:03.796124 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e3506-8a8c-47a2-acec-8c5b409e51fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:03.796812 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e3506-8a8c-47a2-acec-8c5b409e51fc admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:03.797089 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e3506-8a8c-47a2-acec-8c5b409e51fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:03.797353 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e3506-8a8c-47a2-acec-8c5b409e51fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:03.798040 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e3506-8a8c-47a2-acec-8c5b409e51fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:03.800020 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e3506-8a8c-47a2-acec-8c5b409e51fc admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:03.829513 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1359/2683] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 15:07:03 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:07:03.834141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a06fc-c4a0-4f12-bbee-6bda3e5a6ad6 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:03.846396 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a06fc-c4a0-4f12-bbee-6bda3e5a6ad6 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:03.908081 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f356a32-3530-4de4-bf64-c96efc1f01d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:03.908765 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f356a32-3530-4de4-bf64-c96efc1f01d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:03.909046 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f356a32-3530-4de4-bf64-c96efc1f01d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:03.909322 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f356a32-3530-4de4-bf64-c96efc1f01d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:03.910028 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f356a32-3530-4de4-bf64-c96efc1f01d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:03.912211 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f356a32-3530-4de4-bf64-c96efc1f01d6 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:03.933515 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1325/2684] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 15:07:03 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:07:03.937930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e3506-8a8c-47a2-acec-8c5b409e51fc admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:03.949076 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e3506-8a8c-47a2-acec-8c5b409e51fc admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:03.954675 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36b2d0-5386-40e2-b602-50efc1643105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:03.955400 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36b2d0-5386-40e2-b602-50efc1643105 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:03.955610 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36b2d0-5386-40e2-b602-50efc1643105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:03.955905 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36b2d0-5386-40e2-b602-50efc1643105 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:03.956640 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36b2d0-5386-40e2-b602-50efc1643105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:03.958294 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36b2d0-5386-40e2-b602-50efc1643105 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:03.970602 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1360/2685] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:07:03.975234 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f356a32-3530-4de4-bf64-c96efc1f01d6 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:03.986745 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f356a32-3530-4de4-bf64-c96efc1f01d6 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:03.992429 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d5d37-383d-42fe-9134-e026800231d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:03.993417 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d5d37-383d-42fe-9134-e026800231d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:03.993699 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d5d37-383d-42fe-9134-e026800231d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:03.993979 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d5d37-383d-42fe-9134-e026800231d1 admin admin] PATH_INFO: `/v3/projects/ee401387344d4963aeb58e1b1e9ffb81/users/53769063d0274e07840c97cfb2cf69d6/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:04.010051 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d5d37-383d-42fe-9134-e026800231d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee401387344d4963aeb58e1b1e9ffb81, user_id=53769063d0274e07840c97cfb2cf69d6, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:04.012829 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d5d37-383d-42fe-9134-e026800231d1 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:04.027756 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1326/2686] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:07:03 2022] PUT /identity/v3/projects/ee401387344d4963aeb58e1b1e9ffb81/users/53769063d0274e07840c97cfb2cf69d6/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:04.032142 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36b2d0-5386-40e2-b602-50efc1643105 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:04.042880 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36b2d0-5386-40e2-b602-50efc1643105 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:04.069320 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:04.111989 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd58c12-70be-460e-80aa-704027cf6702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:04.112575 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd58c12-70be-460e-80aa-704027cf6702 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:04.112858 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd58c12-70be-460e-80aa-704027cf6702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:04.113127 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd58c12-70be-460e-80aa-704027cf6702 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:04.113877 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd58c12-70be-460e-80aa-704027cf6702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:04.115489 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd58c12-70be-460e-80aa-704027cf6702 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:04.125426 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1361/2687] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:07:04.129946 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d5d37-383d-42fe-9134-e026800231d1 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:04.136177 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:04.143434 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d5d37-383d-42fe-9134-e026800231d1 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:04.150006 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1600b-021d-4fc8-9e1a-8fa05f7e45c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:04.150933 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1600b-021d-4fc8-9e1a-8fa05f7e45c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:04.151214 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1600b-021d-4fc8-9e1a-8fa05f7e45c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:04.151494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1600b-021d-4fc8-9e1a-8fa05f7e45c1 admin admin] PATH_INFO: `/v3/projects/ee401387344d4963aeb58e1b1e9ffb81/users/53769063d0274e07840c97cfb2cf69d6/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:04.153575 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1600b-021d-4fc8-9e1a-8fa05f7e45c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee401387344d4963aeb58e1b1e9ffb81, user_id=53769063d0274e07840c97cfb2cf69d6, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:04.156430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1600b-021d-4fc8-9e1a-8fa05f7e45c1 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:04.168359 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1327/2688] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:07:04 2022] PUT /identity/v3/projects/ee401387344d4963aeb58e1b1e9ffb81/users/53769063d0274e07840c97cfb2cf69d6/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:04.180137 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac753f-50cf-4a5c-81ae-66e48c524f27 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:04.180433 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac753f-50cf-4a5c-81ae-66e48c524f27 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:04.180709 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac753f-50cf-4a5c-81ae-66e48c524f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:04.209068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-1dac753f-50cf-4a5c-81ae-66e48c524f27 None None] MFA Rules not processed for user `53769063d0274e07840c97cfb2cf69d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:04.210393 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1dac753f-50cf-4a5c-81ae-66e48c524f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:04.283406 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1362/2689] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:07:04 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:04.294678 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1600b-021d-4fc8-9e1a-8fa05f7e45c1 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:04.296676 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-35f1600b-021d-4fc8-9e1a-8fa05f7e45c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:04.358369 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1600b-021d-4fc8-9e1a-8fa05f7e45c1 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:04.362414 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4986890-c2e1-46b9-a313-aa6430d047e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:04.363003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4986890-c2e1-46b9-a313-aa6430d047e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:04.363281 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4986890-c2e1-46b9-a313-aa6430d047e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:04.363556 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4986890-c2e1-46b9-a313-aa6430d047e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:04.374551 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4986890-c2e1-46b9-a313-aa6430d047e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:04.376872 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4986890-c2e1-46b9-a313-aa6430d047e0 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:04.386985 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1328/2690] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:04 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:04.769093 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac753f-50cf-4a5c-81ae-66e48c524f27 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:04.833378 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac753f-50cf-4a5c-81ae-66e48c524f27 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:04.838629 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27de9e4-2ca1-49fd-b96d-898127d68327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:04.839501 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27de9e4-2ca1-49fd-b96d-898127d68327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:04.839778 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27de9e4-2ca1-49fd-b96d-898127d68327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:04.840076 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27de9e4-2ca1-49fd-b96d-898127d68327 admin admin] PATH_INFO: `/v3/users/63c5acad33054e0cb190251dd4ef7b1d` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:04.841280 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27de9e4-2ca1-49fd-b96d-898127d68327 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63c5acad33054e0cb190251dd4ef7b1d)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:04.843213 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27de9e4-2ca1-49fd-b96d-898127d68327 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:04.891924 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a27de9e4-2ca1-49fd-b96d-898127d68327 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63c5acad33054e0cb190251dd4ef7b1d'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:04.893111 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:04.907690 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a27de9e4-2ca1-49fd-b96d-898127d68327 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63c5acad33054e0cb190251dd4ef7b1d'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:04.908507 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a27de9e4-2ca1-49fd-b96d-898127d68327 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63c5acad33054e0cb190251dd4ef7b1d'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:04.916572 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a27de9e4-2ca1-49fd-b96d-898127d68327 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63c5acad33054e0cb190251dd4ef7b1d'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:04.924078 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-a27de9e4-2ca1-49fd-b96d-898127d68327 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63c5acad33054e0cb190251dd4ef7b1d'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:04.930495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1363/2691] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 15:07:04 2022] DELETE /identity/v3/users/63c5acad33054e0cb190251dd4ef7b1d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:04.935453 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7c2fc-2349-45d5-a1a0-e0c48655e42c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:04.935757 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7c2fc-2349-45d5-a1a0-e0c48655e42c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:04.936062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7c2fc-2349-45d5-a1a0-e0c48655e42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:04.955201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b2a7c2fc-2349-45d5-a1a0-e0c48655e42c None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:04.956538 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b2a7c2fc-2349-45d5-a1a0-e0c48655e42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:05.019057 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1329/2692] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:07:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:05.030143 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27de9e4-2ca1-49fd-b96d-898127d68327 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:05.031594 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a27de9e4-2ca1-49fd-b96d-898127d68327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:05.090250 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27de9e4-2ca1-49fd-b96d-898127d68327 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:05.094085 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982aee0d-d121-414d-85f9-f107373f9ff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:05.094735 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982aee0d-d121-414d-85f9-f107373f9ff2 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:05.095009 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982aee0d-d121-414d-85f9-f107373f9ff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:05.095279 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982aee0d-d121-414d-85f9-f107373f9ff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:05.104764 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982aee0d-d121-414d-85f9-f107373f9ff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:05.106176 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982aee0d-d121-414d-85f9-f107373f9ff2 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:05.115789 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1364/2693] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:05.403279 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7c2fc-2349-45d5-a1a0-e0c48655e42c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:05.406129 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b2a7c2fc-2349-45d5-a1a0-e0c48655e42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:05.421270 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7c2fc-2349-45d5-a1a0-e0c48655e42c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:05.426783 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca52111-68f7-4312-b6f9-17074448754e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:05.427803 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca52111-68f7-4312-b6f9-17074448754e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:05.428114 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca52111-68f7-4312-b6f9-17074448754e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:05.428391 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca52111-68f7-4312-b6f9-17074448754e admin admin] PATH_INFO: `/v3/projects/258dbd3ee8eb441a988d19b5d31647a3` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:05.429685 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca52111-68f7-4312-b6f9-17074448754e admin admin] RBAC: Authorizing `identity:delete_project(project_id=258dbd3ee8eb441a988d19b5d31647a3)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:05.431694 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca52111-68f7-4312-b6f9-17074448754e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:05.480099 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1ca52111-68f7-4312-b6f9-17074448754e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '258dbd3ee8eb441a988d19b5d31647a3', 'request_id': 'req-1ca52111-68f7-4312-b6f9-17074448754e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:05.486503 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1ca52111-68f7-4312-b6f9-17074448754e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '258dbd3ee8eb441a988d19b5d31647a3', 'request_id': 'req-1ca52111-68f7-4312-b6f9-17074448754e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:05.492149 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1ca52111-68f7-4312-b6f9-17074448754e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '258dbd3ee8eb441a988d19b5d31647a3', 'request_id': 'req-1ca52111-68f7-4312-b6f9-17074448754e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:05.505646 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1ca52111-68f7-4312-b6f9-17074448754e admin admin] The token cache is being invalidate because project 258dbd3ee8eb441a988d19b5d31647a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:07:05.505939 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1ca52111-68f7-4312-b6f9-17074448754e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:05.506568 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1ca52111-68f7-4312-b6f9-17074448754e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:05.508342 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1330/2694] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:07:05 2022] DELETE /identity/v3/projects/258dbd3ee8eb441a988d19b5d31647a3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:05.512346 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982aee0d-d121-414d-85f9-f107373f9ff2 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:05.522643 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982aee0d-d121-414d-85f9-f107373f9ff2 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:05.589177 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c6758-bc7d-4fdc-8d2a-b730e1357c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:05.590061 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c6758-bc7d-4fdc-8d2a-b730e1357c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:05.590340 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c6758-bc7d-4fdc-8d2a-b730e1357c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:05.590613 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c6758-bc7d-4fdc-8d2a-b730e1357c8a admin admin] PATH_INFO: `/v3/users/53769063d0274e07840c97cfb2cf69d6` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:05.591847 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c6758-bc7d-4fdc-8d2a-b730e1357c8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=53769063d0274e07840c97cfb2cf69d6)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:05.593930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c6758-bc7d-4fdc-8d2a-b730e1357c8a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:05.654418 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c80c6758-bc7d-4fdc-8d2a-b730e1357c8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53769063d0274e07840c97cfb2cf69d6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:05.668482 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c80c6758-bc7d-4fdc-8d2a-b730e1357c8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53769063d0274e07840c97cfb2cf69d6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:05.669320 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c80c6758-bc7d-4fdc-8d2a-b730e1357c8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53769063d0274e07840c97cfb2cf69d6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:05.673322 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:05.679275 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c80c6758-bc7d-4fdc-8d2a-b730e1357c8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53769063d0274e07840c97cfb2cf69d6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:05.688326 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c80c6758-bc7d-4fdc-8d2a-b730e1357c8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53769063d0274e07840c97cfb2cf69d6'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:05.694533 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1365/2695] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 15:07:05 2022] DELETE /identity/v3/users/53769063d0274e07840c97cfb2cf69d6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:05.978617 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca52111-68f7-4312-b6f9-17074448754e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:05.980173 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1ca52111-68f7-4312-b6f9-17074448754e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:05.994875 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca52111-68f7-4312-b6f9-17074448754e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:06.016053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:06.072540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336bea9-2f25-47d5-9b81-7e4d0b71f054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:06.073811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336bea9-2f25-47d5-9b81-7e4d0b71f054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:06.074198 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336bea9-2f25-47d5-9b81-7e4d0b71f054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:06.074598 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336bea9-2f25-47d5-9b81-7e4d0b71f054 admin admin] PATH_INFO: `/v3/projects/ee401387344d4963aeb58e1b1e9ffb81` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:06.076672 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336bea9-2f25-47d5-9b81-7e4d0b71f054 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee401387344d4963aeb58e1b1e9ffb81)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:06.079788 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336bea9-2f25-47d5-9b81-7e4d0b71f054 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:06.133572 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e336bea9-2f25-47d5-9b81-7e4d0b71f054 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee401387344d4963aeb58e1b1e9ffb81', 'request_id': 'req-e336bea9-2f25-47d5-9b81-7e4d0b71f054'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:06.142845 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e336bea9-2f25-47d5-9b81-7e4d0b71f054 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee401387344d4963aeb58e1b1e9ffb81', 'request_id': 'req-e336bea9-2f25-47d5-9b81-7e4d0b71f054'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:06.151802 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e336bea9-2f25-47d5-9b81-7e4d0b71f054 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee401387344d4963aeb58e1b1e9ffb81', 'request_id': 'req-e336bea9-2f25-47d5-9b81-7e4d0b71f054'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:06.169040 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e336bea9-2f25-47d5-9b81-7e4d0b71f054 admin admin] The token cache is being invalidate because project ee401387344d4963aeb58e1b1e9ffb81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:07:06.169388 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e336bea9-2f25-47d5-9b81-7e4d0b71f054 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:06.170350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e336bea9-2f25-47d5-9b81-7e4d0b71f054 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:06.172763 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1331/2696] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:07:05 2022] DELETE /identity/v3/projects/ee401387344d4963aeb58e1b1e9ffb81 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:06.179502 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab915fb-5a19-406d-9f18-48f22fa0525e None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:06.180122 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab915fb-5a19-406d-9f18-48f22fa0525e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:06.180122 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab915fb-5a19-406d-9f18-48f22fa0525e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:06.199865 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-6ab915fb-5a19-406d-9f18-48f22fa0525e None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:06.201159 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6ab915fb-5a19-406d-9f18-48f22fa0525e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:06.266628 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1366/2697] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:06.275768 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4e8e1-ae8a-4a6a-b6a7-0a0d230567eb None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:06.276085 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4e8e1-ae8a-4a6a-b6a7-0a0d230567eb None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:06.276361 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4e8e1-ae8a-4a6a-b6a7-0a0d230567eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:06.296842 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-43f4e8e1-ae8a-4a6a-b6a7-0a0d230567eb None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:06.298046 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-43f4e8e1-ae8a-4a6a-b6a7-0a0d230567eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:06.307221 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1332/2698] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:06.311994 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab915fb-5a19-406d-9f18-48f22fa0525e None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:06.322462 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab915fb-5a19-406d-9f18-48f22fa0525e None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:06.327527 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831da61-ebd8-4752-8659-10f09a14dca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:06.328216 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831da61-ebd8-4752-8659-10f09a14dca9 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:06.328494 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831da61-ebd8-4752-8659-10f09a14dca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:06.328765 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831da61-ebd8-4752-8659-10f09a14dca9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:06.329525 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831da61-ebd8-4752-8659-10f09a14dca9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:07:06.329826 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831da61-ebd8-4752-8659-10f09a14dca9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:06.331465 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831da61-ebd8-4752-8659-10f09a14dca9 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:06.344042 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1367/2699] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 15:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:07:06.349007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4e8e1-ae8a-4a6a-b6a7-0a0d230567eb None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:06.364811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4e8e1-ae8a-4a6a-b6a7-0a0d230567eb None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:06.371753 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfdfe5-2cb8-44dc-b430-5322c73d06d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:06.372459 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfdfe5-2cb8-44dc-b430-5322c73d06d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:06.372741 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfdfe5-2cb8-44dc-b430-5322c73d06d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:06.373015 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfdfe5-2cb8-44dc-b430-5322c73d06d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:06.373792 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bfdfe5-2cb8-44dc-b430-5322c73d06d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:06.375723 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bfdfe5-2cb8-44dc-b430-5322c73d06d6 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:06.405910 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1333/2700] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 15:07:06 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:07:06.411013 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831da61-ebd8-4752-8659-10f09a14dca9 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:06.426880 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831da61-ebd8-4752-8659-10f09a14dca9 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:06.487022 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06415e6d-5a41-4fd6-b74a-efed89a85b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:06.487747 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06415e6d-5a41-4fd6-b74a-efed89a85b5f admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:06.488060 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06415e6d-5a41-4fd6-b74a-efed89a85b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:06.488355 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06415e6d-5a41-4fd6-b74a-efed89a85b5f admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:06.489117 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06415e6d-5a41-4fd6-b74a-efed89a85b5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:06.491136 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06415e6d-5a41-4fd6-b74a-efed89a85b5f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:06.513993 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1368/2701] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 15:07:06 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:07:06.520146 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfdfe5-2cb8-44dc-b430-5322c73d06d6 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:06.532197 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfdfe5-2cb8-44dc-b430-5322c73d06d6 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:06.538647 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7d8b2-c307-48ed-a40a-25871b170739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:06.539602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7d8b2-c307-48ed-a40a-25871b170739 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:06.539904 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7d8b2-c307-48ed-a40a-25871b170739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:06.540180 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7d8b2-c307-48ed-a40a-25871b170739 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:06.540926 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e7d8b2-c307-48ed-a40a-25871b170739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:06.542552 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e7d8b2-c307-48ed-a40a-25871b170739 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:06.554142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1334/2702] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:07:06.558257 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06415e6d-5a41-4fd6-b74a-efed89a85b5f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:06.568874 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06415e6d-5a41-4fd6-b74a-efed89a85b5f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:06.573884 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a345e66-0bb6-4840-a67e-56f1fe0c066f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:06.574540 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a345e66-0bb6-4840-a67e-56f1fe0c066f admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:06.574822 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a345e66-0bb6-4840-a67e-56f1fe0c066f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:06.575827 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a345e66-0bb6-4840-a67e-56f1fe0c066f admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:06.575827 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a345e66-0bb6-4840-a67e-56f1fe0c066f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:06.577442 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a345e66-0bb6-4840-a67e-56f1fe0c066f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:06.587689 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1369/2703] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:07:06.591842 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7d8b2-c307-48ed-a40a-25871b170739 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:06.602322 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7d8b2-c307-48ed-a40a-25871b170739 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:06.607110 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f93edd-b9e2-4ac1-8716-9971f7cd7a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:06.608015 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f93edd-b9e2-4ac1-8716-9971f7cd7a8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:06.608304 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f93edd-b9e2-4ac1-8716-9971f7cd7a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:06.608581 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f93edd-b9e2-4ac1-8716-9971f7cd7a8d admin admin] PATH_INFO: `/v3/projects/ba7bffde6d12468f844073bd89213d6e/users/3cf1941011e041deba5320eeea823c19/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:06.623933 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f93edd-b9e2-4ac1-8716-9971f7cd7a8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba7bffde6d12468f844073bd89213d6e, user_id=3cf1941011e041deba5320eeea823c19, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:06.626640 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f93edd-b9e2-4ac1-8716-9971f7cd7a8d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:06.641905 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1335/2704] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:07:06 2022] PUT /identity/v3/projects/ba7bffde6d12468f844073bd89213d6e/users/3cf1941011e041deba5320eeea823c19/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:07:06.660606 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bbbcf-48df-4bdb-ba73-586162b482a8 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:06.660924 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bbbcf-48df-4bdb-ba73-586162b482a8 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:06.661262 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bbbcf-48df-4bdb-ba73-586162b482a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:06.691674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d83bbbcf-48df-4bdb-ba73-586162b482a8 None None] MFA Rules not processed for user `3cf1941011e041deba5320eeea823c19`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:06.692994 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d83bbbcf-48df-4bdb-ba73-586162b482a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:06.738431 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:06.768364 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1370/2705] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:07:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:06.780264 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f93edd-b9e2-4ac1-8716-9971f7cd7a8d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:06.782346 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c7f93edd-b9e2-4ac1-8716-9971f7cd7a8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:06.836448 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:06.855216 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f93edd-b9e2-4ac1-8716-9971f7cd7a8d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:06.861873 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7efb1b7-8e30-45f4-86e9-b8eb61c55998 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:06.862733 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efb1b7-8e30-45f4-86e9-b8eb61c55998 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:06.863122 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efb1b7-8e30-45f4-86e9-b8eb61c55998 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:06.863418 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efb1b7-8e30-45f4-86e9-b8eb61c55998 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:06.874147 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7efb1b7-8e30-45f4-86e9-b8eb61c55998 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:06.875585 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7efb1b7-8e30-45f4-86e9-b8eb61c55998 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:06.885318 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1336/2706] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:06.906247 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83bbbcf-48df-4bdb-ba73-586162b482a8 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:06.976377 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83bbbcf-48df-4bdb-ba73-586162b482a8 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:06.982026 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37503a8-8395-4be7-9ab2-f62350822d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:06.982936 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37503a8-8395-4be7-9ab2-f62350822d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:06.983335 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37503a8-8395-4be7-9ab2-f62350822d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:06.983624 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37503a8-8395-4be7-9ab2-f62350822d3c admin admin] PATH_INFO: `/v3/users/3cf1941011e041deba5320eeea823c19` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:06.984940 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37503a8-8395-4be7-9ab2-f62350822d3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cf1941011e041deba5320eeea823c19)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:06.986884 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37503a8-8395-4be7-9ab2-f62350822d3c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:07.039559 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b37503a8-8395-4be7-9ab2-f62350822d3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cf1941011e041deba5320eeea823c19'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:07.052592 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b37503a8-8395-4be7-9ab2-f62350822d3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cf1941011e041deba5320eeea823c19'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:07.053329 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b37503a8-8395-4be7-9ab2-f62350822d3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cf1941011e041deba5320eeea823c19'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:07.065400 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b37503a8-8395-4be7-9ab2-f62350822d3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cf1941011e041deba5320eeea823c19'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:07.075689 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b37503a8-8395-4be7-9ab2-f62350822d3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cf1941011e041deba5320eeea823c19'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:07.083050 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1371/2707] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 15:07:06 2022] DELETE /identity/v3/users/3cf1941011e041deba5320eeea823c19 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:07.088235 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c2edd-118d-44e2-ab2a-94e7658526e7 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:07.088550 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c2edd-118d-44e2-ab2a-94e7658526e7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:07.088828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c2edd-118d-44e2-ab2a-94e7658526e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:07.109030 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d03c2edd-118d-44e2-ab2a-94e7658526e7 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:07.110276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d03c2edd-118d-44e2-ab2a-94e7658526e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:07.172174 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1337/2708] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:07.182046 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37503a8-8395-4be7-9ab2-f62350822d3c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:07.183655 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b37503a8-8395-4be7-9ab2-f62350822d3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:07.245546 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37503a8-8395-4be7-9ab2-f62350822d3c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:07.249914 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f0317-f0d1-43fc-81a4-ec2a36f348c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:07.250574 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f0317-f0d1-43fc-81a4-ec2a36f348c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:07.250852 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f0317-f0d1-43fc-81a4-ec2a36f348c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:07.251123 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f0317-f0d1-43fc-81a4-ec2a36f348c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:07.261366 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f0317-f0d1-43fc-81a4-ec2a36f348c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:07.262807 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f0317-f0d1-43fc-81a4-ec2a36f348c8 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:07.274026 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1372/2709] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:07.606680 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c2edd-118d-44e2-ab2a-94e7658526e7 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:07.608361 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d03c2edd-118d-44e2-ab2a-94e7658526e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:07.621908 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c2edd-118d-44e2-ab2a-94e7658526e7 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:07.627003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551225f-d62c-406c-b1df-884454a5e325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:07.627917 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551225f-d62c-406c-b1df-884454a5e325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:07.628203 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551225f-d62c-406c-b1df-884454a5e325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:07.628473 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551225f-d62c-406c-b1df-884454a5e325 admin admin] PATH_INFO: `/v3/projects/ba7bffde6d12468f844073bd89213d6e` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:07.629722 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0551225f-d62c-406c-b1df-884454a5e325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba7bffde6d12468f844073bd89213d6e)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:07.631680 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0551225f-d62c-406c-b1df-884454a5e325 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:07.683263 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0551225f-d62c-406c-b1df-884454a5e325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba7bffde6d12468f844073bd89213d6e', 'request_id': 'req-0551225f-d62c-406c-b1df-884454a5e325'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:07.689454 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0551225f-d62c-406c-b1df-884454a5e325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba7bffde6d12468f844073bd89213d6e', 'request_id': 'req-0551225f-d62c-406c-b1df-884454a5e325'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:07.695016 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0551225f-d62c-406c-b1df-884454a5e325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba7bffde6d12468f844073bd89213d6e', 'request_id': 'req-0551225f-d62c-406c-b1df-884454a5e325'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:07.709217 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0551225f-d62c-406c-b1df-884454a5e325 admin admin] The token cache is being invalidate because project ba7bffde6d12468f844073bd89213d6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:07:07.709499 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0551225f-d62c-406c-b1df-884454a5e325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:07.710108 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0551225f-d62c-406c-b1df-884454a5e325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:07.712193 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1338/2710] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:07:07 2022] DELETE /identity/v3/projects/ba7bffde6d12468f844073bd89213d6e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:07.717281 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84427b-66b8-432b-ab09-a3c8a2cd3cde None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:07.717563 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84427b-66b8-432b-ab09-a3c8a2cd3cde None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:07.717832 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84427b-66b8-432b-ab09-a3c8a2cd3cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:07.725073 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:07.738464 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-9a84427b-66b8-432b-ab09-a3c8a2cd3cde None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:07.739662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9a84427b-66b8-432b-ab09-a3c8a2cd3cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:07.803062 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1373/2711] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:07.811764 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c0a1c-157a-4413-a03a-b4ecbdf4572e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:07.812144 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c0a1c-157a-4413-a03a-b4ecbdf4572e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:07.812486 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c0a1c-157a-4413-a03a-b4ecbdf4572e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:07.840869 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e49c0a1c-157a-4413-a03a-b4ecbdf4572e None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:07.842098 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e49c0a1c-157a-4413-a03a-b4ecbdf4572e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:07.852157 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1339/2712] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:07.857179 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84427b-66b8-432b-ab09-a3c8a2cd3cde None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:07.871069 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84427b-66b8-432b-ab09-a3c8a2cd3cde None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:07.876448 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb72efb-0456-4284-b09b-7cb811fc1169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:07.877137 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb72efb-0456-4284-b09b-7cb811fc1169 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:07.877452 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb72efb-0456-4284-b09b-7cb811fc1169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:07.877733 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb72efb-0456-4284-b09b-7cb811fc1169 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:07.878461 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb72efb-0456-4284-b09b-7cb811fc1169 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:07:07.878774 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb72efb-0456-4284-b09b-7cb811fc1169 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:07.880416 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb72efb-0456-4284-b09b-7cb811fc1169 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:07.893761 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1374/2713] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 15:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:07:07.898180 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c0a1c-157a-4413-a03a-b4ecbdf4572e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:07.909451 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c0a1c-157a-4413-a03a-b4ecbdf4572e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:07.915788 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61301ec8-f884-4fd9-84c5-5ef9e1ce8873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:07.916489 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61301ec8-f884-4fd9-84c5-5ef9e1ce8873 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:07.916784 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61301ec8-f884-4fd9-84c5-5ef9e1ce8873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:07.917054 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61301ec8-f884-4fd9-84c5-5ef9e1ce8873 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:07.917752 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61301ec8-f884-4fd9-84c5-5ef9e1ce8873 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:07.919653 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61301ec8-f884-4fd9-84c5-5ef9e1ce8873 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:07.951840 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1340/2714] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 15:07:07 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:07:07.956223 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb72efb-0456-4284-b09b-7cb811fc1169 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:07.966825 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb72efb-0456-4284-b09b-7cb811fc1169 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:08.038152 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3571154-7a5d-4ff2-aac4-679c1b7e4657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:08.039172 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3571154-7a5d-4ff2-aac4-679c1b7e4657 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:08.039452 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3571154-7a5d-4ff2-aac4-679c1b7e4657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:08.039753 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3571154-7a5d-4ff2-aac4-679c1b7e4657 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:08.040485 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3571154-7a5d-4ff2-aac4-679c1b7e4657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:08.042461 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3571154-7a5d-4ff2-aac4-679c1b7e4657 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:08.066493 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1375/2715] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 15:07:07 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:07:08.073292 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61301ec8-f884-4fd9-84c5-5ef9e1ce8873 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:08.088485 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61301ec8-f884-4fd9-84c5-5ef9e1ce8873 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:08.097112 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875d1ac-a01e-4dd8-b2ba-7356f1b80631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:08.098109 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875d1ac-a01e-4dd8-b2ba-7356f1b80631 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:08.098513 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875d1ac-a01e-4dd8-b2ba-7356f1b80631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:08.098888 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875d1ac-a01e-4dd8-b2ba-7356f1b80631 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:08.100033 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875d1ac-a01e-4dd8-b2ba-7356f1b80631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:08.102508 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875d1ac-a01e-4dd8-b2ba-7356f1b80631 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:08.113847 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1341/2716] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:07:08.118476 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3571154-7a5d-4ff2-aac4-679c1b7e4657 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:08.128683 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3571154-7a5d-4ff2-aac4-679c1b7e4657 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:08.134451 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e373cc-3c5f-4006-adcd-a346a29f4724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:08.135094 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e373cc-3c5f-4006-adcd-a346a29f4724 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:08.135370 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e373cc-3c5f-4006-adcd-a346a29f4724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:08.135637 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e373cc-3c5f-4006-adcd-a346a29f4724 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:08.136375 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e373cc-3c5f-4006-adcd-a346a29f4724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:08.138000 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e373cc-3c5f-4006-adcd-a346a29f4724 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:08.150689 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1376/2717] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:07:08.156202 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875d1ac-a01e-4dd8-b2ba-7356f1b80631 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:08.167379 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875d1ac-a01e-4dd8-b2ba-7356f1b80631 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:08.173279 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5743edb-adac-4bcc-912d-6d6c63c45125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:08.174165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5743edb-adac-4bcc-912d-6d6c63c45125 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:08.174451 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5743edb-adac-4bcc-912d-6d6c63c45125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:08.174728 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5743edb-adac-4bcc-912d-6d6c63c45125 admin admin] PATH_INFO: `/v3/projects/006ccf8b7ba3487487513aea80e143e2/users/ff0f7fec4e3e47b285072a21f6e6f4dd/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:08.193092 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5743edb-adac-4bcc-912d-6d6c63c45125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=006ccf8b7ba3487487513aea80e143e2, user_id=ff0f7fec4e3e47b285072a21f6e6f4dd, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:08.196797 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5743edb-adac-4bcc-912d-6d6c63c45125 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:08.214674 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1342/2718] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:07:08 2022] PUT /identity/v3/projects/006ccf8b7ba3487487513aea80e143e2/users/ff0f7fec4e3e47b285072a21f6e6f4dd/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:08.225466 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bb47c-8640-4a89-82a5-031198ffe276 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:08.225992 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bb47c-8640-4a89-82a5-031198ffe276 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:08.226087 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bb47c-8640-4a89-82a5-031198ffe276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:08.263452 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d46bb47c-8640-4a89-82a5-031198ffe276 None None] MFA Rules not processed for user `ff0f7fec4e3e47b285072a21f6e6f4dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:08.264717 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d46bb47c-8640-4a89-82a5-031198ffe276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:08.331633 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:08.338066 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1377/2719] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:07:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:08.343786 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5743edb-adac-4bcc-912d-6d6c63c45125 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:08.352355 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:08.415406 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5743edb-adac-4bcc-912d-6d6c63c45125 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:08.420525 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372b827-1c3d-4d69-bc58-c684be6917ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:08.421189 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372b827-1c3d-4d69-bc58-c684be6917ba admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:08.421469 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372b827-1c3d-4d69-bc58-c684be6917ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:08.421747 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372b827-1c3d-4d69-bc58-c684be6917ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:08.422446 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5372b827-1c3d-4d69-bc58-c684be6917ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:08.424379 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5372b827-1c3d-4d69-bc58-c684be6917ba admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:08.452564 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1343/2720] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 15:07:08 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:07:08.457072 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46bb47c-8640-4a89-82a5-031198ffe276 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:08.469120 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46bb47c-8640-4a89-82a5-031198ffe276 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:08.539760 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708be0dc-8a89-4f94-827c-c94b18ef8732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:08.540546 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708be0dc-8a89-4f94-827c-c94b18ef8732 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:08.540826 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708be0dc-8a89-4f94-827c-c94b18ef8732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:08.541097 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708be0dc-8a89-4f94-827c-c94b18ef8732 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:08.541814 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708be0dc-8a89-4f94-827c-c94b18ef8732 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:08.543717 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708be0dc-8a89-4f94-827c-c94b18ef8732 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:08.569816 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1378/2721] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 15:07:08 2022] POST /identity/v3/users => generated 294 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:07:08.574266 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372b827-1c3d-4d69-bc58-c684be6917ba admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:08.585487 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372b827-1c3d-4d69-bc58-c684be6917ba admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:08.590948 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd7e14-680e-426b-8cf7-77580e06e76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:08.591626 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd7e14-680e-426b-8cf7-77580e06e76f admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:08.591929 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd7e14-680e-426b-8cf7-77580e06e76f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:08.592207 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd7e14-680e-426b-8cf7-77580e06e76f admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:08.592931 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd7e14-680e-426b-8cf7-77580e06e76f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:08.594532 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd7e14-680e-426b-8cf7-77580e06e76f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:08.606637 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1344/2722] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:07:08.611286 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708be0dc-8a89-4f94-827c-c94b18ef8732 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:08.622166 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708be0dc-8a89-4f94-827c-c94b18ef8732 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:08.627983 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61ec6c-c744-49aa-9d95-e0fae873d7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:08.628599 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61ec6c-c744-49aa-9d95-e0fae873d7d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:08.632295 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61ec6c-c744-49aa-9d95-e0fae873d7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:08.632939 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61ec6c-c744-49aa-9d95-e0fae873d7d7 admin admin] PATH_INFO: `/v3/projects/5b81e0fedb9146c681b0631219191fa0/users/55520f7ae2f341af868e767ca3e38396/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:08.649659 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61ec6c-c744-49aa-9d95-e0fae873d7d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b81e0fedb9146c681b0631219191fa0, user_id=55520f7ae2f341af868e767ca3e38396, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:08.652344 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61ec6c-c744-49aa-9d95-e0fae873d7d7 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:08.667408 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1379/2723] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:07:08 2022] PUT /identity/v3/projects/5b81e0fedb9146c681b0631219191fa0/users/55520f7ae2f341af868e767ca3e38396/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:08.671393 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd7e14-680e-426b-8cf7-77580e06e76f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:08.681794 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd7e14-680e-426b-8cf7-77580e06e76f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:08.747914 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08559493-0286-4106-928a-5f9a98722eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:08.748715 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08559493-0286-4106-928a-5f9a98722eeb admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:08.748984 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08559493-0286-4106-928a-5f9a98722eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:08.749262 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08559493-0286-4106-928a-5f9a98722eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:08.750967 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08559493-0286-4106-928a-5f9a98722eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:08.753710 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08559493-0286-4106-928a-5f9a98722eeb admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:08.769413 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1345/2724] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:07:08.774009 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61ec6c-c744-49aa-9d95-e0fae873d7d7 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:08.786478 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61ec6c-c744-49aa-9d95-e0fae873d7d7 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:08.792660 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695a91c-1a30-4bf1-a9fd-c13e6bf5d475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:08.793480 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695a91c-1a30-4bf1-a9fd-c13e6bf5d475 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:08.793759 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695a91c-1a30-4bf1-a9fd-c13e6bf5d475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:08.794032 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695a91c-1a30-4bf1-a9fd-c13e6bf5d475 admin admin] PATH_INFO: `/v3/projects/5b81e0fedb9146c681b0631219191fa0/users/55520f7ae2f341af868e767ca3e38396/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:08.796286 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695a91c-1a30-4bf1-a9fd-c13e6bf5d475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b81e0fedb9146c681b0631219191fa0, user_id=55520f7ae2f341af868e767ca3e38396, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:08.798927 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695a91c-1a30-4bf1-a9fd-c13e6bf5d475 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:08.811820 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1380/2725] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:07:08 2022] PUT /identity/v3/projects/5b81e0fedb9146c681b0631219191fa0/users/55520f7ae2f341af868e767ca3e38396/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:08.824125 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896dbef-3b97-457e-be40-35c2b264ed6f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:08.824414 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896dbef-3b97-457e-be40-35c2b264ed6f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:08.824695 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896dbef-3b97-457e-be40-35c2b264ed6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:08.852771 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1896dbef-3b97-457e-be40-35c2b264ed6f None None] MFA Rules not processed for user `55520f7ae2f341af868e767ca3e38396`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:08.853907 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1896dbef-3b97-457e-be40-35c2b264ed6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:08.924537 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:08.929146 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1346/2726] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:07:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:08.939921 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695a91c-1a30-4bf1-a9fd-c13e6bf5d475 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:08.941919 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-1695a91c-1a30-4bf1-a9fd-c13e6bf5d475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:09.016352 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695a91c-1a30-4bf1-a9fd-c13e6bf5d475 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:09.021386 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752130a-5c74-48e4-afcd-126e654744e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:09.022048 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752130a-5c74-48e4-afcd-126e654744e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:09.022326 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752130a-5c74-48e4-afcd-126e654744e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:09.022628 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752130a-5c74-48e4-afcd-126e654744e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:09.097870 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e752130a-5c74-48e4-afcd-126e654744e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:09.099335 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e752130a-5c74-48e4-afcd-126e654744e8 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:09.109943 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1381/2727] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:11.674652 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896dbef-3b97-457e-be40-35c2b264ed6f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:11.741407 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896dbef-3b97-457e-be40-35c2b264ed6f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:11.746497 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e9ddb-1d8c-4a28-ad2d-02df9fd72442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:11.747383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e9ddb-1d8c-4a28-ad2d-02df9fd72442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:11.747667 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e9ddb-1d8c-4a28-ad2d-02df9fd72442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:11.747974 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e9ddb-1d8c-4a28-ad2d-02df9fd72442 admin admin] PATH_INFO: `/v3/users/ff0f7fec4e3e47b285072a21f6e6f4dd` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:11.749162 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e9ddb-1d8c-4a28-ad2d-02df9fd72442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff0f7fec4e3e47b285072a21f6e6f4dd)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:11.751130 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e9ddb-1d8c-4a28-ad2d-02df9fd72442 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:11.800668 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e89e9ddb-1d8c-4a28-ad2d-02df9fd72442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff0f7fec4e3e47b285072a21f6e6f4dd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:11.808394 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e89e9ddb-1d8c-4a28-ad2d-02df9fd72442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff0f7fec4e3e47b285072a21f6e6f4dd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:11.817400 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e89e9ddb-1d8c-4a28-ad2d-02df9fd72442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff0f7fec4e3e47b285072a21f6e6f4dd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:11.831183 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e89e9ddb-1d8c-4a28-ad2d-02df9fd72442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff0f7fec4e3e47b285072a21f6e6f4dd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:11.831969 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e89e9ddb-1d8c-4a28-ad2d-02df9fd72442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff0f7fec4e3e47b285072a21f6e6f4dd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:11.839231 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1347/2728] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 15:07:11 2022] DELETE /identity/v3/users/ff0f7fec4e3e47b285072a21f6e6f4dd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:11.844089 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead89fd-5e77-49c1-80bb-6af37e9492d6 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:11.844602 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead89fd-5e77-49c1-80bb-6af37e9492d6 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:11.844839 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead89fd-5e77-49c1-80bb-6af37e9492d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:11.857864 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:11.865331 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-dead89fd-5e77-49c1-80bb-6af37e9492d6 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:11.866548 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-dead89fd-5e77-49c1-80bb-6af37e9492d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:11.930008 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1382/2729] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:11.940100 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e9ddb-1d8c-4a28-ad2d-02df9fd72442 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:11.941722 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e89e9ddb-1d8c-4a28-ad2d-02df9fd72442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:12.006337 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e9ddb-1d8c-4a28-ad2d-02df9fd72442 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:12.010606 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e7615-50c3-46d6-9d46-a78231ff912f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:12.011267 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e7615-50c3-46d6-9d46-a78231ff912f service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:12.011554 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e7615-50c3-46d6-9d46-a78231ff912f service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:12.011832 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e7615-50c3-46d6-9d46-a78231ff912f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:12.022655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e7615-50c3-46d6-9d46-a78231ff912f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:12.024573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e7615-50c3-46d6-9d46-a78231ff912f service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:12.034803 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1348/2730] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:12.323662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead89fd-5e77-49c1-80bb-6af37e9492d6 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:12.325181 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-dead89fd-5e77-49c1-80bb-6af37e9492d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:12.337826 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead89fd-5e77-49c1-80bb-6af37e9492d6 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:12.343748 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40323df-d5d7-44c3-8b60-8b1cb864ac5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:12.344663 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40323df-d5d7-44c3-8b60-8b1cb864ac5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:12.344955 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40323df-d5d7-44c3-8b60-8b1cb864ac5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:12.345187 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40323df-d5d7-44c3-8b60-8b1cb864ac5e admin admin] PATH_INFO: `/v3/projects/006ccf8b7ba3487487513aea80e143e2` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:12.346573 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40323df-d5d7-44c3-8b60-8b1cb864ac5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=006ccf8b7ba3487487513aea80e143e2)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:12.348560 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40323df-d5d7-44c3-8b60-8b1cb864ac5e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:12.405224 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c40323df-d5d7-44c3-8b60-8b1cb864ac5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '006ccf8b7ba3487487513aea80e143e2', 'request_id': 'req-c40323df-d5d7-44c3-8b60-8b1cb864ac5e'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:12.410706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c40323df-d5d7-44c3-8b60-8b1cb864ac5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '006ccf8b7ba3487487513aea80e143e2', 'request_id': 'req-c40323df-d5d7-44c3-8b60-8b1cb864ac5e'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:12.417784 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c40323df-d5d7-44c3-8b60-8b1cb864ac5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '006ccf8b7ba3487487513aea80e143e2', 'request_id': 'req-c40323df-d5d7-44c3-8b60-8b1cb864ac5e'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:12.432136 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c40323df-d5d7-44c3-8b60-8b1cb864ac5e admin admin] The token cache is being invalidate because project 006ccf8b7ba3487487513aea80e143e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:07:12.432427 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c40323df-d5d7-44c3-8b60-8b1cb864ac5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:12.433046 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-c40323df-d5d7-44c3-8b60-8b1cb864ac5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:12.434653 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1383/2731] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:07:12 2022] DELETE /identity/v3/projects/006ccf8b7ba3487487513aea80e143e2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:07:12.438835 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e7615-50c3-46d6-9d46-a78231ff912f service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:12.449646 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e7615-50c3-46d6-9d46-a78231ff912f service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:12.470371 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:12.514853 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c288ac2-e779-4c77-8530-fe41b38b2254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:12.520007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c288ac2-e779-4c77-8530-fe41b38b2254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:12.520007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c288ac2-e779-4c77-8530-fe41b38b2254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:12.520007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c288ac2-e779-4c77-8530-fe41b38b2254 admin admin] PATH_INFO: `/v3/users/55520f7ae2f341af868e767ca3e38396` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:12.520007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c288ac2-e779-4c77-8530-fe41b38b2254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55520f7ae2f341af868e767ca3e38396)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:12.520007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c288ac2-e779-4c77-8530-fe41b38b2254 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:12.577151 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6c288ac2-e779-4c77-8530-fe41b38b2254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55520f7ae2f341af868e767ca3e38396'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:12.584262 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6c288ac2-e779-4c77-8530-fe41b38b2254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55520f7ae2f341af868e767ca3e38396'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:12.593272 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6c288ac2-e779-4c77-8530-fe41b38b2254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55520f7ae2f341af868e767ca3e38396'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:12.606994 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6c288ac2-e779-4c77-8530-fe41b38b2254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55520f7ae2f341af868e767ca3e38396'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:12.607681 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6c288ac2-e779-4c77-8530-fe41b38b2254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55520f7ae2f341af868e767ca3e38396'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:12.614023 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1349/2732] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 15:07:12 2022] DELETE /identity/v3/users/55520f7ae2f341af868e767ca3e38396 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:12.909639 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40323df-d5d7-44c3-8b60-8b1cb864ac5e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:12.912930 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c40323df-d5d7-44c3-8b60-8b1cb864ac5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:12.944097 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40323df-d5d7-44c3-8b60-8b1cb864ac5e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:13.001276 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76bcb9-72f1-44aa-9624-e138c5107159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:13.002149 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76bcb9-72f1-44aa-9624-e138c5107159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:13.002431 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76bcb9-72f1-44aa-9624-e138c5107159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:13.002709 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76bcb9-72f1-44aa-9624-e138c5107159 admin admin] PATH_INFO: `/v3/projects/5b81e0fedb9146c681b0631219191fa0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:13.003906 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76bcb9-72f1-44aa-9624-e138c5107159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b81e0fedb9146c681b0631219191fa0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:13.005849 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76bcb9-72f1-44aa-9624-e138c5107159 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:13.041697 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:13.056200 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6e76bcb9-72f1-44aa-9624-e138c5107159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b81e0fedb9146c681b0631219191fa0', 'request_id': 'req-6e76bcb9-72f1-44aa-9624-e138c5107159'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:13.062287 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6e76bcb9-72f1-44aa-9624-e138c5107159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b81e0fedb9146c681b0631219191fa0', 'request_id': 'req-6e76bcb9-72f1-44aa-9624-e138c5107159'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:13.068585 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6e76bcb9-72f1-44aa-9624-e138c5107159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b81e0fedb9146c681b0631219191fa0', 'request_id': 'req-6e76bcb9-72f1-44aa-9624-e138c5107159'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:13.082865 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6e76bcb9-72f1-44aa-9624-e138c5107159 admin admin] The token cache is being invalidate because project 5b81e0fedb9146c681b0631219191fa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:07:13.083151 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6e76bcb9-72f1-44aa-9624-e138c5107159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:13.084083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6e76bcb9-72f1-44aa-9624-e138c5107159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:13.087050 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1384/2733] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:07:12 2022] DELETE /identity/v3/projects/5b81e0fedb9146c681b0631219191fa0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:13.094196 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ada68a-2531-40ab-8fdc-359055893c24 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:13.094712 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ada68a-2531-40ab-8fdc-359055893c24 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:13.094712 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ada68a-2531-40ab-8fdc-359055893c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:13.119680 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e1ada68a-2531-40ab-8fdc-359055893c24 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:13.120944 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e1ada68a-2531-40ab-8fdc-359055893c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:13.186787 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1350/2734] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:13.195997 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95343a3-f9c8-47d6-8c9c-1904245af177 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:13.196204 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95343a3-f9c8-47d6-8c9c-1904245af177 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:13.196460 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95343a3-f9c8-47d6-8c9c-1904245af177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:13.219439 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b95343a3-f9c8-47d6-8c9c-1904245af177 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:13.220909 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b95343a3-f9c8-47d6-8c9c-1904245af177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:13.230552 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1385/2735] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:13.235083 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ada68a-2531-40ab-8fdc-359055893c24 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:13.245969 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ada68a-2531-40ab-8fdc-359055893c24 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:13.251569 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f54090-551c-4d2b-8708-199ceb1026cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:13.252318 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f54090-551c-4d2b-8708-199ceb1026cf admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:13.252605 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f54090-551c-4d2b-8708-199ceb1026cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:13.252878 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f54090-551c-4d2b-8708-199ceb1026cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:13.253606 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f54090-551c-4d2b-8708-199ceb1026cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:07:13.253914 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f54090-551c-4d2b-8708-199ceb1026cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:13.255565 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f54090-551c-4d2b-8708-199ceb1026cf admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:13.268929 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1351/2736] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 15:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:07:13.273891 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95343a3-f9c8-47d6-8c9c-1904245af177 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:13.284059 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95343a3-f9c8-47d6-8c9c-1904245af177 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:13.289269 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9cb96-d900-4612-b7c7-850f6f238685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:13.289999 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9cb96-d900-4612-b7c7-850f6f238685 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:13.290278 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9cb96-d900-4612-b7c7-850f6f238685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:13.290549 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9cb96-d900-4612-b7c7-850f6f238685 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:13.291245 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd9cb96-d900-4612-b7c7-850f6f238685 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:13.293209 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd9cb96-d900-4612-b7c7-850f6f238685 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:13.322230 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1386/2737] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 15:07:13 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:07:13.326798 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f54090-551c-4d2b-8708-199ceb1026cf admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:13.337711 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f54090-551c-4d2b-8708-199ceb1026cf admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:13.364717 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:13.398499 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad8972-bf79-484b-8387-c3ee71739831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:13.399509 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad8972-bf79-484b-8387-c3ee71739831 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:13.399771 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad8972-bf79-484b-8387-c3ee71739831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:13.400078 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad8972-bf79-484b-8387-c3ee71739831 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:13.400762 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad8972-bf79-484b-8387-c3ee71739831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:13.402686 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad8972-bf79-484b-8387-c3ee71739831 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:13.424272 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1352/2738] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 15:07:13 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:07:13.428408 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9cb96-d900-4612-b7c7-850f6f238685 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:13.439338 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9cb96-d900-4612-b7c7-850f6f238685 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:13.444658 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b0029-11f4-4673-8757-7f03de688056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:13.445344 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b0029-11f4-4673-8757-7f03de688056 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:13.445608 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b0029-11f4-4673-8757-7f03de688056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:13.445911 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b0029-11f4-4673-8757-7f03de688056 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:13.446696 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b0029-11f4-4673-8757-7f03de688056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:13.448256 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b0029-11f4-4673-8757-7f03de688056 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:13.458669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1387/2739] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:07:13.462870 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad8972-bf79-484b-8387-c3ee71739831 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:13.474918 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad8972-bf79-484b-8387-c3ee71739831 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:13.478069 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a6398-ba18-44d0-a64c-c93c74e79732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:13.478733 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a6398-ba18-44d0-a64c-c93c74e79732 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:13.479017 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a6398-ba18-44d0-a64c-c93c74e79732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:13.479290 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a6398-ba18-44d0-a64c-c93c74e79732 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:13.480074 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a6398-ba18-44d0-a64c-c93c74e79732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:13.481680 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a6398-ba18-44d0-a64c-c93c74e79732 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:13.492522 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1353/2740] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:07:13.496868 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b0029-11f4-4673-8757-7f03de688056 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:13.507811 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b0029-11f4-4673-8757-7f03de688056 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:13.513235 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f8fc0-23ca-4e94-875a-e5da28ca7f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:13.514129 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f8fc0-23ca-4e94-875a-e5da28ca7f5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:13.514413 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f8fc0-23ca-4e94-875a-e5da28ca7f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:13.514689 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f8fc0-23ca-4e94-875a-e5da28ca7f5f admin admin] PATH_INFO: `/v3/projects/22f4efa8387745ccbf2d3c6565ca4ea0/users/1445e64d749844a790f7ffe4c2befec9/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:13.531964 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f8fc0-23ca-4e94-875a-e5da28ca7f5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=22f4efa8387745ccbf2d3c6565ca4ea0, user_id=1445e64d749844a790f7ffe4c2befec9, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:13.535789 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f8fc0-23ca-4e94-875a-e5da28ca7f5f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:13.551944 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1388/2741] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:07:13 2022] PUT /identity/v3/projects/22f4efa8387745ccbf2d3c6565ca4ea0/users/1445e64d749844a790f7ffe4c2befec9/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:13.563744 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b4758-231c-463f-a7a6-2bfe537f32e9 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:13.564203 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b4758-231c-463f-a7a6-2bfe537f32e9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:13.564488 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b4758-231c-463f-a7a6-2bfe537f32e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:13.596320 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-7f7b4758-231c-463f-a7a6-2bfe537f32e9 None None] MFA Rules not processed for user `1445e64d749844a790f7ffe4c2befec9`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:13.597528 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7f7b4758-231c-463f-a7a6-2bfe537f32e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:13.667768 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1354/2742] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:07:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:13.679169 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f8fc0-23ca-4e94-875a-e5da28ca7f5f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:13.681349 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-198f8fc0-23ca-4e94-875a-e5da28ca7f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:13.739891 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f8fc0-23ca-4e94-875a-e5da28ca7f5f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:13.744254 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6c98a-9e60-4c74-96f6-d1331e4cb69f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:13.744892 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6c98a-9e60-4c74-96f6-d1331e4cb69f service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:13.745175 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6c98a-9e60-4c74-96f6-d1331e4cb69f service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:13.745445 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6c98a-9e60-4c74-96f6-d1331e4cb69f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:13.754534 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f6c98a-9e60-4c74-96f6-d1331e4cb69f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:13.756009 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f6c98a-9e60-4c74-96f6-d1331e4cb69f service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:13.765554 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1389/2743] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:14.062046 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b4758-231c-463f-a7a6-2bfe537f32e9 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:14.063607 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7f7b4758-231c-463f-a7a6-2bfe537f32e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:14.122698 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b4758-231c-463f-a7a6-2bfe537f32e9 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:14.126674 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc5ae3-3b2f-49d1-a9e1-8d86ecf26b05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:14.127325 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc5ae3-3b2f-49d1-a9e1-8d86ecf26b05 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:14.127611 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc5ae3-3b2f-49d1-a9e1-8d86ecf26b05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:14.127907 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc5ae3-3b2f-49d1-a9e1-8d86ecf26b05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:14.129759 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-62fc5ae3-3b2f-49d1-a9e1-8d86ecf26b05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:14.181309 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:14.199068 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc5ae3-3b2f-49d1-a9e1-8d86ecf26b05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:14.200642 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc5ae3-3b2f-49d1-a9e1-8d86ecf26b05 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:14.211560 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1355/2744] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:17.497524 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6c98a-9e60-4c74-96f6-d1331e4cb69f service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:17.499165 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b4f6c98a-9e60-4c74-96f6-d1331e4cb69f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:17.520683 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6c98a-9e60-4c74-96f6-d1331e4cb69f service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:17.524933 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4783816-8c22-451a-bef1-5a6796879759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:17.526011 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4783816-8c22-451a-bef1-5a6796879759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:17.526302 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4783816-8c22-451a-bef1-5a6796879759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:17.526577 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4783816-8c22-451a-bef1-5a6796879759 admin admin] PATH_INFO: `/v3/users/74029b3845b4408bb58332e21e801ba0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:17.542988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4783816-8c22-451a-bef1-5a6796879759 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74029b3845b4408bb58332e21e801ba0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:17.545169 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4783816-8c22-451a-bef1-5a6796879759 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:17.600462 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:17.604799 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-f4783816-8c22-451a-bef1-5a6796879759 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74029b3845b4408bb58332e21e801ba0'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:17.620200 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-f4783816-8c22-451a-bef1-5a6796879759 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74029b3845b4408bb58332e21e801ba0'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:17.620932 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-f4783816-8c22-451a-bef1-5a6796879759 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74029b3845b4408bb58332e21e801ba0'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:17.629694 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-f4783816-8c22-451a-bef1-5a6796879759 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74029b3845b4408bb58332e21e801ba0'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:17.637352 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-f4783816-8c22-451a-bef1-5a6796879759 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74029b3845b4408bb58332e21e801ba0'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:17.647322 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1390/2745] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 15:07:17 2022] DELETE /identity/v3/users/74029b3845b4408bb58332e21e801ba0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:17.830537 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc5ae3-3b2f-49d1-a9e1-8d86ecf26b05 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:17.841999 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc5ae3-3b2f-49d1-a9e1-8d86ecf26b05 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:17.903291 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819bb46-1b2f-48d0-9dfa-b74af147e4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:17.904191 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819bb46-1b2f-48d0-9dfa-b74af147e4a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:17.904487 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819bb46-1b2f-48d0-9dfa-b74af147e4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:17.904762 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819bb46-1b2f-48d0-9dfa-b74af147e4a9 admin admin] PATH_INFO: `/v3/projects/fdb9cd0a4bc9437db70e9b81c4f1b0d3` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:17.915391 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819bb46-1b2f-48d0-9dfa-b74af147e4a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdb9cd0a4bc9437db70e9b81c4f1b0d3)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:17.917360 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819bb46-1b2f-48d0-9dfa-b74af147e4a9 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:17.977098 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4819bb46-1b2f-48d0-9dfa-b74af147e4a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdb9cd0a4bc9437db70e9b81c4f1b0d3', 'request_id': 'req-4819bb46-1b2f-48d0-9dfa-b74af147e4a9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:17.983780 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4819bb46-1b2f-48d0-9dfa-b74af147e4a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdb9cd0a4bc9437db70e9b81c4f1b0d3', 'request_id': 'req-4819bb46-1b2f-48d0-9dfa-b74af147e4a9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:17.989910 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4819bb46-1b2f-48d0-9dfa-b74af147e4a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdb9cd0a4bc9437db70e9b81c4f1b0d3', 'request_id': 'req-4819bb46-1b2f-48d0-9dfa-b74af147e4a9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:18.005959 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4819bb46-1b2f-48d0-9dfa-b74af147e4a9 admin admin] The token cache is being invalidate because project fdb9cd0a4bc9437db70e9b81c4f1b0d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:07:18.006242 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4819bb46-1b2f-48d0-9dfa-b74af147e4a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:18.006875 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4819bb46-1b2f-48d0-9dfa-b74af147e4a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:18.008957 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1356/2746] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:07:17 2022] DELETE /identity/v3/projects/fdb9cd0a4bc9437db70e9b81c4f1b0d3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:18.014088 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be10f7-7503-4ac8-8696-f85e33d7574b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:18.014376 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be10f7-7503-4ac8-8696-f85e33d7574b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:18.014670 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be10f7-7503-4ac8-8696-f85e33d7574b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:18.040702 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-63be10f7-7503-4ac8-8696-f85e33d7574b None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:18.042000 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-63be10f7-7503-4ac8-8696-f85e33d7574b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:18.116666 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1391/2747] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:18.128340 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232491c0-947d-4992-aab9-a6df2bedad2d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:18.128739 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232491c0-947d-4992-aab9-a6df2bedad2d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:18.129124 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232491c0-947d-4992-aab9-a6df2bedad2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:18.155049 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-232491c0-947d-4992-aab9-a6df2bedad2d None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:18.156285 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-232491c0-947d-4992-aab9-a6df2bedad2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:18.166103 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1357/2748] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:18.170681 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be10f7-7503-4ac8-8696-f85e33d7574b None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:18.181494 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be10f7-7503-4ac8-8696-f85e33d7574b None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:18.187235 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eac450-eecf-4219-bbd4-480c02d31336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:18.187893 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eac450-eecf-4219-bbd4-480c02d31336 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:18.188322 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eac450-eecf-4219-bbd4-480c02d31336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:18.188596 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eac450-eecf-4219-bbd4-480c02d31336 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:18.189312 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eac450-eecf-4219-bbd4-480c02d31336 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:07:18.189618 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eac450-eecf-4219-bbd4-480c02d31336 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:18.191281 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eac450-eecf-4219-bbd4-480c02d31336 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:18.204890 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1392/2749] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 15:07:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:07:18.209686 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232491c0-947d-4992-aab9-a6df2bedad2d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:18.220382 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232491c0-947d-4992-aab9-a6df2bedad2d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:18.226525 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c66d8-fec5-4399-81e5-851126aec23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:18.227414 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c66d8-fec5-4399-81e5-851126aec23a admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:18.227703 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c66d8-fec5-4399-81e5-851126aec23a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:18.228074 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c66d8-fec5-4399-81e5-851126aec23a admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:18.228839 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c66d8-fec5-4399-81e5-851126aec23a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:18.230943 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c66d8-fec5-4399-81e5-851126aec23a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:18.260217 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1358/2750] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 15:07:18 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:07:18.264787 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eac450-eecf-4219-bbd4-480c02d31336 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:18.275900 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eac450-eecf-4219-bbd4-480c02d31336 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:18.333428 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6cd755-42d4-4864-8512-47a649f4b5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:18.334136 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cd755-42d4-4864-8512-47a649f4b5c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:18.334442 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cd755-42d4-4864-8512-47a649f4b5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:18.334742 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cd755-42d4-4864-8512-47a649f4b5c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:18.335461 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6cd755-42d4-4864-8512-47a649f4b5c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:18.337674 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6cd755-42d4-4864-8512-47a649f4b5c8 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:18.358531 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1393/2751] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 15:07:18 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:07:18.362757 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c66d8-fec5-4399-81e5-851126aec23a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:18.374106 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c66d8-fec5-4399-81e5-851126aec23a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:18.380037 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c08be-aac6-4032-b6bc-c3ac2ddc53f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:18.380699 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c08be-aac6-4032-b6bc-c3ac2ddc53f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:18.381000 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c08be-aac6-4032-b6bc-c3ac2ddc53f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:18.381271 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c08be-aac6-4032-b6bc-c3ac2ddc53f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:18.381986 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c08be-aac6-4032-b6bc-c3ac2ddc53f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:18.384065 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c08be-aac6-4032-b6bc-c3ac2ddc53f0 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:18.394464 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1359/2752] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:07:18.398698 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6cd755-42d4-4864-8512-47a649f4b5c8 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:18.409927 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6cd755-42d4-4864-8512-47a649f4b5c8 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:18.416296 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831b7f0-c678-4dca-bf64-9efab70f88d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:18.416970 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831b7f0-c678-4dca-bf64-9efab70f88d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:18.417248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831b7f0-c678-4dca-bf64-9efab70f88d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:18.417522 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831b7f0-c678-4dca-bf64-9efab70f88d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:18.418247 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831b7f0-c678-4dca-bf64-9efab70f88d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:18.419894 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831b7f0-c678-4dca-bf64-9efab70f88d5 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:18.431153 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1394/2753] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:07:18.435393 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c08be-aac6-4032-b6bc-c3ac2ddc53f0 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:18.445733 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c08be-aac6-4032-b6bc-c3ac2ddc53f0 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:18.450606 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60f398-07f3-4221-92b6-5187716b4aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:18.451495 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60f398-07f3-4221-92b6-5187716b4aeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:18.451779 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60f398-07f3-4221-92b6-5187716b4aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:18.452088 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60f398-07f3-4221-92b6-5187716b4aeb admin admin] PATH_INFO: `/v3/projects/a7c33c5ec03c49f2996a9a1630b5ed52/users/9872c8bfbcf9495bb226034153b0438e/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:18.467382 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60f398-07f3-4221-92b6-5187716b4aeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7c33c5ec03c49f2996a9a1630b5ed52, user_id=9872c8bfbcf9495bb226034153b0438e, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:18.470100 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60f398-07f3-4221-92b6-5187716b4aeb admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:18.485602 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1360/2754] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:07:18 2022] PUT /identity/v3/projects/a7c33c5ec03c49f2996a9a1630b5ed52/users/9872c8bfbcf9495bb226034153b0438e/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:18.490806 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93d516-f32c-4bdc-839c-d97becd7ead4 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:18.491099 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93d516-f32c-4bdc-839c-d97becd7ead4 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:18.491381 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93d516-f32c-4bdc-839c-d97becd7ead4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:18.512340 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-4c93d516-f32c-4bdc-839c-d97becd7ead4 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:18.513559 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4c93d516-f32c-4bdc-839c-d97becd7ead4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:18.536429 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:18.582098 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1395/2755] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:18.592123 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60f398-07f3-4221-92b6-5187716b4aeb admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:18.593918 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9f60f398-07f3-4221-92b6-5187716b4aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:18.600674 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:18.658402 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60f398-07f3-4221-92b6-5187716b4aeb admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:18.662482 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c6030-93ff-4489-89de-8f73b75ba75b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:18.663165 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c6030-93ff-4489-89de-8f73b75ba75b service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:18.663502 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c6030-93ff-4489-89de-8f73b75ba75b service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:18.664110 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c6030-93ff-4489-89de-8f73b75ba75b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:18.674245 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c6030-93ff-4489-89de-8f73b75ba75b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:18.676075 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c6030-93ff-4489-89de-8f73b75ba75b service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:18.686237 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1361/2756] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:07:22.835471 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7dda7-45dc-4054-93fb-b405c6c2b5c8 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:22.836133 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7dda7-45dc-4054-93fb-b405c6c2b5c8 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:22.836343 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7dda7-45dc-4054-93fb-b405c6c2b5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:22.880921 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-50f7dda7-45dc-4054-93fb-b405c6c2b5c8 None None] MFA Rules not processed for user `9872c8bfbcf9495bb226034153b0438e`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:22.882580 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-50f7dda7-45dc-4054-93fb-b405c6c2b5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:22.959492 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1396/2757] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:07:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:22.977826 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c6030-93ff-4489-89de-8f73b75ba75b service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:22.979776 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-435c6030-93ff-4489-89de-8f73b75ba75b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:23.113441 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c6030-93ff-4489-89de-8f73b75ba75b service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:23.123858 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4066db-2a8f-4428-b067-286d386b136d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:23.124718 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4066db-2a8f-4428-b067-286d386b136d service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:23.125066 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4066db-2a8f-4428-b067-286d386b136d service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:23.125422 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4066db-2a8f-4428-b067-286d386b136d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:23.135080 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4066db-2a8f-4428-b067-286d386b136d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:23.136732 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4066db-2a8f-4428-b067-286d386b136d service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:23.146687 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1362/2758] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:24.751737 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc076e8d-921f-45d9-9639-ddf7a2a185d8 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:24.752323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc076e8d-921f-45d9-9639-ddf7a2a185d8 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:24.752323 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc076e8d-921f-45d9-9639-ddf7a2a185d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:24.772423 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-cc076e8d-921f-45d9-9639-ddf7a2a185d8 None None] MFA Rules not processed for user `9872c8bfbcf9495bb226034153b0438e`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:24.774390 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-cc076e8d-921f-45d9-9639-ddf7a2a185d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:24.784949 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1397/2759] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:07:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:27.631260 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4066db-2a8f-4428-b067-286d386b136d service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:27.633938 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-cf4066db-2a8f-4428-b067-286d386b136d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:27.646301 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4066db-2a8f-4428-b067-286d386b136d service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:27.650534 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3d272-f8c8-4db8-9f3a-de4ba8474b64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:27.651207 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3d272-f8c8-4db8-9f3a-de4ba8474b64 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:27.651489 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3d272-f8c8-4db8-9f3a-de4ba8474b64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:27.651765 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3d272-f8c8-4db8-9f3a-de4ba8474b64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:27.653720 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-49a3d272-f8c8-4db8-9f3a-de4ba8474b64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:27.665234 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3d272-f8c8-4db8-9f3a-de4ba8474b64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:27.666857 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3d272-f8c8-4db8-9f3a-de4ba8474b64 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:27.675771 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1363/2760] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:27.825157 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc076e8d-921f-45d9-9639-ddf7a2a185d8 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:27.826626 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-cc076e8d-921f-45d9-9639-ddf7a2a185d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:27.841069 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc076e8d-921f-45d9-9639-ddf7a2a185d8 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:27.846205 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb622f3-f3f5-4296-931c-0048d388cd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:27.847391 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb622f3-f3f5-4296-931c-0048d388cd37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:27.848193 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb622f3-f3f5-4296-931c-0048d388cd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:27.848687 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb622f3-f3f5-4296-931c-0048d388cd37 admin admin] PATH_INFO: `/v3/users/1445e64d749844a790f7ffe4c2befec9` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:27.850138 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb622f3-f3f5-4296-931c-0048d388cd37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1445e64d749844a790f7ffe4c2befec9)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:27.852411 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb622f3-f3f5-4296-931c-0048d388cd37 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:27.900846 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5cb622f3-f3f5-4296-931c-0048d388cd37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1445e64d749844a790f7ffe4c2befec9'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:27.913558 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5cb622f3-f3f5-4296-931c-0048d388cd37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1445e64d749844a790f7ffe4c2befec9'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:27.914336 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5cb622f3-f3f5-4296-931c-0048d388cd37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1445e64d749844a790f7ffe4c2befec9'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:27.922370 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5cb622f3-f3f5-4296-931c-0048d388cd37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1445e64d749844a790f7ffe4c2befec9'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:27.929889 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-5cb622f3-f3f5-4296-931c-0048d388cd37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1445e64d749844a790f7ffe4c2befec9'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:27.937177 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1398/2761] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 15:07:27 2022] DELETE /identity/v3/users/1445e64d749844a790f7ffe4c2befec9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:27.941627 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86715c36-8a16-44e0-9f2a-dc6cde98cffe None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:27.941920 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86715c36-8a16-44e0-9f2a-dc6cde98cffe None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:27.942200 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86715c36-8a16-44e0-9f2a-dc6cde98cffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:27.961304 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-86715c36-8a16-44e0-9f2a-dc6cde98cffe None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:27.962596 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-86715c36-8a16-44e0-9f2a-dc6cde98cffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:28.026649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1364/2762] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:28.036594 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb622f3-f3f5-4296-931c-0048d388cd37 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:28.038302 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5cb622f3-f3f5-4296-931c-0048d388cd37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:28.067666 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:28.101917 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb622f3-f3f5-4296-931c-0048d388cd37 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:28.105920 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68958771-5012-4f07-8a39-77c2faa31a18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:28.106551 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68958771-5012-4f07-8a39-77c2faa31a18 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:28.106862 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68958771-5012-4f07-8a39-77c2faa31a18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:28.107167 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68958771-5012-4f07-8a39-77c2faa31a18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:28.117409 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68958771-5012-4f07-8a39-77c2faa31a18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:28.118827 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68958771-5012-4f07-8a39-77c2faa31a18 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:28.128916 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1399/2763] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:28.560775 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86715c36-8a16-44e0-9f2a-dc6cde98cffe None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:28.563203 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-86715c36-8a16-44e0-9f2a-dc6cde98cffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:28.590013 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86715c36-8a16-44e0-9f2a-dc6cde98cffe None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:28.595669 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc439f-438f-4e2b-9659-bf5806e2f979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:28.596651 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc439f-438f-4e2b-9659-bf5806e2f979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:28.597003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc439f-438f-4e2b-9659-bf5806e2f979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:28.598275 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc439f-438f-4e2b-9659-bf5806e2f979 admin admin] PATH_INFO: `/v3/projects/22f4efa8387745ccbf2d3c6565ca4ea0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:28.600912 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc439f-438f-4e2b-9659-bf5806e2f979 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22f4efa8387745ccbf2d3c6565ca4ea0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:28.603983 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc439f-438f-4e2b-9659-bf5806e2f979 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:28.625087 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:28.664129 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a0cc439f-438f-4e2b-9659-bf5806e2f979 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22f4efa8387745ccbf2d3c6565ca4ea0', 'request_id': 'req-a0cc439f-438f-4e2b-9659-bf5806e2f979'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:28.671016 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a0cc439f-438f-4e2b-9659-bf5806e2f979 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22f4efa8387745ccbf2d3c6565ca4ea0', 'request_id': 'req-a0cc439f-438f-4e2b-9659-bf5806e2f979'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:28.677902 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a0cc439f-438f-4e2b-9659-bf5806e2f979 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22f4efa8387745ccbf2d3c6565ca4ea0', 'request_id': 'req-a0cc439f-438f-4e2b-9659-bf5806e2f979'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:28.696051 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a0cc439f-438f-4e2b-9659-bf5806e2f979 admin admin] The token cache is being invalidate because project 22f4efa8387745ccbf2d3c6565ca4ea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:07:28.696366 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a0cc439f-438f-4e2b-9659-bf5806e2f979 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:28.697322 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a0cc439f-438f-4e2b-9659-bf5806e2f979 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:28.699379 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1365/2764] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:07:28 2022] DELETE /identity/v3/projects/22f4efa8387745ccbf2d3c6565ca4ea0 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:28.706584 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88887aba-9407-4d4d-94e6-ea8226abf6f8 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:28.706990 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88887aba-9407-4d4d-94e6-ea8226abf6f8 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:28.707395 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88887aba-9407-4d4d-94e6-ea8226abf6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:28.726531 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-88887aba-9407-4d4d-94e6-ea8226abf6f8 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:28.727724 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-88887aba-9407-4d4d-94e6-ea8226abf6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:28.797000 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1400/2765] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:07:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:28.806045 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a2fcf-b09c-4c50-ad24-31ddce97d910 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:28.806335 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a2fcf-b09c-4c50-ad24-31ddce97d910 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:28.806616 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a2fcf-b09c-4c50-ad24-31ddce97d910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:28.825841 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-280a2fcf-b09c-4c50-ad24-31ddce97d910 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:28.827059 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-280a2fcf-b09c-4c50-ad24-31ddce97d910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:28.835617 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1366/2766] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:07:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:28.840904 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88887aba-9407-4d4d-94e6-ea8226abf6f8 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:28.857660 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88887aba-9407-4d4d-94e6-ea8226abf6f8 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:28.867793 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb9a25-1f36-4f1a-9a89-3d2740ba5c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:28.868494 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb9a25-1f36-4f1a-9a89-3d2740ba5c82 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:28.868774 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb9a25-1f36-4f1a-9a89-3d2740ba5c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:28.869049 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb9a25-1f36-4f1a-9a89-3d2740ba5c82 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:28.869766 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb9a25-1f36-4f1a-9a89-3d2740ba5c82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:07:28.870068 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb9a25-1f36-4f1a-9a89-3d2740ba5c82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:28.871768 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb9a25-1f36-4f1a-9a89-3d2740ba5c82 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:28.885264 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1401/2767] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 15:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:07:28.889596 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a2fcf-b09c-4c50-ad24-31ddce97d910 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:28.899828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a2fcf-b09c-4c50-ad24-31ddce97d910 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:28.905758 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428becec-6a65-4571-a052-e75acdb023a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:28.906489 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428becec-6a65-4571-a052-e75acdb023a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:28.906758 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428becec-6a65-4571-a052-e75acdb023a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:28.907527 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428becec-6a65-4571-a052-e75acdb023a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:28.907758 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428becec-6a65-4571-a052-e75acdb023a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:28.909725 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428becec-6a65-4571-a052-e75acdb023a9 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:28.939581 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1367/2768] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 15:07:28 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:07:28.943948 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb9a25-1f36-4f1a-9a89-3d2740ba5c82 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:28.955091 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb9a25-1f36-4f1a-9a89-3d2740ba5c82 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:29.016973 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc8c94-1ba2-49d0-9f26-a76c28572c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:29.017654 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc8c94-1ba2-49d0-9f26-a76c28572c92 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:29.017938 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc8c94-1ba2-49d0-9f26-a76c28572c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:29.018217 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc8c94-1ba2-49d0-9f26-a76c28572c92 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:29.018915 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc8c94-1ba2-49d0-9f26-a76c28572c92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:29.020912 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc8c94-1ba2-49d0-9f26-a76c28572c92 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:29.044960 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1402/2769] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 15:07:28 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:07:29.049347 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428becec-6a65-4571-a052-e75acdb023a9 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:29.060400 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428becec-6a65-4571-a052-e75acdb023a9 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:29.065947 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7b0e1-18ea-4fce-9bba-6fcbcf014b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:29.066623 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7b0e1-18ea-4fce-9bba-6fcbcf014b12 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:29.066910 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7b0e1-18ea-4fce-9bba-6fcbcf014b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:29.067176 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7b0e1-18ea-4fce-9bba-6fcbcf014b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:29.067935 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f7b0e1-18ea-4fce-9bba-6fcbcf014b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:29.069548 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f7b0e1-18ea-4fce-9bba-6fcbcf014b12 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:29.081187 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1368/2770] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:07:29.085244 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc8c94-1ba2-49d0-9f26-a76c28572c92 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:29.096310 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc8c94-1ba2-49d0-9f26-a76c28572c92 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:29.101717 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd025346-d90a-4fc3-98e0-eef253ae0f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:29.102461 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd025346-d90a-4fc3-98e0-eef253ae0f28 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:29.102741 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd025346-d90a-4fc3-98e0-eef253ae0f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:29.103015 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd025346-d90a-4fc3-98e0-eef253ae0f28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:29.103748 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd025346-d90a-4fc3-98e0-eef253ae0f28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:29.105439 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd025346-d90a-4fc3-98e0-eef253ae0f28 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:29.116167 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1403/2771] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:07:29.120568 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7b0e1-18ea-4fce-9bba-6fcbcf014b12 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:29.131054 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7b0e1-18ea-4fce-9bba-6fcbcf014b12 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:29.136173 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5abd137-09ea-40db-bd91-387a078937de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:29.137097 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abd137-09ea-40db-bd91-387a078937de admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:29.137506 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abd137-09ea-40db-bd91-387a078937de admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:29.137821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abd137-09ea-40db-bd91-387a078937de admin admin] PATH_INFO: `/v3/projects/094abc4dea1a46009df462b7f63729f9/users/dedda428e405446e9f785f52010aefe3/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:29.154849 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5abd137-09ea-40db-bd91-387a078937de admin admin] RBAC: Authorizing `identity:create_grant(project_id=094abc4dea1a46009df462b7f63729f9, user_id=dedda428e405446e9f785f52010aefe3, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:29.157707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5abd137-09ea-40db-bd91-387a078937de admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:29.171724 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1369/2772] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:07:29 2022] PUT /identity/v3/projects/094abc4dea1a46009df462b7f63729f9/users/dedda428e405446e9f785f52010aefe3/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:29.182710 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfa429-11f9-4f57-b27a-d846485f1363 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:29.182999 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfa429-11f9-4f57-b27a-d846485f1363 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:29.183275 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfa429-11f9-4f57-b27a-d846485f1363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:29.221112 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-37dfa429-11f9-4f57-b27a-d846485f1363 None None] MFA Rules not processed for user `dedda428e405446e9f785f52010aefe3`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:29.222523 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-37dfa429-11f9-4f57-b27a-d846485f1363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:29.243119 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:29.296797 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1404/2773] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:07:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:29.307637 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5abd137-09ea-40db-bd91-387a078937de admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:29.309352 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c5abd137-09ea-40db-bd91-387a078937de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:29.374667 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5abd137-09ea-40db-bd91-387a078937de admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:29.378469 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caced9d7-d648-404a-9972-e3a1531ce54f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:29.379114 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caced9d7-d648-404a-9972-e3a1531ce54f service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:29.379395 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caced9d7-d648-404a-9972-e3a1531ce54f service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:29.379668 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caced9d7-d648-404a-9972-e3a1531ce54f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:29.388781 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caced9d7-d648-404a-9972-e3a1531ce54f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:29.390743 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caced9d7-d648-404a-9972-e3a1531ce54f service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:29.403168 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1370/2774] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:32.503226 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfa429-11f9-4f57-b27a-d846485f1363 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:32.573585 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfa429-11f9-4f57-b27a-d846485f1363 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:32.578847 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe06b7-f3f5-49a6-950f-fac7a010d541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:32.579726 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe06b7-f3f5-49a6-950f-fac7a010d541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:32.580039 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe06b7-f3f5-49a6-950f-fac7a010d541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:32.580309 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe06b7-f3f5-49a6-950f-fac7a010d541 admin admin] PATH_INFO: `/v3/users/dedda428e405446e9f785f52010aefe3` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:32.581561 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe06b7-f3f5-49a6-950f-fac7a010d541 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dedda428e405446e9f785f52010aefe3)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:32.583504 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe06b7-f3f5-49a6-950f-fac7a010d541 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:32.637964 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9abe06b7-f3f5-49a6-950f-fac7a010d541 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dedda428e405446e9f785f52010aefe3'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:32.655984 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9abe06b7-f3f5-49a6-950f-fac7a010d541 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dedda428e405446e9f785f52010aefe3'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:32.657357 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9abe06b7-f3f5-49a6-950f-fac7a010d541 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dedda428e405446e9f785f52010aefe3'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:32.666902 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9abe06b7-f3f5-49a6-950f-fac7a010d541 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dedda428e405446e9f785f52010aefe3'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:32.677109 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-9abe06b7-f3f5-49a6-950f-fac7a010d541 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dedda428e405446e9f785f52010aefe3'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:32.683844 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1405/2775] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 15:07:32 2022] DELETE /identity/v3/users/dedda428e405446e9f785f52010aefe3 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:32.688311 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eec12d-c2db-4019-aae4-87fd9bd30654 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:32.688820 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eec12d-c2db-4019-aae4-87fd9bd30654 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:32.689007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eec12d-c2db-4019-aae4-87fd9bd30654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:32.706632 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-51eec12d-c2db-4019-aae4-87fd9bd30654 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:32.707914 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-51eec12d-c2db-4019-aae4-87fd9bd30654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:32.751163 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:32.782609 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1371/2776] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:32.793315 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe06b7-f3f5-49a6-950f-fac7a010d541 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:32.795188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9abe06b7-f3f5-49a6-950f-fac7a010d541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:32.840135 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:32.858211 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe06b7-f3f5-49a6-950f-fac7a010d541 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:32.861946 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d4ebf-2409-45f1-80b2-8e69a1612eb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:32.862597 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d4ebf-2409-45f1-80b2-8e69a1612eb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:32.862877 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d4ebf-2409-45f1-80b2-8e69a1612eb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:32.863153 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d4ebf-2409-45f1-80b2-8e69a1612eb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:32.872467 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d4ebf-2409-45f1-80b2-8e69a1612eb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:32.873893 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d4ebf-2409-45f1-80b2-8e69a1612eb2 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:32.883650 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1406/2777] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:33.169148 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eec12d-c2db-4019-aae4-87fd9bd30654 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:33.170623 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-51eec12d-c2db-4019-aae4-87fd9bd30654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:33.183287 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eec12d-c2db-4019-aae4-87fd9bd30654 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:33.189078 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb1e5e-bab2-4456-8811-10a76bcdcd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:33.190050 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb1e5e-bab2-4456-8811-10a76bcdcd36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:33.190405 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb1e5e-bab2-4456-8811-10a76bcdcd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:33.190751 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb1e5e-bab2-4456-8811-10a76bcdcd36 admin admin] PATH_INFO: `/v3/projects/094abc4dea1a46009df462b7f63729f9` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:33.192175 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb1e5e-bab2-4456-8811-10a76bcdcd36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=094abc4dea1a46009df462b7f63729f9)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:33.194510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb1e5e-bab2-4456-8811-10a76bcdcd36 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:33.248991 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0eeb1e5e-bab2-4456-8811-10a76bcdcd36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '094abc4dea1a46009df462b7f63729f9', 'request_id': 'req-0eeb1e5e-bab2-4456-8811-10a76bcdcd36'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:33.255377 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0eeb1e5e-bab2-4456-8811-10a76bcdcd36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '094abc4dea1a46009df462b7f63729f9', 'request_id': 'req-0eeb1e5e-bab2-4456-8811-10a76bcdcd36'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:33.261469 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0eeb1e5e-bab2-4456-8811-10a76bcdcd36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '094abc4dea1a46009df462b7f63729f9', 'request_id': 'req-0eeb1e5e-bab2-4456-8811-10a76bcdcd36'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:33.277266 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0eeb1e5e-bab2-4456-8811-10a76bcdcd36 admin admin] The token cache is being invalidate because project 094abc4dea1a46009df462b7f63729f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:07:33.277489 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0eeb1e5e-bab2-4456-8811-10a76bcdcd36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:33.278145 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0eeb1e5e-bab2-4456-8811-10a76bcdcd36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:33.279738 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1372/2778] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:07:33 2022] DELETE /identity/v3/projects/094abc4dea1a46009df462b7f63729f9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:33.284800 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08cb0e5-5b4a-4bd4-9130-3c32724e9651 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:33.285089 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08cb0e5-5b4a-4bd4-9130-3c32724e9651 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:33.285368 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08cb0e5-5b4a-4bd4-9130-3c32724e9651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:33.302956 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-c08cb0e5-5b4a-4bd4-9130-3c32724e9651 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:33.304353 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c08cb0e5-5b4a-4bd4-9130-3c32724e9651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:33.369291 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1407/2779] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:07:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:33.378067 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279e2b8-b8f5-4dca-a11c-bc6c0c5619cc None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:33.378436 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279e2b8-b8f5-4dca-a11c-bc6c0c5619cc None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:33.378776 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279e2b8-b8f5-4dca-a11c-bc6c0c5619cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:33.404925 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5279e2b8-b8f5-4dca-a11c-bc6c0c5619cc None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:33.406151 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5279e2b8-b8f5-4dca-a11c-bc6c0c5619cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:33.415585 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1373/2780] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:07:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:33.420115 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08cb0e5-5b4a-4bd4-9130-3c32724e9651 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:33.430117 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08cb0e5-5b4a-4bd4-9130-3c32724e9651 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:33.436037 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75f042-146e-42b9-b84a-0267b3fcee37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:33.436692 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75f042-146e-42b9-b84a-0267b3fcee37 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:33.436978 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75f042-146e-42b9-b84a-0267b3fcee37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:33.437251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75f042-146e-42b9-b84a-0267b3fcee37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:33.437983 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75f042-146e-42b9-b84a-0267b3fcee37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:07:33.438292 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75f042-146e-42b9-b84a-0267b3fcee37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:33.439937 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75f042-146e-42b9-b84a-0267b3fcee37 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:33.452626 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1408/2781] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 15:07:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 15:07:33.458578 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279e2b8-b8f5-4dca-a11c-bc6c0c5619cc None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:33.468476 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279e2b8-b8f5-4dca-a11c-bc6c0c5619cc None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:33.474206 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c038ab-4643-417a-953a-abf127eae9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:33.474861 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c038ab-4643-417a-953a-abf127eae9ce admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:33.475175 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c038ab-4643-417a-953a-abf127eae9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:33.475443 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c038ab-4643-417a-953a-abf127eae9ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:33.476203 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c038ab-4643-417a-953a-abf127eae9ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:33.478109 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c038ab-4643-417a-953a-abf127eae9ce admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:33.507932 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1374/2782] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 15:07:33 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:07:33.512635 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75f042-146e-42b9-b84a-0267b3fcee37 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:33.528466 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75f042-146e-42b9-b84a-0267b3fcee37 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:33.594150 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda20ea-07d0-4b1b-ac17-2fab5b38f649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:33.594963 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda20ea-07d0-4b1b-ac17-2fab5b38f649 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:33.595259 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda20ea-07d0-4b1b-ac17-2fab5b38f649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:33.595531 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda20ea-07d0-4b1b-ac17-2fab5b38f649 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:33.596248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda20ea-07d0-4b1b-ac17-2fab5b38f649 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:33.598212 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda20ea-07d0-4b1b-ac17-2fab5b38f649 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:33.624766 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1409/2783] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 15:07:33 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:07:33.626097 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c038ab-4643-417a-953a-abf127eae9ce admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:33.637837 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c038ab-4643-417a-953a-abf127eae9ce admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:33.642745 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6a5f9-cc8e-4214-b61c-7bba5a5a0e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:33.643411 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6a5f9-cc8e-4214-b61c-7bba5a5a0e05 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:33.643691 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6a5f9-cc8e-4214-b61c-7bba5a5a0e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:33.643996 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6a5f9-cc8e-4214-b61c-7bba5a5a0e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:33.644749 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe6a5f9-cc8e-4214-b61c-7bba5a5a0e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:33.646350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe6a5f9-cc8e-4214-b61c-7bba5a5a0e05 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:33.658356 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1375/2784] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:07:33.662468 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda20ea-07d0-4b1b-ac17-2fab5b38f649 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:33.674220 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda20ea-07d0-4b1b-ac17-2fab5b38f649 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:33.678798 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4469f-31b7-44d0-8853-486682444feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:33.679617 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4469f-31b7-44d0-8853-486682444feb admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:33.680156 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4469f-31b7-44d0-8853-486682444feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:33.680569 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4469f-31b7-44d0-8853-486682444feb admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:33.681299 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4469f-31b7-44d0-8853-486682444feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:33.682959 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4469f-31b7-44d0-8853-486682444feb admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:33.696586 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1410/2785] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:07:33.700595 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6a5f9-cc8e-4214-b61c-7bba5a5a0e05 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:33.713103 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6a5f9-cc8e-4214-b61c-7bba5a5a0e05 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:33.717771 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c25ac-579b-4d4e-bd22-38964fffecaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:33.718662 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c25ac-579b-4d4e-bd22-38964fffecaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:33.718941 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c25ac-579b-4d4e-bd22-38964fffecaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:33.719213 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c25ac-579b-4d4e-bd22-38964fffecaf admin admin] PATH_INFO: `/v3/projects/ef21475a097545609cad9a7b708f3f32/users/3e8628951f76432db644834b8a36d970/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:33.734963 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c25ac-579b-4d4e-bd22-38964fffecaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef21475a097545609cad9a7b708f3f32, user_id=3e8628951f76432db644834b8a36d970, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:33.737726 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c25ac-579b-4d4e-bd22-38964fffecaf admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:33.751916 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1376/2786] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:07:33 2022] PUT /identity/v3/projects/ef21475a097545609cad9a7b708f3f32/users/3e8628951f76432db644834b8a36d970/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:33.762728 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c7040-b118-4834-9e5d-6b7031e6ae8b None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:33.763013 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c7040-b118-4834-9e5d-6b7031e6ae8b None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:33.763287 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c7040-b118-4834-9e5d-6b7031e6ae8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:33.792821 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-653c7040-b118-4834-9e5d-6b7031e6ae8b None None] MFA Rules not processed for user `3e8628951f76432db644834b8a36d970`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:33.794055 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-653c7040-b118-4834-9e5d-6b7031e6ae8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:33.835716 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:33.865345 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1411/2787] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:07:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:07:33.870330 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c25ac-579b-4d4e-bd22-38964fffecaf admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:33.936367 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c25ac-579b-4d4e-bd22-38964fffecaf admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:33.941363 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d334238-8a3f-4708-a2b6-1109704e8d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:33.942038 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d334238-8a3f-4708-a2b6-1109704e8d4b admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:33.942326 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d334238-8a3f-4708-a2b6-1109704e8d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:33.942614 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d334238-8a3f-4708-a2b6-1109704e8d4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:33.943382 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d334238-8a3f-4708-a2b6-1109704e8d4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:33.945457 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d334238-8a3f-4708-a2b6-1109704e8d4b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:33.949841 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:33.973276 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1377/2788] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 15:07:33 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:07:33.977679 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c7040-b118-4834-9e5d-6b7031e6ae8b None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:33.988464 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c7040-b118-4834-9e5d-6b7031e6ae8b None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:34.052613 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d1ac1-b031-42a3-bfe9-f81839d2a75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:34.053441 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d1ac1-b031-42a3-bfe9-f81839d2a75f admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:34.053799 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d1ac1-b031-42a3-bfe9-f81839d2a75f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:34.054508 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d1ac1-b031-42a3-bfe9-f81839d2a75f admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:34.055204 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d1ac1-b031-42a3-bfe9-f81839d2a75f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:34.057163 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d1ac1-b031-42a3-bfe9-f81839d2a75f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:34.080028 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1412/2789] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 15:07:33 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:07:34.086013 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d334238-8a3f-4708-a2b6-1109704e8d4b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:34.096521 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d334238-8a3f-4708-a2b6-1109704e8d4b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:34.102695 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed1325-870f-49d0-a3d6-6a190d7b623a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:34.103201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed1325-870f-49d0-a3d6-6a190d7b623a admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:34.103550 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed1325-870f-49d0-a3d6-6a190d7b623a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:34.103827 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed1325-870f-49d0-a3d6-6a190d7b623a admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:34.104680 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed1325-870f-49d0-a3d6-6a190d7b623a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:34.106908 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed1325-870f-49d0-a3d6-6a190d7b623a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:34.118247 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1378/2790] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:07:34.122537 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d1ac1-b031-42a3-bfe9-f81839d2a75f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:34.133118 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d1ac1-b031-42a3-bfe9-f81839d2a75f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:34.138745 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56daed43-5345-4751-a32a-61805956c500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:34.139405 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56daed43-5345-4751-a32a-61805956c500 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:34.139689 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56daed43-5345-4751-a32a-61805956c500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:34.139997 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56daed43-5345-4751-a32a-61805956c500 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:34.140732 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56daed43-5345-4751-a32a-61805956c500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:34.142344 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56daed43-5345-4751-a32a-61805956c500 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:34.153813 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1413/2791] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:07:34.158257 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed1325-870f-49d0-a3d6-6a190d7b623a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:34.169427 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed1325-870f-49d0-a3d6-6a190d7b623a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:34.174468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec25136-0dfe-4b56-9061-53a905a40d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:34.175386 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec25136-0dfe-4b56-9061-53a905a40d5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:34.175666 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec25136-0dfe-4b56-9061-53a905a40d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:34.175971 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec25136-0dfe-4b56-9061-53a905a40d5a admin admin] PATH_INFO: `/v3/projects/62a927f9b67c4e7c9bf0ccf26bf644de/users/d353b5d342704c9e98ece0c868221c1d/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:34.196689 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec25136-0dfe-4b56-9061-53a905a40d5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=62a927f9b67c4e7c9bf0ccf26bf644de, user_id=d353b5d342704c9e98ece0c868221c1d, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:34.203315 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec25136-0dfe-4b56-9061-53a905a40d5a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:34.220415 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1379/2792] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:07:34 2022] PUT /identity/v3/projects/62a927f9b67c4e7c9bf0ccf26bf644de/users/d353b5d342704c9e98ece0c868221c1d/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:34.230905 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbd26b-bac5-492c-924f-e4248ac25168 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:34.231197 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbd26b-bac5-492c-924f-e4248ac25168 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:34.231511 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbd26b-bac5-492c-924f-e4248ac25168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:34.259134 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-88fbd26b-bac5-492c-924f-e4248ac25168 None None] MFA Rules not processed for user `d353b5d342704c9e98ece0c868221c1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:34.260421 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-88fbd26b-bac5-492c-924f-e4248ac25168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:34.326479 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1414/2793] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:07:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:34.331445 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec25136-0dfe-4b56-9061-53a905a40d5a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:34.399838 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec25136-0dfe-4b56-9061-53a905a40d5a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:34.405246 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951b5c6-8a88-4863-9380-71f8c30827e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:34.405904 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951b5c6-8a88-4863-9380-71f8c30827e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:34.406185 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951b5c6-8a88-4863-9380-71f8c30827e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:34.406458 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951b5c6-8a88-4863-9380-71f8c30827e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:34.407143 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e951b5c6-8a88-4863-9380-71f8c30827e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:34.409073 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e951b5c6-8a88-4863-9380-71f8c30827e5 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:34.437833 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1380/2794] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 15:07:34 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:07:34.442539 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbd26b-bac5-492c-924f-e4248ac25168 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:34.456061 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbd26b-bac5-492c-924f-e4248ac25168 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:34.504269 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:34.519055 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac56d6-62ad-496f-975e-f617ee89fa59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:34.519825 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac56d6-62ad-496f-975e-f617ee89fa59 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:34.520045 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac56d6-62ad-496f-975e-f617ee89fa59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:34.520321 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac56d6-62ad-496f-975e-f617ee89fa59 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:34.521017 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac56d6-62ad-496f-975e-f617ee89fa59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:34.523001 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac56d6-62ad-496f-975e-f617ee89fa59 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:34.546472 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1415/2795] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 15:07:34 2022] POST /identity/v3/users => generated 298 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:07:34.552811 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951b5c6-8a88-4863-9380-71f8c30827e5 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:34.564264 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951b5c6-8a88-4863-9380-71f8c30827e5 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:34.569773 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbb448-e776-41cd-a61e-076eb55db900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:34.570536 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbb448-e776-41cd-a61e-076eb55db900 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:34.570829 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbb448-e776-41cd-a61e-076eb55db900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:34.571105 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbb448-e776-41cd-a61e-076eb55db900 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:34.571821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fbb448-e776-41cd-a61e-076eb55db900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:34.573462 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fbb448-e776-41cd-a61e-076eb55db900 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:34.584599 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1381/2796] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:07:34.590002 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac56d6-62ad-496f-975e-f617ee89fa59 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:34.601361 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac56d6-62ad-496f-975e-f617ee89fa59 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:34.606876 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f78e9-e386-4c73-9e38-991688ff668c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:34.607759 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f78e9-e386-4c73-9e38-991688ff668c admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:34.608085 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f78e9-e386-4c73-9e38-991688ff668c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:34.608367 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f78e9-e386-4c73-9e38-991688ff668c admin admin] PATH_INFO: `/v3/projects/8e7542aac7c34432b8c4440204f0585b/users/3891079a95f74f7a8a34902b4f595b7c/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:34.624026 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f78e9-e386-4c73-9e38-991688ff668c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e7542aac7c34432b8c4440204f0585b, user_id=3891079a95f74f7a8a34902b4f595b7c, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:34.626854 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f78e9-e386-4c73-9e38-991688ff668c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:34.644021 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1416/2797] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:07:34 2022] PUT /identity/v3/projects/8e7542aac7c34432b8c4440204f0585b/users/3891079a95f74f7a8a34902b4f595b7c/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:34.649136 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbb448-e776-41cd-a61e-076eb55db900 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:34.659625 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbb448-e776-41cd-a61e-076eb55db900 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:34.721066 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101b695-8bbe-4ce3-9216-0c20d033e338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:34.721734 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101b695-8bbe-4ce3-9216-0c20d033e338 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:34.722015 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101b695-8bbe-4ce3-9216-0c20d033e338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:34.722302 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101b695-8bbe-4ce3-9216-0c20d033e338 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:34.723032 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101b695-8bbe-4ce3-9216-0c20d033e338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:34.724685 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101b695-8bbe-4ce3-9216-0c20d033e338 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:34.734571 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1382/2798] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:07:34.739178 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f78e9-e386-4c73-9e38-991688ff668c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:34.749779 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f78e9-e386-4c73-9e38-991688ff668c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:34.755653 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129875a-8289-48dc-9ac8-47aa8ec9a6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:34.756562 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129875a-8289-48dc-9ac8-47aa8ec9a6cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:34.756844 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129875a-8289-48dc-9ac8-47aa8ec9a6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:34.757136 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129875a-8289-48dc-9ac8-47aa8ec9a6cd admin admin] PATH_INFO: `/v3/projects/8e7542aac7c34432b8c4440204f0585b/users/3891079a95f74f7a8a34902b4f595b7c/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:34.759495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129875a-8289-48dc-9ac8-47aa8ec9a6cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e7542aac7c34432b8c4440204f0585b, user_id=3891079a95f74f7a8a34902b4f595b7c, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:34.762233 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129875a-8289-48dc-9ac8-47aa8ec9a6cd admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:34.773429 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1417/2799] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:07:34 2022] PUT /identity/v3/projects/8e7542aac7c34432b8c4440204f0585b/users/3891079a95f74f7a8a34902b4f595b7c/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:34.839007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083dd7ee-6bef-444b-ae04-eaff4dd407fc None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:34.839232 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083dd7ee-6bef-444b-ae04-eaff4dd407fc None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:34.839528 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083dd7ee-6bef-444b-ae04-eaff4dd407fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:34.879021 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-083dd7ee-6bef-444b-ae04-eaff4dd407fc None None] MFA Rules not processed for user `3891079a95f74f7a8a34902b4f595b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:34.880264 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-083dd7ee-6bef-444b-ae04-eaff4dd407fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:34.890227 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:34.955332 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1383/2800] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:07:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:34.966998 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129875a-8289-48dc-9ac8-47aa8ec9a6cd admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:34.968808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9129875a-8289-48dc-9ac8-47aa8ec9a6cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:35.028739 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129875a-8289-48dc-9ac8-47aa8ec9a6cd admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:35.032670 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1509c-f564-4ece-8bff-e4bac03f1bc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:35.033319 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1509c-f564-4ece-8bff-e4bac03f1bc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:35.033596 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1509c-f564-4ece-8bff-e4bac03f1bc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:35.033888 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1509c-f564-4ece-8bff-e4bac03f1bc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:35.094364 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1509c-f564-4ece-8bff-e4bac03f1bc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:35.095832 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1509c-f564-4ece-8bff-e4bac03f1bc1 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:35.106063 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1418/2801] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:36.618650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083dd7ee-6bef-444b-ae04-eaff4dd407fc None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:36.620335 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-083dd7ee-6bef-444b-ae04-eaff4dd407fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:36.639620 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083dd7ee-6bef-444b-ae04-eaff4dd407fc None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:36.643828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23763929-4119-4a49-8668-28624a713a03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:36.644534 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23763929-4119-4a49-8668-28624a713a03 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:36.644817 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23763929-4119-4a49-8668-28624a713a03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:36.645092 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23763929-4119-4a49-8668-28624a713a03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:36.708375 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23763929-4119-4a49-8668-28624a713a03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:36.710442 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23763929-4119-4a49-8668-28624a713a03 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:36.724446 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1384/2802] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:37.314829 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1509c-f564-4ece-8bff-e4bac03f1bc1 service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:37.324616 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1509c-f564-4ece-8bff-e4bac03f1bc1 service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:37.328410 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef10e5b-ee2a-486a-a983-10156bc30d75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:37.329047 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef10e5b-ee2a-486a-a983-10156bc30d75 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:37.329431 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef10e5b-ee2a-486a-a983-10156bc30d75 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:37.329660 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef10e5b-ee2a-486a-a983-10156bc30d75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:37.339943 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef10e5b-ee2a-486a-a983-10156bc30d75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:37.341416 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef10e5b-ee2a-486a-a983-10156bc30d75 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:37.353201 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1419/2803] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:41.294452 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23763929-4119-4a49-8668-28624a713a03 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:41.367468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23763929-4119-4a49-8668-28624a713a03 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:41.372771 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26d73e-77fb-4d0d-aeea-b41e201d1701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:41.373678 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26d73e-77fb-4d0d-aeea-b41e201d1701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:41.373959 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26d73e-77fb-4d0d-aeea-b41e201d1701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:41.374234 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26d73e-77fb-4d0d-aeea-b41e201d1701 admin admin] PATH_INFO: `/v3/users/3e8628951f76432db644834b8a36d970` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:41.375499 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26d73e-77fb-4d0d-aeea-b41e201d1701 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e8628951f76432db644834b8a36d970)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:41.377473 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26d73e-77fb-4d0d-aeea-b41e201d1701 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:41.435187 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5d26d73e-77fb-4d0d-aeea-b41e201d1701 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e8628951f76432db644834b8a36d970'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:41.436510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:41.444519 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5d26d73e-77fb-4d0d-aeea-b41e201d1701 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e8628951f76432db644834b8a36d970'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:41.452963 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5d26d73e-77fb-4d0d-aeea-b41e201d1701 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e8628951f76432db644834b8a36d970'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:41.466021 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5d26d73e-77fb-4d0d-aeea-b41e201d1701 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e8628951f76432db644834b8a36d970'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:41.466857 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5d26d73e-77fb-4d0d-aeea-b41e201d1701 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e8628951f76432db644834b8a36d970'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:41.473147 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1385/2804] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 15:07:41 2022] DELETE /identity/v3/users/3e8628951f76432db644834b8a36d970 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:41.477981 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f2748-1bda-464b-8863-b3417e6d8cdd None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:41.478485 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f2748-1bda-464b-8863-b3417e6d8cdd None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:41.478485 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f2748-1bda-464b-8863-b3417e6d8cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:41.496630 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d97f2748-1bda-464b-8863-b3417e6d8cdd None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:41.498556 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d97f2748-1bda-464b-8863-b3417e6d8cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:41.539511 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:41.567900 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1420/2805] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:41.578001 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26d73e-77fb-4d0d-aeea-b41e201d1701 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:41.579513 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5d26d73e-77fb-4d0d-aeea-b41e201d1701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:41.642517 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26d73e-77fb-4d0d-aeea-b41e201d1701 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:41.646539 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316a0f8-7468-47a5-8378-5797a6f6ebdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:41.647277 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316a0f8-7468-47a5-8378-5797a6f6ebdf service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:41.647701 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316a0f8-7468-47a5-8378-5797a6f6ebdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:41.648040 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316a0f8-7468-47a5-8378-5797a6f6ebdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:41.658407 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316a0f8-7468-47a5-8378-5797a6f6ebdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:41.659905 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316a0f8-7468-47a5-8378-5797a6f6ebdf service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:41.670068 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1386/2806] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:41.974050 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f2748-1bda-464b-8863-b3417e6d8cdd None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:41.975582 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d97f2748-1bda-464b-8863-b3417e6d8cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:41.988019 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f2748-1bda-464b-8863-b3417e6d8cdd None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:41.995296 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ca827-719c-4117-9696-7765b2dd00b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:41.996074 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ca827-719c-4117-9696-7765b2dd00b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:41.996300 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ca827-719c-4117-9696-7765b2dd00b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:41.996570 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ca827-719c-4117-9696-7765b2dd00b7 admin admin] PATH_INFO: `/v3/projects/ef21475a097545609cad9a7b708f3f32` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:41.998635 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ca827-719c-4117-9696-7765b2dd00b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef21475a097545609cad9a7b708f3f32)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:42.000603 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ca827-719c-4117-9696-7765b2dd00b7 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:42.054204 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-058ca827-719c-4117-9696-7765b2dd00b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef21475a097545609cad9a7b708f3f32', 'request_id': 'req-058ca827-719c-4117-9696-7765b2dd00b7'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:42.059888 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-058ca827-719c-4117-9696-7765b2dd00b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef21475a097545609cad9a7b708f3f32', 'request_id': 'req-058ca827-719c-4117-9696-7765b2dd00b7'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:42.066163 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-058ca827-719c-4117-9696-7765b2dd00b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef21475a097545609cad9a7b708f3f32', 'request_id': 'req-058ca827-719c-4117-9696-7765b2dd00b7'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:42.080773 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-058ca827-719c-4117-9696-7765b2dd00b7 admin admin] The token cache is being invalidate because project ef21475a097545609cad9a7b708f3f32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:07:42.081062 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-058ca827-719c-4117-9696-7765b2dd00b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:42.081759 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-058ca827-719c-4117-9696-7765b2dd00b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:42.083398 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1421/2807] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:07:41 2022] DELETE /identity/v3/projects/ef21475a097545609cad9a7b708f3f32 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:42.087600 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316a0f8-7468-47a5-8378-5797a6f6ebdf service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:42.097646 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316a0f8-7468-47a5-8378-5797a6f6ebdf service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:42.162570 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56dbb6-f1f8-4d84-a20a-1001b725d770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:42.163648 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56dbb6-f1f8-4d84-a20a-1001b725d770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:42.164040 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56dbb6-f1f8-4d84-a20a-1001b725d770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:42.164310 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56dbb6-f1f8-4d84-a20a-1001b725d770 admin admin] PATH_INFO: `/v3/users/d353b5d342704c9e98ece0c868221c1d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:42.165561 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc56dbb6-f1f8-4d84-a20a-1001b725d770 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d353b5d342704c9e98ece0c868221c1d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:42.167560 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc56dbb6-f1f8-4d84-a20a-1001b725d770 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:42.215703 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-dc56dbb6-f1f8-4d84-a20a-1001b725d770 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd353b5d342704c9e98ece0c868221c1d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:42.222540 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-dc56dbb6-f1f8-4d84-a20a-1001b725d770 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd353b5d342704c9e98ece0c868221c1d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:42.230502 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-dc56dbb6-f1f8-4d84-a20a-1001b725d770 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd353b5d342704c9e98ece0c868221c1d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:42.236385 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:42.246493 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-dc56dbb6-f1f8-4d84-a20a-1001b725d770 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd353b5d342704c9e98ece0c868221c1d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:42.247880 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-dc56dbb6-f1f8-4d84-a20a-1001b725d770 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd353b5d342704c9e98ece0c868221c1d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:42.255755 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1387/2808] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 15:07:42 2022] DELETE /identity/v3/users/d353b5d342704c9e98ece0c868221c1d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:42.554196 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ca827-719c-4117-9696-7765b2dd00b7 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:42.556749 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-058ca827-719c-4117-9696-7765b2dd00b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:42.579721 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ca827-719c-4117-9696-7765b2dd00b7 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:42.655952 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf8727-564c-4979-a9dd-c586be22797a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:42.656751 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf8727-564c-4979-a9dd-c586be22797a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:42.657027 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf8727-564c-4979-a9dd-c586be22797a admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:42.657298 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf8727-564c-4979-a9dd-c586be22797a admin admin] PATH_INFO: `/v3/projects/62a927f9b67c4e7c9bf0ccf26bf644de` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:42.658545 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf8727-564c-4979-a9dd-c586be22797a admin admin] RBAC: Authorizing `identity:delete_project(project_id=62a927f9b67c4e7c9bf0ccf26bf644de)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:42.660522 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf8727-564c-4979-a9dd-c586be22797a admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:42.721646 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0dcf8727-564c-4979-a9dd-c586be22797a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62a927f9b67c4e7c9bf0ccf26bf644de', 'request_id': 'req-0dcf8727-564c-4979-a9dd-c586be22797a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:42.727277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0dcf8727-564c-4979-a9dd-c586be22797a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62a927f9b67c4e7c9bf0ccf26bf644de', 'request_id': 'req-0dcf8727-564c-4979-a9dd-c586be22797a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:42.733408 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0dcf8727-564c-4979-a9dd-c586be22797a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62a927f9b67c4e7c9bf0ccf26bf644de', 'request_id': 'req-0dcf8727-564c-4979-a9dd-c586be22797a'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:42.735908 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:42.751082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0dcf8727-564c-4979-a9dd-c586be22797a admin admin] The token cache is being invalidate because project 62a927f9b67c4e7c9bf0ccf26bf644de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:07:42.751436 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0dcf8727-564c-4979-a9dd-c586be22797a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:42.752314 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-0dcf8727-564c-4979-a9dd-c586be22797a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:42.754602 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1422/2809] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:07:42 2022] DELETE /identity/v3/projects/62a927f9b67c4e7c9bf0ccf26bf644de => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:42.759171 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56dbb6-f1f8-4d84-a20a-1001b725d770 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:42.760681 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-dc56dbb6-f1f8-4d84-a20a-1001b725d770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:42.774622 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56dbb6-f1f8-4d84-a20a-1001b725d770 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:42.840758 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64533a3c-ddba-40af-a7fd-4f6e48ae2487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:42.841812 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64533a3c-ddba-40af-a7fd-4f6e48ae2487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:42.842091 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64533a3c-ddba-40af-a7fd-4f6e48ae2487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:42.842362 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64533a3c-ddba-40af-a7fd-4f6e48ae2487 admin admin] PATH_INFO: `/v3/users/3891079a95f74f7a8a34902b4f595b7c` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:42.843595 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64533a3c-ddba-40af-a7fd-4f6e48ae2487 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3891079a95f74f7a8a34902b4f595b7c)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:42.845607 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64533a3c-ddba-40af-a7fd-4f6e48ae2487 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:42.895960 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-64533a3c-ddba-40af-a7fd-4f6e48ae2487 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3891079a95f74f7a8a34902b4f595b7c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:42.902839 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-64533a3c-ddba-40af-a7fd-4f6e48ae2487 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3891079a95f74f7a8a34902b4f595b7c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:42.911818 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-64533a3c-ddba-40af-a7fd-4f6e48ae2487 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3891079a95f74f7a8a34902b4f595b7c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:42.924761 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-64533a3c-ddba-40af-a7fd-4f6e48ae2487 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3891079a95f74f7a8a34902b4f595b7c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:42.925431 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-64533a3c-ddba-40af-a7fd-4f6e48ae2487 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3891079a95f74f7a8a34902b4f595b7c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:42.931649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1388/2810] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 15:07:42 2022] DELETE /identity/v3/users/3891079a95f74f7a8a34902b4f595b7c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:43.222671 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf8727-564c-4979-a9dd-c586be22797a admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:43.224558 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-0dcf8727-564c-4979-a9dd-c586be22797a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:43.242082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf8727-564c-4979-a9dd-c586be22797a admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:43.304130 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451e8a3-9ec3-4c08-8b4d-ab35964814e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:43.305388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451e8a3-9ec3-4c08-8b4d-ab35964814e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:43.305666 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451e8a3-9ec3-4c08-8b4d-ab35964814e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:43.305939 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451e8a3-9ec3-4c08-8b4d-ab35964814e0 admin admin] PATH_INFO: `/v3/projects/8e7542aac7c34432b8c4440204f0585b` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:43.307137 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451e8a3-9ec3-4c08-8b4d-ab35964814e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e7542aac7c34432b8c4440204f0585b)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:43.309219 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451e8a3-9ec3-4c08-8b4d-ab35964814e0 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:43.364172 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b451e8a3-9ec3-4c08-8b4d-ab35964814e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e7542aac7c34432b8c4440204f0585b', 'request_id': 'req-b451e8a3-9ec3-4c08-8b4d-ab35964814e0'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:43.370074 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b451e8a3-9ec3-4c08-8b4d-ab35964814e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e7542aac7c34432b8c4440204f0585b', 'request_id': 'req-b451e8a3-9ec3-4c08-8b4d-ab35964814e0'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:43.376483 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b451e8a3-9ec3-4c08-8b4d-ab35964814e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e7542aac7c34432b8c4440204f0585b', 'request_id': 'req-b451e8a3-9ec3-4c08-8b4d-ab35964814e0'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:43.391808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b451e8a3-9ec3-4c08-8b4d-ab35964814e0 admin admin] The token cache is being invalidate because project 8e7542aac7c34432b8c4440204f0585b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:07:43.392148 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b451e8a3-9ec3-4c08-8b4d-ab35964814e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:43.392847 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-b451e8a3-9ec3-4c08-8b4d-ab35964814e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:07:43.394475 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1423/2811] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:07:43 2022] DELETE /identity/v3/projects/8e7542aac7c34432b8c4440204f0585b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:07:52.928038 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=58,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:53.387972 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:DELETE=8,keystone:SELECT=53,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:31.916992 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64533a3c-ddba-40af-a7fd-4f6e48ae2487 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:31.918682 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-64533a3c-ddba-40af-a7fd-4f6e48ae2487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:32.072125 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64533a3c-ddba-40af-a7fd-4f6e48ae2487 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:32.135426 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419a23e-d82d-4ff4-9d3d-da4e8cd0759b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819ad532defb4adaa2f4fd06b47630d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:32.136373 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419a23e-d82d-4ff4-9d3d-da4e8cd0759b service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:32.136654 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419a23e-d82d-4ff4-9d3d-da4e8cd0759b service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:32.136909 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419a23e-d82d-4ff4-9d3d-da4e8cd0759b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:32.138729 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d419a23e-d82d-4ff4-9d3d-da4e8cd0759b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:32.150545 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419a23e-d82d-4ff4-9d3d-da4e8cd0759b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:32.152152 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419a23e-d82d-4ff4-9d3d-da4e8cd0759b service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:32.162197 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1389/2812] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:10:42.158009 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:36.271495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451e8a3-9ec3-4c08-8b4d-ab35964814e0 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:36.273548 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b451e8a3-9ec3-4c08-8b4d-ab35964814e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:36.372287 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451e8a3-9ec3-4c08-8b4d-ab35964814e0 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:36.376945 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36858e7-f3fe-45f6-b20d-33abd45d3276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:36.377658 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36858e7-f3fe-45f6-b20d-33abd45d3276 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:36.377940 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36858e7-f3fe-45f6-b20d-33abd45d3276 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:36.378244 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36858e7-f3fe-45f6-b20d-33abd45d3276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:36.380576 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e36858e7-f3fe-45f6-b20d-33abd45d3276 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:36.478108 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36858e7-f3fe-45f6-b20d-33abd45d3276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:36.479493 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36858e7-f3fe-45f6-b20d-33abd45d3276 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:36.500817 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1424/2813] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:11:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:11:37.690752 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419a23e-d82d-4ff4-9d3d-da4e8cd0759b service placement] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:37.702041 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419a23e-d82d-4ff4-9d3d-da4e8cd0759b service placement] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:37.706558 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d2509-a2d3-4516-8d41-e3eee3a6b584 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:37.707203 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d2509-a2d3-4516-8d41-e3eee3a6b584 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:37.707494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d2509-a2d3-4516-8d41-e3eee3a6b584 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:37.707777 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d2509-a2d3-4516-8d41-e3eee3a6b584 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:37.709833 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-609d2509-a2d3-4516-8d41-e3eee3a6b584 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:37.724653 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d2509-a2d3-4516-8d41-e3eee3a6b584 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:37.726093 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d2509-a2d3-4516-8d41-e3eee3a6b584 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:37.737236 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1390/2814] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:11:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:11:39.720561 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36858e7-f3fe-45f6-b20d-33abd45d3276 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:39.722089 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-e36858e7-f3fe-45f6-b20d-33abd45d3276 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:39.745728 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36858e7-f3fe-45f6-b20d-33abd45d3276 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:39.749197 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b7fa0-bf66-44cf-923a-2fd535fbd25f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:39.750520 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b7fa0-bf66-44cf-923a-2fd535fbd25f service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:39.750520 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b7fa0-bf66-44cf-923a-2fd535fbd25f service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:39.750520 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b7fa0-bf66-44cf-923a-2fd535fbd25f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:39.752464 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a59b7fa0-bf66-44cf-923a-2fd535fbd25f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:39.767621 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b7fa0-bf66-44cf-923a-2fd535fbd25f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:39.769733 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b7fa0-bf66-44cf-923a-2fd535fbd25f service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:39.793759 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1425/2815] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:11:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:11:43.310332 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cbe28-9048-4dbb-874a-6f4f6ee925df None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:43.310893 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cbe28-9048-4dbb-874a-6f4f6ee925df None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:43.310893 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cbe28-9048-4dbb-874a-6f4f6ee925df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:43.329500 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-941cbe28-9048-4dbb-874a-6f4f6ee925df None None] MFA Rules not processed for user `9872c8bfbcf9495bb226034153b0438e`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:11:43.330711 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-941cbe28-9048-4dbb-874a-6f4f6ee925df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:43.397128 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1391/2816] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:11:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:11:43.726401 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b7fa0-bf66-44cf-923a-2fd535fbd25f service nova] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:43.736608 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b7fa0-bf66-44cf-923a-2fd535fbd25f service nova] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:43.740594 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff23a1e-6485-4a4c-8fc8-f59001303ca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:43.741226 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff23a1e-6485-4a4c-8fc8-f59001303ca7 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:43.741505 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff23a1e-6485-4a4c-8fc8-f59001303ca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:43.741779 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff23a1e-6485-4a4c-8fc8-f59001303ca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:43.743705 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-eff23a1e-6485-4a4c-8fc8-f59001303ca7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:43.753636 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff23a1e-6485-4a4c-8fc8-f59001303ca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:43.755199 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff23a1e-6485-4a4c-8fc8-f59001303ca7 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:43.764130 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1426/2817] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:11:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:11:44.098601 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941cbe28-9048-4dbb-874a-6f4f6ee925df None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:44.100297 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-941cbe28-9048-4dbb-874a-6f4f6ee925df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:44.115462 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941cbe28-9048-4dbb-874a-6f4f6ee925df None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:44.120805 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d44915e-3cba-483d-808b-8482f026875d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819ad532defb4adaa2f4fd06b47630d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:44.121572 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44915e-3cba-483d-808b-8482f026875d service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:44.121858 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44915e-3cba-483d-808b-8482f026875d service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:44.122143 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44915e-3cba-483d-808b-8482f026875d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:44.123912 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5d44915e-3cba-483d-808b-8482f026875d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:44.139449 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d44915e-3cba-483d-808b-8482f026875d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:44.141166 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d44915e-3cba-483d-808b-8482f026875d service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:44.152134 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1392/2818] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:11:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:11:53.759825 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:54.147818 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=37 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:55.162790 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff23a1e-6485-4a4c-8fc8-f59001303ca7 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:55.177361 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff23a1e-6485-4a4c-8fc8-f59001303ca7 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:55.183134 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac1f91-0f43-4d91-b1bf-70044c91d66e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:55.183800 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac1f91-0f43-4d91-b1bf-70044c91d66e service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:55.184114 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac1f91-0f43-4d91-b1bf-70044c91d66e service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:55.184387 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac1f91-0f43-4d91-b1bf-70044c91d66e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:55.186220 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-adac1f91-0f43-4d91-b1bf-70044c91d66e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:55.199398 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac1f91-0f43-4d91-b1bf-70044c91d66e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:55.201431 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac1f91-0f43-4d91-b1bf-70044c91d66e service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:55.213858 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1427/2819] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:11:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:12:05.209138 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=6 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:13:14.694417 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d44915e-3cba-483d-808b-8482f026875d service placement] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:14.710834 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d44915e-3cba-483d-808b-8482f026875d service placement] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:14.716986 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85266e45-b58a-48f9-9869-5b21e8ccb5bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:14.717630 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85266e45-b58a-48f9-9869-5b21e8ccb5bf service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:14.717909 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85266e45-b58a-48f9-9869-5b21e8ccb5bf service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:14.718182 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85266e45-b58a-48f9-9869-5b21e8ccb5bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:14.720679 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-85266e45-b58a-48f9-9869-5b21e8ccb5bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:13:14.732083 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85266e45-b58a-48f9-9869-5b21e8ccb5bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:14.733686 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85266e45-b58a-48f9-9869-5b21e8ccb5bf service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:14.743766 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1393/2820] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:13:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:13:24.605224 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac1f91-0f43-4d91-b1bf-70044c91d66e service nova] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:24.615794 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac1f91-0f43-4d91-b1bf-70044c91d66e service nova] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:24.620460 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f6126-ddcf-48b2-a719-a081a813d07b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:24.621113 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f6126-ddcf-48b2-a719-a081a813d07b service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:24.621369 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f6126-ddcf-48b2-a719-a081a813d07b service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:24.621769 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f6126-ddcf-48b2-a719-a081a813d07b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:24.623941 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ae0f6126-ddcf-48b2-a719-a081a813d07b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:13:24.640553 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f6126-ddcf-48b2-a719-a081a813d07b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:24.643191 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f6126-ddcf-48b2-a719-a081a813d07b service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:24.654388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1428/2821] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:13:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:13:24.739121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=6 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:13:34.650600 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=6 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:13:35.336722 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85266e45-b58a-48f9-9869-5b21e8ccb5bf service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:35.352881 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85266e45-b58a-48f9-9869-5b21e8ccb5bf service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:35.359761 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205a3ca-d071-44b5-a791-c26c1ea09fd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:35.360458 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205a3ca-d071-44b5-a791-c26c1ea09fd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:35.360744 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205a3ca-d071-44b5-a791-c26c1ea09fd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:35.361017 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205a3ca-d071-44b5-a791-c26c1ea09fd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:35.363507 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9205a3ca-d071-44b5-a791-c26c1ea09fd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:13:35.463100 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205a3ca-d071-44b5-a791-c26c1ea09fd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:35.464744 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205a3ca-d071-44b5-a791-c26c1ea09fd0 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:35.484588 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1394/2822] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:13:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:13:38.703848 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f6126-ddcf-48b2-a719-a081a813d07b service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:38.705392 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-ae0f6126-ddcf-48b2-a719-a081a813d07b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:13:38.728461 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f6126-ddcf-48b2-a719-a081a813d07b service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:38.734669 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa55a12-6097-4336-8112-058fae0ebbab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819ad532defb4adaa2f4fd06b47630d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:38.735484 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa55a12-6097-4336-8112-058fae0ebbab service placement] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:38.736084 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa55a12-6097-4336-8112-058fae0ebbab service placement] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:38.736604 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa55a12-6097-4336-8112-058fae0ebbab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:38.738941 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-afa55a12-6097-4336-8112-058fae0ebbab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:13:38.752734 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa55a12-6097-4336-8112-058fae0ebbab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:38.754387 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa55a12-6097-4336-8112-058fae0ebbab service placement] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:38.765681 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205a3ca-d071-44b5-a791-c26c1ea09fd0 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:38.767467 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9205a3ca-d071-44b5-a791-c26c1ea09fd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:13:38.770594 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1429/2823] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:13:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:13:38.784435 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205a3ca-d071-44b5-a791-c26c1ea09fd0 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:38.789430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e7e67-1938-421e-ab1c-c57bead0d240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:38.790352 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e7e67-1938-421e-ab1c-c57bead0d240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:38.790639 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e7e67-1938-421e-ab1c-c57bead0d240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:38.790920 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e7e67-1938-421e-ab1c-c57bead0d240 admin admin] PATH_INFO: `/v3/users/9872c8bfbcf9495bb226034153b0438e` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:38.792157 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e7e67-1938-421e-ab1c-c57bead0d240 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9872c8bfbcf9495bb226034153b0438e)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:38.794098 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e7e67-1938-421e-ab1c-c57bead0d240 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:38.844612 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1a5e7e67-1938-421e-ab1c-c57bead0d240 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9872c8bfbcf9495bb226034153b0438e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:13:38.852566 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1a5e7e67-1938-421e-ab1c-c57bead0d240 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9872c8bfbcf9495bb226034153b0438e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:13:38.861366 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1a5e7e67-1938-421e-ab1c-c57bead0d240 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9872c8bfbcf9495bb226034153b0438e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:13:38.873424 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1a5e7e67-1938-421e-ab1c-c57bead0d240 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9872c8bfbcf9495bb226034153b0438e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:13:38.874116 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1a5e7e67-1938-421e-ab1c-c57bead0d240 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9872c8bfbcf9495bb226034153b0438e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:13:38.880168 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1395/2824] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 15:13:38 2022] DELETE /identity/v3/users/9872c8bfbcf9495bb226034153b0438e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:13:39.062470 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa55a12-6097-4336-8112-058fae0ebbab service placement] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:39.073802 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa55a12-6097-4336-8112-058fae0ebbab service placement] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:39.131865 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e5ca5-db7e-4420-93f5-809a68c02c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:39.132850 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e5ca5-db7e-4420-93f5-809a68c02c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:39.133133 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e5ca5-db7e-4420-93f5-809a68c02c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:39.133415 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e5ca5-db7e-4420-93f5-809a68c02c3f admin admin] PATH_INFO: `/v3/projects/a7c33c5ec03c49f2996a9a1630b5ed52` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:39.134591 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e5ca5-db7e-4420-93f5-809a68c02c3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7c33c5ec03c49f2996a9a1630b5ed52)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:39.136564 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e5ca5-db7e-4420-93f5-809a68c02c3f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:39.183408 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-916e5ca5-db7e-4420-93f5-809a68c02c3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7c33c5ec03c49f2996a9a1630b5ed52', 'request_id': 'req-916e5ca5-db7e-4420-93f5-809a68c02c3f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:13:39.190090 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-916e5ca5-db7e-4420-93f5-809a68c02c3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7c33c5ec03c49f2996a9a1630b5ed52', 'request_id': 'req-916e5ca5-db7e-4420-93f5-809a68c02c3f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:13:39.199818 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-916e5ca5-db7e-4420-93f5-809a68c02c3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7c33c5ec03c49f2996a9a1630b5ed52', 'request_id': 'req-916e5ca5-db7e-4420-93f5-809a68c02c3f'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:13:39.215944 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-916e5ca5-db7e-4420-93f5-809a68c02c3f admin admin] The token cache is being invalidate because project a7c33c5ec03c49f2996a9a1630b5ed52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:13:39.216233 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-916e5ca5-db7e-4420-93f5-809a68c02c3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:13:39.217062 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-916e5ca5-db7e-4420-93f5-809a68c02c3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:13:39.218862 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1430/2825] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:13:39 2022] DELETE /identity/v3/projects/a7c33c5ec03c49f2996a9a1630b5ed52 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:13:39.226705 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba67f3-9c08-4725-bde6-dc6e32cb3f62 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:39.227092 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba67f3-9c08-4725-bde6-dc6e32cb3f62 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:39.227498 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba67f3-9c08-4725-bde6-dc6e32cb3f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:39.295266 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:13:39.298915 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e4ba67f3-9c08-4725-bde6-dc6e32cb3f62 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:13:39.300839 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e4ba67f3-9c08-4725-bde6-dc6e32cb3f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:13:39.367536 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1396/2826] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:13:39.376123 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf0164-10ec-4e44-a3c7-ce164627ce6c None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:39.376413 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf0164-10ec-4e44-a3c7-ce164627ce6c None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:39.376691 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf0164-10ec-4e44-a3c7-ce164627ce6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:39.396240 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-87cf0164-10ec-4e44-a3c7-ce164627ce6c None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:13:39.397484 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-87cf0164-10ec-4e44-a3c7-ce164627ce6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:13:39.406496 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1431/2827] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:13:39.410994 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba67f3-9c08-4725-bde6-dc6e32cb3f62 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:39.421475 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba67f3-9c08-4725-bde6-dc6e32cb3f62 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:39.427803 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae3396-32d4-443f-9068-557ccfb80941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:39.428528 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae3396-32d4-443f-9068-557ccfb80941 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:39.428818 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae3396-32d4-443f-9068-557ccfb80941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:39.429089 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae3396-32d4-443f-9068-557ccfb80941 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:39.429988 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae3396-32d4-443f-9068-557ccfb80941 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:13:39.430296 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae3396-32d4-443f-9068-557ccfb80941 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:39.432127 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae3396-32d4-443f-9068-557ccfb80941 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:39.445392 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1397/2828] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 15:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 15:13:39.451832 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf0164-10ec-4e44-a3c7-ce164627ce6c None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:39.468348 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf0164-10ec-4e44-a3c7-ce164627ce6c None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:39.474192 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae8da12-d54e-4d4a-8ec0-c38baabdfb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:39.474915 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae8da12-d54e-4d4a-8ec0-c38baabdfb7f admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:39.475337 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae8da12-d54e-4d4a-8ec0-c38baabdfb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:39.475500 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae8da12-d54e-4d4a-8ec0-c38baabdfb7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:39.476206 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae8da12-d54e-4d4a-8ec0-c38baabdfb7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:39.478111 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae8da12-d54e-4d4a-8ec0-c38baabdfb7f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:39.519286 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1432/2829] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 15:13:39 2022] POST /identity/v3/projects => generated 399 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:13:39.524210 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae3396-32d4-443f-9068-557ccfb80941 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:39.536312 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae3396-32d4-443f-9068-557ccfb80941 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:39.602813 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea038af-951a-40f0-8027-bdfee5012e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:39.603626 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea038af-951a-40f0-8027-bdfee5012e1b admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:39.603990 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea038af-951a-40f0-8027-bdfee5012e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:39.604337 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea038af-951a-40f0-8027-bdfee5012e1b admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:39.605106 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea038af-951a-40f0-8027-bdfee5012e1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:39.607132 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea038af-951a-40f0-8027-bdfee5012e1b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:39.629536 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1398/2830] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 15:13:39 2022] POST /identity/v3/users => generated 300 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:13:39.633655 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae8da12-d54e-4d4a-8ec0-c38baabdfb7f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:39.644792 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae8da12-d54e-4d4a-8ec0-c38baabdfb7f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:39.650075 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f30c8-5156-4e76-b4bb-bbb1abeeb196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:39.650743 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f30c8-5156-4e76-b4bb-bbb1abeeb196 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:39.651023 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f30c8-5156-4e76-b4bb-bbb1abeeb196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:39.651297 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f30c8-5156-4e76-b4bb-bbb1abeeb196 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:39.652056 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f30c8-5156-4e76-b4bb-bbb1abeeb196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:39.653662 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f30c8-5156-4e76-b4bb-bbb1abeeb196 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:39.664567 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1433/2831] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:13:39.668897 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea038af-951a-40f0-8027-bdfee5012e1b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:39.679390 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea038af-951a-40f0-8027-bdfee5012e1b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:39.684084 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bda970-2cb2-4d31-9f8e-84bbd79cc502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:39.684746 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bda970-2cb2-4d31-9f8e-84bbd79cc502 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:39.685028 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bda970-2cb2-4d31-9f8e-84bbd79cc502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:39.685303 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bda970-2cb2-4d31-9f8e-84bbd79cc502 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:39.686033 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bda970-2cb2-4d31-9f8e-84bbd79cc502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:39.687671 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bda970-2cb2-4d31-9f8e-84bbd79cc502 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:39.697805 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1399/2832] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:13:39.702291 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f30c8-5156-4e76-b4bb-bbb1abeeb196 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:39.713313 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f30c8-5156-4e76-b4bb-bbb1abeeb196 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:39.718581 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f3f06-8ab6-4a2f-b4a7-351de065422e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:39.719600 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f3f06-8ab6-4a2f-b4a7-351de065422e admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:39.719906 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f3f06-8ab6-4a2f-b4a7-351de065422e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:39.720174 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f3f06-8ab6-4a2f-b4a7-351de065422e admin admin] PATH_INFO: `/v3/projects/03ca09cd75af42cab97050a7fb7a69e0/users/df77f56554a146cf8e72256edf989e90/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:39.737035 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f3f06-8ab6-4a2f-b4a7-351de065422e admin admin] RBAC: Authorizing `identity:create_grant(project_id=03ca09cd75af42cab97050a7fb7a69e0, user_id=df77f56554a146cf8e72256edf989e90, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:39.741989 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f3f06-8ab6-4a2f-b4a7-351de065422e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:39.773872 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1434/2833] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:13:39 2022] PUT /identity/v3/projects/03ca09cd75af42cab97050a7fb7a69e0/users/df77f56554a146cf8e72256edf989e90/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:13:39.784573 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8642c-2a20-4acd-a4ff-68c91a60f0e7 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:39.785134 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8642c-2a20-4acd-a4ff-68c91a60f0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:39.785134 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8642c-2a20-4acd-a4ff-68c91a60f0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:39.819426 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f3a8642c-2a20-4acd-a4ff-68c91a60f0e7 None None] MFA Rules not processed for user `df77f56554a146cf8e72256edf989e90`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:13:39.820828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f3a8642c-2a20-4acd-a4ff-68c91a60f0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:13:39.906933 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1400/2834] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:13:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:13:39.911640 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f3f06-8ab6-4a2f-b4a7-351de065422e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:39.918191 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:13:39.978108 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f3f06-8ab6-4a2f-b4a7-351de065422e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:39.984472 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432822bd-6e2a-46b8-8254-2b4c7839a710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:39.985120 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432822bd-6e2a-46b8-8254-2b4c7839a710 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:39.985394 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432822bd-6e2a-46b8-8254-2b4c7839a710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:39.985665 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432822bd-6e2a-46b8-8254-2b4c7839a710 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:39.986391 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432822bd-6e2a-46b8-8254-2b4c7839a710 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:39.988397 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432822bd-6e2a-46b8-8254-2b4c7839a710 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:40.017223 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1435/2835] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 15:13:39 2022] POST /identity/v3/projects => generated 401 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:13:40.021487 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8642c-2a20-4acd-a4ff-68c91a60f0e7 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:40.027162 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:13:40.034896 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8642c-2a20-4acd-a4ff-68c91a60f0e7 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:40.093053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479c481-2b6b-4de6-a312-7b5ecebb617e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:40.093632 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479c481-2b6b-4de6-a312-7b5ecebb617e admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:40.093911 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479c481-2b6b-4de6-a312-7b5ecebb617e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:40.094183 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479c481-2b6b-4de6-a312-7b5ecebb617e admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:40.094857 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2479c481-2b6b-4de6-a312-7b5ecebb617e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:40.096825 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2479c481-2b6b-4de6-a312-7b5ecebb617e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:40.120306 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1401/2836] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 15:13:40 2022] POST /identity/v3/users => generated 307 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:13:40.126048 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432822bd-6e2a-46b8-8254-2b4c7839a710 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:40.136907 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432822bd-6e2a-46b8-8254-2b4c7839a710 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:40.142486 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ef644-20d2-47d1-952c-bb2ad33e1e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:40.143147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ef644-20d2-47d1-952c-bb2ad33e1e3d admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:40.143429 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ef644-20d2-47d1-952c-bb2ad33e1e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:40.143704 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ef644-20d2-47d1-952c-bb2ad33e1e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:40.144458 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ef644-20d2-47d1-952c-bb2ad33e1e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:40.147496 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ef644-20d2-47d1-952c-bb2ad33e1e3d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:40.158348 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1436/2837] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:13:40.162930 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479c481-2b6b-4de6-a312-7b5ecebb617e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:40.175704 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479c481-2b6b-4de6-a312-7b5ecebb617e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:40.181210 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05334e38-ceaf-481f-bb56-dcc0ccf579b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:40.182111 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05334e38-ceaf-481f-bb56-dcc0ccf579b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:40.182394 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05334e38-ceaf-481f-bb56-dcc0ccf579b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:40.182941 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05334e38-ceaf-481f-bb56-dcc0ccf579b4 admin admin] PATH_INFO: `/v3/projects/7f93cbd358754264b18f57079e602a96/users/03e2682fce7a46268a753b3a1aa6d81e/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:40.200433 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05334e38-ceaf-481f-bb56-dcc0ccf579b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f93cbd358754264b18f57079e602a96, user_id=03e2682fce7a46268a753b3a1aa6d81e, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:40.203144 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05334e38-ceaf-481f-bb56-dcc0ccf579b4 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:40.219751 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1402/2838] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:13:40 2022] PUT /identity/v3/projects/7f93cbd358754264b18f57079e602a96/users/03e2682fce7a46268a753b3a1aa6d81e/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:13:40.226137 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ef644-20d2-47d1-952c-bb2ad33e1e3d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:40.243926 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ef644-20d2-47d1-952c-bb2ad33e1e3d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:40.310054 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba86d7-2450-44f0-bfd1-1baa9a08d577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:40.310994 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba86d7-2450-44f0-bfd1-1baa9a08d577 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:40.311406 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba86d7-2450-44f0-bfd1-1baa9a08d577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:40.311671 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba86d7-2450-44f0-bfd1-1baa9a08d577 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:40.312432 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba86d7-2450-44f0-bfd1-1baa9a08d577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:40.314032 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba86d7-2450-44f0-bfd1-1baa9a08d577 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:40.324688 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1437/2839] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:13:40.329526 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05334e38-ceaf-481f-bb56-dcc0ccf579b4 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:40.340558 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05334e38-ceaf-481f-bb56-dcc0ccf579b4 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:40.347129 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfbf4b-6043-47e5-8faa-cfe4e09cafca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:40.348001 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfbf4b-6043-47e5-8faa-cfe4e09cafca admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:40.348283 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfbf4b-6043-47e5-8faa-cfe4e09cafca admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:40.348559 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfbf4b-6043-47e5-8faa-cfe4e09cafca admin admin] PATH_INFO: `/v3/projects/7f93cbd358754264b18f57079e602a96/users/03e2682fce7a46268a753b3a1aa6d81e/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:40.350879 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfbf4b-6043-47e5-8faa-cfe4e09cafca admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f93cbd358754264b18f57079e602a96, user_id=03e2682fce7a46268a753b3a1aa6d81e, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:40.353613 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfbf4b-6043-47e5-8faa-cfe4e09cafca admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:40.365061 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1403/2840] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:13:40 2022] PUT /identity/v3/projects/7f93cbd358754264b18f57079e602a96/users/03e2682fce7a46268a753b3a1aa6d81e/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:13:40.377580 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34861c-5f7d-4746-a21e-36036b6cb71a None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:40.377862 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34861c-5f7d-4746-a21e-36036b6cb71a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:40.378132 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34861c-5f7d-4746-a21e-36036b6cb71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:40.407630 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-6a34861c-5f7d-4746-a21e-36036b6cb71a None None] MFA Rules not processed for user `03e2682fce7a46268a753b3a1aa6d81e`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:13:40.408904 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6a34861c-5f7d-4746-a21e-36036b6cb71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:13:40.483837 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:13:40.488895 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1438/2841] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:13:40 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:13:40.503041 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfbf4b-6043-47e5-8faa-cfe4e09cafca admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:40.505287 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c0cfbf4b-6043-47e5-8faa-cfe4e09cafca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:13:40.597056 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfbf4b-6043-47e5-8faa-cfe4e09cafca admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:40.602407 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed0d26-1432-4aac-9dbb-398debda0b39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:40.603041 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed0d26-1432-4aac-9dbb-398debda0b39 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:40.603516 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed0d26-1432-4aac-9dbb-398debda0b39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:40.603516 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed0d26-1432-4aac-9dbb-398debda0b39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:40.614125 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed0d26-1432-4aac-9dbb-398debda0b39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:40.615580 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed0d26-1432-4aac-9dbb-398debda0b39 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:40.625716 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1404/2842] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:13:40 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:13:40.702535 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34861c-5f7d-4746-a21e-36036b6cb71a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:40.713268 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34861c-5f7d-4746-a21e-36036b6cb71a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:40.717854 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d304107-6cb8-44ad-a939-e4e8f12b0e89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:40.718442 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d304107-6cb8-44ad-a939-e4e8f12b0e89 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:40.718671 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d304107-6cb8-44ad-a939-e4e8f12b0e89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:40.718944 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d304107-6cb8-44ad-a939-e4e8f12b0e89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:40.785985 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d304107-6cb8-44ad-a939-e4e8f12b0e89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:40.787436 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d304107-6cb8-44ad-a939-e4e8f12b0e89 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:40.798182 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1439/2843] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:13:40 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:13:44.920345 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed0d26-1432-4aac-9dbb-398debda0b39 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:44.965785 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:13:44.989970 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed0d26-1432-4aac-9dbb-398debda0b39 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:44.994720 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d1e8b-7f0d-47d2-ba6d-3b26307603c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:44.995583 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d1e8b-7f0d-47d2-ba6d-3b26307603c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:44.995861 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d1e8b-7f0d-47d2-ba6d-3b26307603c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:44.996158 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d1e8b-7f0d-47d2-ba6d-3b26307603c0 admin admin] PATH_INFO: `/v3/users/df77f56554a146cf8e72256edf989e90` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:44.997350 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d1e8b-7f0d-47d2-ba6d-3b26307603c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df77f56554a146cf8e72256edf989e90)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:44.999269 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d1e8b-7f0d-47d2-ba6d-3b26307603c0 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:45.054358 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ee8d1e8b-7f0d-47d2-ba6d-3b26307603c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df77f56554a146cf8e72256edf989e90'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:13:45.061371 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ee8d1e8b-7f0d-47d2-ba6d-3b26307603c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df77f56554a146cf8e72256edf989e90'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:13:45.069215 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ee8d1e8b-7f0d-47d2-ba6d-3b26307603c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df77f56554a146cf8e72256edf989e90'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:13:45.082659 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ee8d1e8b-7f0d-47d2-ba6d-3b26307603c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df77f56554a146cf8e72256edf989e90'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:13:45.083321 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ee8d1e8b-7f0d-47d2-ba6d-3b26307603c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df77f56554a146cf8e72256edf989e90'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:13:45.090073 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1405/2844] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 15:13:44 2022] DELETE /identity/v3/users/df77f56554a146cf8e72256edf989e90 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:13:45.094822 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c52982-92e1-44f2-9919-b4a47078208a None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:45.095325 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c52982-92e1-44f2-9919-b4a47078208a None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:45.095432 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c52982-92e1-44f2-9919-b4a47078208a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:45.114122 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-76c52982-92e1-44f2-9919-b4a47078208a None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:13:45.115397 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-76c52982-92e1-44f2-9919-b4a47078208a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:13:45.182059 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1440/2845] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:13:45.192467 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d1e8b-7f0d-47d2-ba6d-3b26307603c0 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:45.194161 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ee8d1e8b-7f0d-47d2-ba6d-3b26307603c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:13:45.255891 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d1e8b-7f0d-47d2-ba6d-3b26307603c0 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:45.259841 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6dea60-5b6e-425d-b92a-668601ecfad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:45.260529 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6dea60-5b6e-425d-b92a-668601ecfad6 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:45.260813 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6dea60-5b6e-425d-b92a-668601ecfad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:45.261091 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6dea60-5b6e-425d-b92a-668601ecfad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:45.271310 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6dea60-5b6e-425d-b92a-668601ecfad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:45.272845 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6dea60-5b6e-425d-b92a-668601ecfad6 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:45.282496 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1406/2846] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:13:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:13:45.602670 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c52982-92e1-44f2-9919-b4a47078208a None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:45.604421 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-76c52982-92e1-44f2-9919-b4a47078208a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:13:45.619776 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c52982-92e1-44f2-9919-b4a47078208a None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:45.626735 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482efc0-88ab-494f-a5c0-20e98035d1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:45.628031 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482efc0-88ab-494f-a5c0-20e98035d1dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:45.628158 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482efc0-88ab-494f-a5c0-20e98035d1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:45.628340 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482efc0-88ab-494f-a5c0-20e98035d1dc admin admin] PATH_INFO: `/v3/projects/03ca09cd75af42cab97050a7fb7a69e0` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:45.629741 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6482efc0-88ab-494f-a5c0-20e98035d1dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=03ca09cd75af42cab97050a7fb7a69e0)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:45.631827 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6482efc0-88ab-494f-a5c0-20e98035d1dc admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:45.685251 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6482efc0-88ab-494f-a5c0-20e98035d1dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03ca09cd75af42cab97050a7fb7a69e0', 'request_id': 'req-6482efc0-88ab-494f-a5c0-20e98035d1dc'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:13:45.692046 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6482efc0-88ab-494f-a5c0-20e98035d1dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03ca09cd75af42cab97050a7fb7a69e0', 'request_id': 'req-6482efc0-88ab-494f-a5c0-20e98035d1dc'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:13:45.701507 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6482efc0-88ab-494f-a5c0-20e98035d1dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03ca09cd75af42cab97050a7fb7a69e0', 'request_id': 'req-6482efc0-88ab-494f-a5c0-20e98035d1dc'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:13:45.719590 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6482efc0-88ab-494f-a5c0-20e98035d1dc admin admin] The token cache is being invalidate because project 03ca09cd75af42cab97050a7fb7a69e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:13:45.719892 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6482efc0-88ab-494f-a5c0-20e98035d1dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:13:45.720753 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6482efc0-88ab-494f-a5c0-20e98035d1dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:13:45.722837 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1441/2847] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:13:45 2022] DELETE /identity/v3/projects/03ca09cd75af42cab97050a7fb7a69e0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:13:45.735364 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6dea60-5b6e-425d-b92a-668601ecfad6 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:45.748185 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6dea60-5b6e-425d-b92a-668601ecfad6 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:45.813992 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a31ac-40b6-4c40-83e0-479cef3cd11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:45.814875 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a31ac-40b6-4c40-83e0-479cef3cd11d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:45.815161 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a31ac-40b6-4c40-83e0-479cef3cd11d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:45.815432 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a31ac-40b6-4c40-83e0-479cef3cd11d admin admin] PATH_INFO: `/v3/users/03e2682fce7a46268a753b3a1aa6d81e` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:45.816660 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a31ac-40b6-4c40-83e0-479cef3cd11d admin admin] RBAC: Authorizing `identity:delete_user(user_id=03e2682fce7a46268a753b3a1aa6d81e)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:45.818623 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a31ac-40b6-4c40-83e0-479cef3cd11d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:45.820201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:13:45.874923 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-561a31ac-40b6-4c40-83e0-479cef3cd11d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03e2682fce7a46268a753b3a1aa6d81e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:13:45.881966 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-561a31ac-40b6-4c40-83e0-479cef3cd11d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03e2682fce7a46268a753b3a1aa6d81e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:13:45.891003 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-561a31ac-40b6-4c40-83e0-479cef3cd11d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03e2682fce7a46268a753b3a1aa6d81e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:13:45.905188 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-561a31ac-40b6-4c40-83e0-479cef3cd11d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03e2682fce7a46268a753b3a1aa6d81e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:13:45.905841 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-561a31ac-40b6-4c40-83e0-479cef3cd11d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03e2682fce7a46268a753b3a1aa6d81e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:13:45.913544 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1407/2848] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 15:13:45 2022] DELETE /identity/v3/users/03e2682fce7a46268a753b3a1aa6d81e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:13:46.234082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482efc0-88ab-494f-a5c0-20e98035d1dc admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:46.235663 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6482efc0-88ab-494f-a5c0-20e98035d1dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:13:46.249303 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482efc0-88ab-494f-a5c0-20e98035d1dc admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:46.270978 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:13:46.314496 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88bdc2-664b-4326-a0f3-9b9ead26fc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:46.315354 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88bdc2-664b-4326-a0f3-9b9ead26fc09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:46.315631 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88bdc2-664b-4326-a0f3-9b9ead26fc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:46.315934 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88bdc2-664b-4326-a0f3-9b9ead26fc09 admin admin] PATH_INFO: `/v3/projects/7f93cbd358754264b18f57079e602a96` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:46.317147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc88bdc2-664b-4326-a0f3-9b9ead26fc09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f93cbd358754264b18f57079e602a96)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:46.319083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc88bdc2-664b-4326-a0f3-9b9ead26fc09 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:46.366505 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-dc88bdc2-664b-4326-a0f3-9b9ead26fc09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f93cbd358754264b18f57079e602a96', 'request_id': 'req-dc88bdc2-664b-4326-a0f3-9b9ead26fc09'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:13:46.372080 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-dc88bdc2-664b-4326-a0f3-9b9ead26fc09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f93cbd358754264b18f57079e602a96', 'request_id': 'req-dc88bdc2-664b-4326-a0f3-9b9ead26fc09'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:13:46.378490 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-dc88bdc2-664b-4326-a0f3-9b9ead26fc09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f93cbd358754264b18f57079e602a96', 'request_id': 'req-dc88bdc2-664b-4326-a0f3-9b9ead26fc09'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:13:46.392852 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-dc88bdc2-664b-4326-a0f3-9b9ead26fc09 admin admin] The token cache is being invalidate because project 7f93cbd358754264b18f57079e602a96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:13:46.393116 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-dc88bdc2-664b-4326-a0f3-9b9ead26fc09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:13:46.393808 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-dc88bdc2-664b-4326-a0f3-9b9ead26fc09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:13:46.395386 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1442/2849] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:13:46 2022] DELETE /identity/v3/projects/7f93cbd358754264b18f57079e602a96 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:13:46.400513 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64c3a6-b1b4-49f2-942c-a44148873990 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:46.401016 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64c3a6-b1b4-49f2-942c-a44148873990 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:46.401118 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64c3a6-b1b4-49f2-942c-a44148873990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:46.419761 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-6e64c3a6-b1b4-49f2-942c-a44148873990 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:13:46.421125 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6e64c3a6-b1b4-49f2-942c-a44148873990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:13:46.499006 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1408/2850] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:13:46.508452 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e02cf-0745-4f23-b9a7-e8c31cd2992e None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:46.508862 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e02cf-0745-4f23-b9a7-e8c31cd2992e None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:46.509268 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e02cf-0745-4f23-b9a7-e8c31cd2992e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:46.532261 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-954e02cf-0745-4f23-b9a7-e8c31cd2992e None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:13:46.533536 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-954e02cf-0745-4f23-b9a7-e8c31cd2992e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:13:46.547035 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1443/2851] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:13:46.548466 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64c3a6-b1b4-49f2-942c-a44148873990 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:46.561001 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64c3a6-b1b4-49f2-942c-a44148873990 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:46.567371 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b6991-6b73-43ee-b240-72f94e430a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:46.568168 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b6991-6b73-43ee-b240-72f94e430a76 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:46.568452 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b6991-6b73-43ee-b240-72f94e430a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:46.568728 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b6991-6b73-43ee-b240-72f94e430a76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:46.569468 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b6991-6b73-43ee-b240-72f94e430a76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:13:46.569776 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b6991-6b73-43ee-b240-72f94e430a76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:46.571446 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b6991-6b73-43ee-b240-72f94e430a76 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:46.588982 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1409/2852] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 15:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:13:46.592175 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e02cf-0745-4f23-b9a7-e8c31cd2992e None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:46.602611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e02cf-0745-4f23-b9a7-e8c31cd2992e None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:46.607578 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f0ea0-ac45-41d4-b95a-d6ff8659b93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:46.608315 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f0ea0-ac45-41d4-b95a-d6ff8659b93c admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:46.608595 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f0ea0-ac45-41d4-b95a-d6ff8659b93c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:46.608864 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f0ea0-ac45-41d4-b95a-d6ff8659b93c admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:46.609557 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f0ea0-ac45-41d4-b95a-d6ff8659b93c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:46.611883 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f0ea0-ac45-41d4-b95a-d6ff8659b93c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:46.640912 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1444/2853] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 15:13:46 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:13:46.645651 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b6991-6b73-43ee-b240-72f94e430a76 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:46.656422 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b6991-6b73-43ee-b240-72f94e430a76 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:46.720977 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce0e9d-50c6-494f-a83f-56e857e1a468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:46.721666 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce0e9d-50c6-494f-a83f-56e857e1a468 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:46.721974 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce0e9d-50c6-494f-a83f-56e857e1a468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:46.722251 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce0e9d-50c6-494f-a83f-56e857e1a468 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:46.722966 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce0e9d-50c6-494f-a83f-56e857e1a468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:46.724958 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce0e9d-50c6-494f-a83f-56e857e1a468 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:46.735155 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:13:46.749774 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1410/2854] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 15:13:46 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:13:46.753951 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f0ea0-ac45-41d4-b95a-d6ff8659b93c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:46.765120 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f0ea0-ac45-41d4-b95a-d6ff8659b93c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:46.770668 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e99c0-ebc2-47d6-a1e8-3af71647eb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:46.771360 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e99c0-ebc2-47d6-a1e8-3af71647eb8c admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:46.771654 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e99c0-ebc2-47d6-a1e8-3af71647eb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:46.771971 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e99c0-ebc2-47d6-a1e8-3af71647eb8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:46.772711 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e99c0-ebc2-47d6-a1e8-3af71647eb8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:46.774338 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e99c0-ebc2-47d6-a1e8-3af71647eb8c admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:46.787230 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1445/2855] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:13:46.791304 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce0e9d-50c6-494f-a83f-56e857e1a468 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:46.802766 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce0e9d-50c6-494f-a83f-56e857e1a468 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:46.807600 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd02d4b-d5e1-4c61-8e15-f116d5ed58c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:46.808321 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd02d4b-d5e1-4c61-8e15-f116d5ed58c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:46.808608 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd02d4b-d5e1-4c61-8e15-f116d5ed58c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:46.808884 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd02d4b-d5e1-4c61-8e15-f116d5ed58c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:46.809624 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd02d4b-d5e1-4c61-8e15-f116d5ed58c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:46.811241 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd02d4b-d5e1-4c61-8e15-f116d5ed58c8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:46.825186 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1411/2856] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:13:46.826310 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e99c0-ebc2-47d6-a1e8-3af71647eb8c admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:46.836751 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e99c0-ebc2-47d6-a1e8-3af71647eb8c admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:46.841611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8957098-c207-41a8-89ce-672b9424f15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:46.842499 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8957098-c207-41a8-89ce-672b9424f15f admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:46.842784 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8957098-c207-41a8-89ce-672b9424f15f admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:46.843061 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8957098-c207-41a8-89ce-672b9424f15f admin admin] PATH_INFO: `/v3/projects/5cbd1b70721c41cc9d829f36cbc4b6a2/users/8bdf6327695f43a4bdcaf3ea2f4fce48/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:46.859474 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8957098-c207-41a8-89ce-672b9424f15f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cbd1b70721c41cc9d829f36cbc4b6a2, user_id=8bdf6327695f43a4bdcaf3ea2f4fce48, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:46.862277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8957098-c207-41a8-89ce-672b9424f15f admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:46.877083 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1446/2857] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:13:46 2022] PUT /identity/v3/projects/5cbd1b70721c41cc9d829f36cbc4b6a2/users/8bdf6327695f43a4bdcaf3ea2f4fce48/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:13:46.887457 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e8ad2-9953-438b-a247-fec63dcf6a52 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:46.887748 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e8ad2-9953-438b-a247-fec63dcf6a52 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:46.888062 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e8ad2-9953-438b-a247-fec63dcf6a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:46.916443 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-059e8ad2-9953-438b-a247-fec63dcf6a52 None None] MFA Rules not processed for user `8bdf6327695f43a4bdcaf3ea2f4fce48`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:13:46.917661 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-059e8ad2-9953-438b-a247-fec63dcf6a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:13:46.992000 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1412/2858] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:13:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:13:47.004933 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8957098-c207-41a8-89ce-672b9424f15f admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:47.006607 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a8957098-c207-41a8-89ce-672b9424f15f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:13:47.078355 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:13:47.106534 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8957098-c207-41a8-89ce-672b9424f15f admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:47.111064 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ab4aa-f4d9-4b0f-bd4b-d61b0fe75c33 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5819a7d47f644bc18e6d07a125826d76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:47.111711 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ab4aa-f4d9-4b0f-bd4b-d61b0fe75c33 service glance] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:47.112023 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ab4aa-f4d9-4b0f-bd4b-d61b0fe75c33 service glance] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:47.112298 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ab4aa-f4d9-4b0f-bd4b-d61b0fe75c33 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:47.120705 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ab4aa-f4d9-4b0f-bd4b-d61b0fe75c33 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:47.122145 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ab4aa-f4d9-4b0f-bd4b-d61b0fe75c33 service glance] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:47.131246 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1447/2859] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:13:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:13:56.987430 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=39 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:13:57.127164 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=13 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:14:05.887933 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e8ad2-9953-438b-a247-fec63dcf6a52 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:14:05.957060 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e8ad2-9953-438b-a247-fec63dcf6a52 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:14:05.962272 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a80ad0-f6b4-4b5b-8cce-685d76361f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:14:05.963188 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a80ad0-f6b4-4b5b-8cce-685d76361f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:14:05.963467 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a80ad0-f6b4-4b5b-8cce-685d76361f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:14:05.963754 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a80ad0-f6b4-4b5b-8cce-685d76361f21 admin admin] PATH_INFO: `/v3/users/8bdf6327695f43a4bdcaf3ea2f4fce48` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:14:05.965031 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a80ad0-f6b4-4b5b-8cce-685d76361f21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bdf6327695f43a4bdcaf3ea2f4fce48)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:14:05.966962 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a80ad0-f6b4-4b5b-8cce-685d76361f21 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:14:06.022166 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e3a80ad0-f6b4-4b5b-8cce-685d76361f21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bdf6327695f43a4bdcaf3ea2f4fce48'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:14:06.030006 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e3a80ad0-f6b4-4b5b-8cce-685d76361f21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bdf6327695f43a4bdcaf3ea2f4fce48'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:14:06.039365 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e3a80ad0-f6b4-4b5b-8cce-685d76361f21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bdf6327695f43a4bdcaf3ea2f4fce48'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:14:06.052000 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e3a80ad0-f6b4-4b5b-8cce-685d76361f21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bdf6327695f43a4bdcaf3ea2f4fce48'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:14:06.052632 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e3a80ad0-f6b4-4b5b-8cce-685d76361f21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bdf6327695f43a4bdcaf3ea2f4fce48'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:14:06.059040 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1413/2860] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 15:14:05 2022] DELETE /identity/v3/users/8bdf6327695f43a4bdcaf3ea2f4fce48 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:14:06.063849 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440a1db-04af-4ae3-9a4c-83e93472c701 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:14:06.063849 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440a1db-04af-4ae3-9a4c-83e93472c701 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:14:06.063849 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440a1db-04af-4ae3-9a4c-83e93472c701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:14:06.084517 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-d440a1db-04af-4ae3-9a4c-83e93472c701 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:14:06.085742 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d440a1db-04af-4ae3-9a4c-83e93472c701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:14:06.164160 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1448/2861] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:14:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:14:06.178219 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a80ad0-f6b4-4b5b-8cce-685d76361f21 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:14:06.179797 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e3a80ad0-f6b4-4b5b-8cce-685d76361f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:14:06.247785 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a80ad0-f6b4-4b5b-8cce-685d76361f21 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:14:06.253543 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93385475-82ff-457d-9f8b-dd11e2e1da8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:14:06.254795 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93385475-82ff-457d-9f8b-dd11e2e1da8a service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:14:06.255230 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93385475-82ff-457d-9f8b-dd11e2e1da8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:14:06.255636 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93385475-82ff-457d-9f8b-dd11e2e1da8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:14:06.269240 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93385475-82ff-457d-9f8b-dd11e2e1da8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:14:06.270691 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93385475-82ff-457d-9f8b-dd11e2e1da8a service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:14:06.280937 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1414/2862] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:14:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:14:06.577066 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440a1db-04af-4ae3-9a4c-83e93472c701 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:14:06.578557 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-d440a1db-04af-4ae3-9a4c-83e93472c701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:14:06.594050 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440a1db-04af-4ae3-9a4c-83e93472c701 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:14:06.599053 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e681c-c032-4b57-bd49-e3537b284417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:14:06.600148 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e681c-c032-4b57-bd49-e3537b284417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:14:06.600429 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e681c-c032-4b57-bd49-e3537b284417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:14:06.600701 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e681c-c032-4b57-bd49-e3537b284417 admin admin] PATH_INFO: `/v3/projects/5cbd1b70721c41cc9d829f36cbc4b6a2` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:14:06.601916 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e681c-c032-4b57-bd49-e3537b284417 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cbd1b70721c41cc9d829f36cbc4b6a2)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:14:06.603907 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e681c-c032-4b57-bd49-e3537b284417 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:14:06.651393 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4a9e681c-c032-4b57-bd49-e3537b284417 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cbd1b70721c41cc9d829f36cbc4b6a2', 'request_id': 'req-4a9e681c-c032-4b57-bd49-e3537b284417'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:14:06.657163 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4a9e681c-c032-4b57-bd49-e3537b284417 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cbd1b70721c41cc9d829f36cbc4b6a2', 'request_id': 'req-4a9e681c-c032-4b57-bd49-e3537b284417'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:14:06.663318 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4a9e681c-c032-4b57-bd49-e3537b284417 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cbd1b70721c41cc9d829f36cbc4b6a2', 'request_id': 'req-4a9e681c-c032-4b57-bd49-e3537b284417'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:14:06.677767 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4a9e681c-c032-4b57-bd49-e3537b284417 admin admin] The token cache is being invalidate because project 5cbd1b70721c41cc9d829f36cbc4b6a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:14:06.678052 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4a9e681c-c032-4b57-bd49-e3537b284417 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:14:06.678690 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-4a9e681c-c032-4b57-bd49-e3537b284417 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:14:06.680275 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1449/2863] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:14:06 2022] DELETE /identity/v3/projects/5cbd1b70721c41cc9d829f36cbc4b6a2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:14:06.686020 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24dc529-ad99-443a-a66f-60c335d572f9 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:14:06.686274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24dc529-ad99-443a-a66f-60c335d572f9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:14:06.686546 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24dc529-ad99-443a-a66f-60c335d572f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:14:06.705971 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f24dc529-ad99-443a-a66f-60c335d572f9 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:14:06.707212 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f24dc529-ad99-443a-a66f-60c335d572f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:14:06.724636 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:14:06.769156 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1415/2864] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:14:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:14:06.778041 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69389fbc-69f9-40a0-a8bd-76def52f7c9d None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:14:06.778352 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69389fbc-69f9-40a0-a8bd-76def52f7c9d None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:14:06.778640 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69389fbc-69f9-40a0-a8bd-76def52f7c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:14:06.797554 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-69389fbc-69f9-40a0-a8bd-76def52f7c9d None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:14:06.798755 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-69389fbc-69f9-40a0-a8bd-76def52f7c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:14:06.807313 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1450/2865] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:14:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:14:06.811650 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24dc529-ad99-443a-a66f-60c335d572f9 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:14:06.821866 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24dc529-ad99-443a-a66f-60c335d572f9 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:14:06.827764 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33cc44-ad8e-448a-9af0-f5429d45317a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:14:06.828501 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33cc44-ad8e-448a-9af0-f5429d45317a admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:14:06.828784 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33cc44-ad8e-448a-9af0-f5429d45317a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:14:06.829063 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33cc44-ad8e-448a-9af0-f5429d45317a admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:14:06.829792 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d33cc44-ad8e-448a-9af0-f5429d45317a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:14:06.830108 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d33cc44-ad8e-448a-9af0-f5429d45317a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:14:06.831729 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d33cc44-ad8e-448a-9af0-f5429d45317a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:14:06.845612 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1416/2866] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 15:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:14:06.850617 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69389fbc-69f9-40a0-a8bd-76def52f7c9d None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:14:06.861692 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69389fbc-69f9-40a0-a8bd-76def52f7c9d None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:14:06.867482 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55794a1c-2cfc-4044-ba2f-973e429027c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:14:06.868151 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55794a1c-2cfc-4044-ba2f-973e429027c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:14:06.868445 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55794a1c-2cfc-4044-ba2f-973e429027c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:14:06.868722 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55794a1c-2cfc-4044-ba2f-973e429027c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:14:06.869418 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55794a1c-2cfc-4044-ba2f-973e429027c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:14:06.871355 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55794a1c-2cfc-4044-ba2f-973e429027c5 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:14:06.898434 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1451/2867] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 15:14:06 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:14:06.902721 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33cc44-ad8e-448a-9af0-f5429d45317a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:14:06.913385 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33cc44-ad8e-448a-9af0-f5429d45317a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:14:06.976948 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d6a82-627f-4600-a386-8ed04ec9f3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:14:06.977523 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d6a82-627f-4600-a386-8ed04ec9f3a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:14:06.977815 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d6a82-627f-4600-a386-8ed04ec9f3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:14:06.978090 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d6a82-627f-4600-a386-8ed04ec9f3a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:14:06.978772 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d6a82-627f-4600-a386-8ed04ec9f3a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:14:06.980791 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d6a82-627f-4600-a386-8ed04ec9f3a1 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:14:07.002690 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1417/2868] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 15:14:06 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:14:07.007633 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55794a1c-2cfc-4044-ba2f-973e429027c5 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:14:07.020850 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55794a1c-2cfc-4044-ba2f-973e429027c5 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:14:07.026927 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd36e4-0cb1-406b-bd48-bc129d255341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:14:07.028001 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd36e4-0cb1-406b-bd48-bc129d255341 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:14:07.028284 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd36e4-0cb1-406b-bd48-bc129d255341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:14:07.028555 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd36e4-0cb1-406b-bd48-bc129d255341 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:14:07.029280 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd36e4-0cb1-406b-bd48-bc129d255341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:14:07.030869 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd36e4-0cb1-406b-bd48-bc129d255341 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:14:07.042042 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1452/2869] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:14:07.046558 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d6a82-627f-4600-a386-8ed04ec9f3a1 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:14:07.057197 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d6a82-627f-4600-a386-8ed04ec9f3a1 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:14:07.062088 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f261a62-ccde-4ddc-be8d-78b19f45ef6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:14:07.062748 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f261a62-ccde-4ddc-be8d-78b19f45ef6a admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:14:07.063031 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f261a62-ccde-4ddc-be8d-78b19f45ef6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:14:07.063310 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f261a62-ccde-4ddc-be8d-78b19f45ef6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:14:07.064070 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f261a62-ccde-4ddc-be8d-78b19f45ef6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:14:07.065686 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f261a62-ccde-4ddc-be8d-78b19f45ef6a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:14:07.076783 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1418/2870] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:14:07.081080 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd36e4-0cb1-406b-bd48-bc129d255341 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:14:07.091636 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd36e4-0cb1-406b-bd48-bc129d255341 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:14:07.096463 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc55ad0-6677-4515-bdab-19a904bfadc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:14:07.097334 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc55ad0-6677-4515-bdab-19a904bfadc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:14:07.097611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc55ad0-6677-4515-bdab-19a904bfadc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:14:07.097878 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc55ad0-6677-4515-bdab-19a904bfadc4 admin admin] PATH_INFO: `/v3/projects/d5d314f55e2e4d55b6b74f94ed188b43/users/675267542fd842b39476f8bad82017dc/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:14:07.112910 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc55ad0-6677-4515-bdab-19a904bfadc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d314f55e2e4d55b6b74f94ed188b43, user_id=675267542fd842b39476f8bad82017dc, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:14:07.115551 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc55ad0-6677-4515-bdab-19a904bfadc4 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:14:07.130123 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1453/2871] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:14:07 2022] PUT /identity/v3/projects/d5d314f55e2e4d55b6b74f94ed188b43/users/675267542fd842b39476f8bad82017dc/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:14:07.135520 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac422dd5-46f0-44e5-8009-670ce0c9a3b1 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:14:07.135812 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac422dd5-46f0-44e5-8009-670ce0c9a3b1 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:14:07.136128 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac422dd5-46f0-44e5-8009-670ce0c9a3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:14:07.158085 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ac422dd5-46f0-44e5-8009-670ce0c9a3b1 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:14:07.159312 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ac422dd5-46f0-44e5-8009-670ce0c9a3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:14:07.225170 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1419/2872] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:14:07.235003 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc55ad0-6677-4515-bdab-19a904bfadc4 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:14:07.236814 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-0fc55ad0-6677-4515-bdab-19a904bfadc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:14:07.259566 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:14:07.298706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc55ad0-6677-4515-bdab-19a904bfadc4 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:14:07.302730 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b6870-cfa8-4284-9c5a-096ae1f2bd33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:14:07.303369 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b6870-cfa8-4284-9c5a-096ae1f2bd33 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:14:07.303647 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b6870-cfa8-4284-9c5a-096ae1f2bd33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:14:07.303912 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b6870-cfa8-4284-9c5a-096ae1f2bd33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:14:07.313880 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b6870-cfa8-4284-9c5a-096ae1f2bd33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:14:07.315319 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b6870-cfa8-4284-9c5a-096ae1f2bd33 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:14:07.325217 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1454/2873] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:14:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:14:07.983286 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335564d3-1e49-4a7d-bd63-3bc3a3866386 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:14:07.983833 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335564d3-1e49-4a7d-bd63-3bc3a3866386 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:14:07.983833 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335564d3-1e49-4a7d-bd63-3bc3a3866386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:14:08.011995 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-335564d3-1e49-4a7d-bd63-3bc3a3866386 None None] MFA Rules not processed for user `675267542fd842b39476f8bad82017dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:14:08.013224 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-335564d3-1e49-4a7d-bd63-3bc3a3866386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:14:08.031565 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:14:08.082274 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1420/2874] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:14:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:14:08.093874 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b6870-cfa8-4284-9c5a-096ae1f2bd33 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:14:08.095341 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-a73b6870-cfa8-4284-9c5a-096ae1f2bd33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:14:08.161199 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b6870-cfa8-4284-9c5a-096ae1f2bd33 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:14:08.164960 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661a05a-890a-40ae-bf27-3a11ca0a8d24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:14:08.165612 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661a05a-890a-40ae-bf27-3a11ca0a8d24 service cinder] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:14:08.165913 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661a05a-890a-40ae-bf27-3a11ca0a8d24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:14:08.166199 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661a05a-890a-40ae-bf27-3a11ca0a8d24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:14:08.174888 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c661a05a-890a-40ae-bf27-3a11ca0a8d24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:14:08.176393 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c661a05a-890a-40ae-bf27-3a11ca0a8d24 service cinder] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:14:08.185607 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1455/2875] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:14:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:14:09.572706 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe552e-b84f-4a4b-bbbc-84ef7e545caa None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:14:09.573147 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe552e-b84f-4a4b-bbbc-84ef7e545caa None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:14:09.573256 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe552e-b84f-4a4b-bbbc-84ef7e545caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:14:09.591531 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5afe552e-b84f-4a4b-bbbc-84ef7e545caa None None] MFA Rules not processed for user `675267542fd842b39476f8bad82017dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:14:09.592775 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5afe552e-b84f-4a4b-bbbc-84ef7e545caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:14:09.599983 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1421/2876] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:14:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:14:09.850261 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661a05a-890a-40ae-bf27-3a11ca0a8d24 service cinder] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:14:09.861435 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661a05a-890a-40ae-bf27-3a11ca0a8d24 service cinder] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:14:09.866001 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22007b46-eb5b-47cf-8d27-c0478aaeba96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:14:09.866637 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22007b46-eb5b-47cf-8d27-c0478aaeba96 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:14:09.866918 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22007b46-eb5b-47cf-8d27-c0478aaeba96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:14:09.867194 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22007b46-eb5b-47cf-8d27-c0478aaeba96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:14:09.869147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-22007b46-eb5b-47cf-8d27-c0478aaeba96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:14:09.880232 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22007b46-eb5b-47cf-8d27-c0478aaeba96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:14:09.881678 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22007b46-eb5b-47cf-8d27-c0478aaeba96 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:14:09.890439 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1456/2877] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:14:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:14:19.585914 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=22 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:14:19.886330 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=49 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:14:26.425579 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce00d0b-9fc6-403f-84f5-546ac991684f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:14:26.426073 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce00d0b-9fc6-403f-84f5-546ac991684f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:14:26.426184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce00d0b-9fc6-403f-84f5-546ac991684f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:14:26.445096 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-8ce00d0b-9fc6-403f-84f5-546ac991684f None None] MFA Rules not processed for user `675267542fd842b39476f8bad82017dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:14:26.446401 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8ce00d0b-9fc6-403f-84f5-546ac991684f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:14:26.453971 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1422/2878] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:14:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:14:36.439389 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:14:44.837372 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f9ca0-f8fc-4215-b2ef-abef6d9f4ad4 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:14:44.837855 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f9ca0-f8fc-4215-b2ef-abef6d9f4ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:14:44.838181 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f9ca0-f8fc-4215-b2ef-abef6d9f4ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:14:44.902258 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-636f9ca0-f8fc-4215-b2ef-abef6d9f4ad4 None None] MFA Rules not processed for user `db4d36e6837d4b2fa4b7ee5c7243b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:14:44.903558 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-636f9ca0-f8fc-4215-b2ef-abef6d9f4ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:14:44.973774 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1457/2879] 10.222.0.85 () {58 vars in 1009 bytes} [Thu Jun 16 15:14:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:14:45.023193 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce00d0b-9fc6-403f-84f5-546ac991684f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:14:45.024910 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8ce00d0b-9fc6-403f-84f5-546ac991684f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:14:45.126118 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce00d0b-9fc6-403f-84f5-546ac991684f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:14:45.131481 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dfbe1d-871b-4c45-b5d5-70870a900beb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf9c39de29324b0ca6329c9a171367c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:14:45.132193 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dfbe1d-871b-4c45-b5d5-70870a900beb service swift] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:14:45.132480 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dfbe1d-871b-4c45-b5d5-70870a900beb service swift] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:14:45.132760 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dfbe1d-871b-4c45-b5d5-70870a900beb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:14:45.142029 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dfbe1d-871b-4c45-b5d5-70870a900beb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:14:45.143644 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dfbe1d-871b-4c45-b5d5-70870a900beb service swift] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:14:45.152346 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1423/2880] 10.222.0.85 () {60 vars in 1384 bytes} [Thu Jun 16 15:14:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 15:14:54.970503 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=44 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:14:55.148853 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=41 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:14:59.460613 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77756eaa-7b16-4220-a3d1-375333e0ae18 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:14:59.461652 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77756eaa-7b16-4220-a3d1-375333e0ae18 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:14:59.461652 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77756eaa-7b16-4220-a3d1-375333e0ae18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:14:59.481316 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-77756eaa-7b16-4220-a3d1-375333e0ae18 None None] MFA Rules not processed for user `db4d36e6837d4b2fa4b7ee5c7243b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:14:59.482518 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-77756eaa-7b16-4220-a3d1-375333e0ae18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:14:59.492014 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1458/2881] 10.222.0.85 () {58 vars in 967 bytes} [Thu Jun 16 15:14:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:14:59.505977 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dfbe1d-871b-4c45-b5d5-70870a900beb service swift] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:14:59.517821 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dfbe1d-871b-4c45-b5d5-70870a900beb service swift] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:14:59.523167 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3284b2-06df-4dc7-b882-d0ae167e49a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf9c39de29324b0ca6329c9a171367c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:14:59.523810 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3284b2-06df-4dc7-b882-d0ae167e49a6 service swift] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:14:59.524121 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3284b2-06df-4dc7-b882-d0ae167e49a6 service swift] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:14:59.524399 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3284b2-06df-4dc7-b882-d0ae167e49a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:14:59.533946 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3284b2-06df-4dc7-b882-d0ae167e49a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:14:59.535549 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3284b2-06df-4dc7-b882-d0ae167e49a6 service swift] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:14:59.543975 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1424/2882] 10.222.0.85 () {60 vars in 1384 bytes} [Thu Jun 16 15:14:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 15:15:01.513759 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77756eaa-7b16-4220-a3d1-375333e0ae18 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:01.530741 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77756eaa-7b16-4220-a3d1-375333e0ae18 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:01.536906 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6a59b-b3b0-43bb-aebe-67e2c7ffef58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:01.537779 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6a59b-b3b0-43bb-aebe-67e2c7ffef58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:01.538056 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6a59b-b3b0-43bb-aebe-67e2c7ffef58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:01.538339 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6a59b-b3b0-43bb-aebe-67e2c7ffef58 admin admin] PATH_INFO: `/v3/users/675267542fd842b39476f8bad82017dc` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:01.539575 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6a59b-b3b0-43bb-aebe-67e2c7ffef58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=675267542fd842b39476f8bad82017dc)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:01.541585 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6a59b-b3b0-43bb-aebe-67e2c7ffef58 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:01.591673 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-82b6a59b-b3b0-43bb-aebe-67e2c7ffef58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '675267542fd842b39476f8bad82017dc'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:01.606522 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-82b6a59b-b3b0-43bb-aebe-67e2c7ffef58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '675267542fd842b39476f8bad82017dc'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:01.607346 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-82b6a59b-b3b0-43bb-aebe-67e2c7ffef58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '675267542fd842b39476f8bad82017dc'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:01.616625 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-82b6a59b-b3b0-43bb-aebe-67e2c7ffef58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '675267542fd842b39476f8bad82017dc'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:01.624161 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-82b6a59b-b3b0-43bb-aebe-67e2c7ffef58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '675267542fd842b39476f8bad82017dc'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:01.630837 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1459/2883] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 15:15:01 2022] DELETE /identity/v3/users/675267542fd842b39476f8bad82017dc => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:15:01.819441 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3284b2-06df-4dc7-b882-d0ae167e49a6 service swift] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:01.831563 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3284b2-06df-4dc7-b882-d0ae167e49a6 service swift] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:01.898768 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f03d0-dd47-4db7-9ed6-da64e0cdbabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:01.899735 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f03d0-dd47-4db7-9ed6-da64e0cdbabf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:01.900207 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f03d0-dd47-4db7-9ed6-da64e0cdbabf admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:01.900485 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f03d0-dd47-4db7-9ed6-da64e0cdbabf admin admin] PATH_INFO: `/v3/projects/d5d314f55e2e4d55b6b74f94ed188b43` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:01.901756 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f03d0-dd47-4db7-9ed6-da64e0cdbabf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5d314f55e2e4d55b6b74f94ed188b43)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:01.903716 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f03d0-dd47-4db7-9ed6-da64e0cdbabf admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:01.951053 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-bc3f03d0-dd47-4db7-9ed6-da64e0cdbabf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5d314f55e2e4d55b6b74f94ed188b43', 'request_id': 'req-bc3f03d0-dd47-4db7-9ed6-da64e0cdbabf'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:01.957528 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-bc3f03d0-dd47-4db7-9ed6-da64e0cdbabf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5d314f55e2e4d55b6b74f94ed188b43', 'request_id': 'req-bc3f03d0-dd47-4db7-9ed6-da64e0cdbabf'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:01.963110 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-bc3f03d0-dd47-4db7-9ed6-da64e0cdbabf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5d314f55e2e4d55b6b74f94ed188b43', 'request_id': 'req-bc3f03d0-dd47-4db7-9ed6-da64e0cdbabf'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:01.976511 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-bc3f03d0-dd47-4db7-9ed6-da64e0cdbabf admin admin] The token cache is being invalidate because project d5d314f55e2e4d55b6b74f94ed188b43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:15:01.976846 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-bc3f03d0-dd47-4db7-9ed6-da64e0cdbabf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:01.977520 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-bc3f03d0-dd47-4db7-9ed6-da64e0cdbabf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:01.979141 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1425/2884] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:15:01 2022] DELETE /identity/v3/projects/d5d314f55e2e4d55b6b74f94ed188b43 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:15:01.985939 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fab8f-6515-4142-bb52-376d0f319045 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:01.986278 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fab8f-6515-4142-bb52-376d0f319045 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:01.986563 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fab8f-6515-4142-bb52-376d0f319045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:02.005370 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-b12fab8f-6515-4142-bb52-376d0f319045 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:15:02.006568 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-b12fab8f-6515-4142-bb52-376d0f319045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:02.067165 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1460/2885] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:15:02.074958 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b2d29-dcdd-4fb7-b82e-1a10e11e2add None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:02.075252 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b2d29-dcdd-4fb7-b82e-1a10e11e2add None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:02.075535 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b2d29-dcdd-4fb7-b82e-1a10e11e2add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:02.095039 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-428b2d29-dcdd-4fb7-b82e-1a10e11e2add None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:15:02.096373 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-428b2d29-dcdd-4fb7-b82e-1a10e11e2add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:02.106167 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1426/2886] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:15:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:15:02.114571 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fab8f-6515-4142-bb52-376d0f319045 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:02.130358 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fab8f-6515-4142-bb52-376d0f319045 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:02.136384 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6f75f-fb73-4352-a2b9-0208ca86ce67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:02.137078 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6f75f-fb73-4352-a2b9-0208ca86ce67 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:02.137359 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6f75f-fb73-4352-a2b9-0208ca86ce67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:02.137637 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6f75f-fb73-4352-a2b9-0208ca86ce67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:02.138385 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6f75f-fb73-4352-a2b9-0208ca86ce67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:15:02.138706 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6f75f-fb73-4352-a2b9-0208ca86ce67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:02.140798 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6f75f-fb73-4352-a2b9-0208ca86ce67 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:02.153565 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1461/2887] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 15:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:15:02.158482 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b2d29-dcdd-4fb7-b82e-1a10e11e2add None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:02.168961 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b2d29-dcdd-4fb7-b82e-1a10e11e2add None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:02.175385 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdaead1-0373-49b4-af22-5aef767be8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:02.176332 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdaead1-0373-49b4-af22-5aef767be8fa admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:02.176753 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdaead1-0373-49b4-af22-5aef767be8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:02.177032 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdaead1-0373-49b4-af22-5aef767be8fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:02.177730 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdaead1-0373-49b4-af22-5aef767be8fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:02.179663 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdaead1-0373-49b4-af22-5aef767be8fa admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:02.206498 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1427/2888] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 15:15:02 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:15:02.211103 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6f75f-fb73-4352-a2b9-0208ca86ce67 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:02.222355 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6f75f-fb73-4352-a2b9-0208ca86ce67 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:02.271905 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:15:02.285065 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364be45-daaf-4ae3-8359-44fe0215e9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:02.285813 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364be45-daaf-4ae3-8359-44fe0215e9c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:02.286135 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364be45-daaf-4ae3-8359-44fe0215e9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:02.286485 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364be45-daaf-4ae3-8359-44fe0215e9c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:02.287240 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364be45-daaf-4ae3-8359-44fe0215e9c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:02.289505 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364be45-daaf-4ae3-8359-44fe0215e9c7 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:02.311775 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1462/2889] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 15:15:02 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:15:02.316595 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdaead1-0373-49b4-af22-5aef767be8fa admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:02.327680 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdaead1-0373-49b4-af22-5aef767be8fa admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:02.333065 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fac166-0e1c-4b9d-8f30-c447a1151dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:02.333803 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fac166-0e1c-4b9d-8f30-c447a1151dcc admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:02.334149 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fac166-0e1c-4b9d-8f30-c447a1151dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:02.334474 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fac166-0e1c-4b9d-8f30-c447a1151dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:02.335251 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fac166-0e1c-4b9d-8f30-c447a1151dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:02.337040 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fac166-0e1c-4b9d-8f30-c447a1151dcc admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:02.348539 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1428/2890] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:15:02.353057 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364be45-daaf-4ae3-8359-44fe0215e9c7 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:02.363746 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364be45-daaf-4ae3-8359-44fe0215e9c7 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:02.369657 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c132a3-cd11-46c4-ae55-66a885f9e48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:02.370611 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c132a3-cd11-46c4-ae55-66a885f9e48d admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:02.370983 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c132a3-cd11-46c4-ae55-66a885f9e48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:02.371358 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c132a3-cd11-46c4-ae55-66a885f9e48d admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:02.372261 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c132a3-cd11-46c4-ae55-66a885f9e48d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:02.374032 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c132a3-cd11-46c4-ae55-66a885f9e48d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:02.386010 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1463/2891] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:15:02.390844 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fac166-0e1c-4b9d-8f30-c447a1151dcc admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:02.401469 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fac166-0e1c-4b9d-8f30-c447a1151dcc admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:02.407139 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb8292-b7d0-489f-95b0-e5bef373ad25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:02.408106 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb8292-b7d0-489f-95b0-e5bef373ad25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:02.408389 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb8292-b7d0-489f-95b0-e5bef373ad25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:02.408649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb8292-b7d0-489f-95b0-e5bef373ad25 admin admin] PATH_INFO: `/v3/projects/91bdba2d40e3428fa0f2a3e5cfd98a26/users/9c6ff5030ae74fc0a87de9e5c7ad798c/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:02.424355 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb8292-b7d0-489f-95b0-e5bef373ad25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91bdba2d40e3428fa0f2a3e5cfd98a26, user_id=9c6ff5030ae74fc0a87de9e5c7ad798c, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:02.426998 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb8292-b7d0-489f-95b0-e5bef373ad25 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:02.441438 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1429/2892] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:15:02 2022] PUT /identity/v3/projects/91bdba2d40e3428fa0f2a3e5cfd98a26/users/9c6ff5030ae74fc0a87de9e5c7ad798c/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:15:02.452271 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b514e-881c-49ea-adef-b59ce04bc679 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:02.452565 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b514e-881c-49ea-adef-b59ce04bc679 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:02.453112 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b514e-881c-49ea-adef-b59ce04bc679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:02.483957 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-580b514e-881c-49ea-adef-b59ce04bc679 None None] MFA Rules not processed for user `9c6ff5030ae74fc0a87de9e5c7ad798c`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:15:02.485501 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-580b514e-881c-49ea-adef-b59ce04bc679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:02.554659 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1464/2893] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:15:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:15:02.566583 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb8292-b7d0-489f-95b0-e5bef373ad25 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:02.568480 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f3eb8292-b7d0-489f-95b0-e5bef373ad25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:02.583231 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:15:02.630710 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb8292-b7d0-489f-95b0-e5bef373ad25 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:02.635149 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9480e1-8025-4c48-be77-87c432ba996c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d0ac98d9520470483c348644566d9ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:02.635805 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9480e1-8025-4c48-be77-87c432ba996c service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:02.636113 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9480e1-8025-4c48-be77-87c432ba996c service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:02.636382 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9480e1-8025-4c48-be77-87c432ba996c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:02.646162 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9480e1-8025-4c48-be77-87c432ba996c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:02.647649 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9480e1-8025-4c48-be77-87c432ba996c service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:02.657029 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1430/2894] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:15:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:15:12.551404 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=42,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:15:12.652600 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=20 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:15:12.791079 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b514e-881c-49ea-adef-b59ce04bc679 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:12.858011 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b514e-881c-49ea-adef-b59ce04bc679 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:12.862778 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e86e0-2c2a-4bef-925c-f3318fa33892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:12.863707 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e86e0-2c2a-4bef-925c-f3318fa33892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:12.864010 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e86e0-2c2a-4bef-925c-f3318fa33892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:12.864289 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e86e0-2c2a-4bef-925c-f3318fa33892 admin admin] PATH_INFO: `/v3/users/9c6ff5030ae74fc0a87de9e5c7ad798c` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:12.865562 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e86e0-2c2a-4bef-925c-f3318fa33892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c6ff5030ae74fc0a87de9e5c7ad798c)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:12.867540 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e86e0-2c2a-4bef-925c-f3318fa33892 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:12.918014 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6e1e86e0-2c2a-4bef-925c-f3318fa33892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c6ff5030ae74fc0a87de9e5c7ad798c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:12.930522 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6e1e86e0-2c2a-4bef-925c-f3318fa33892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c6ff5030ae74fc0a87de9e5c7ad798c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:12.931235 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6e1e86e0-2c2a-4bef-925c-f3318fa33892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c6ff5030ae74fc0a87de9e5c7ad798c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:12.939562 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6e1e86e0-2c2a-4bef-925c-f3318fa33892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c6ff5030ae74fc0a87de9e5c7ad798c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:12.952844 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-6e1e86e0-2c2a-4bef-925c-f3318fa33892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c6ff5030ae74fc0a87de9e5c7ad798c'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:12.961189 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1465/2895] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 15:15:12 2022] DELETE /identity/v3/users/9c6ff5030ae74fc0a87de9e5c7ad798c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:15:12.967634 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2400f-ce44-4246-b7ff-ec72b3537eb9 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:12.968076 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2400f-ce44-4246-b7ff-ec72b3537eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:12.969114 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2400f-ce44-4246-b7ff-ec72b3537eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:12.988562 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-abc2400f-ce44-4246-b7ff-ec72b3537eb9 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:15:12.989864 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-abc2400f-ce44-4246-b7ff-ec72b3537eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:13.053068 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1431/2896] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:15:13.063554 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e86e0-2c2a-4bef-925c-f3318fa33892 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:13.065102 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6e1e86e0-2c2a-4bef-925c-f3318fa33892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:13.125147 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e86e0-2c2a-4bef-925c-f3318fa33892 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:13.129781 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bdca8a-aaf0-4f2a-b2b3-5feb2ed83104 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:13.130511 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdca8a-aaf0-4f2a-b2b3-5feb2ed83104 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:13.130830 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdca8a-aaf0-4f2a-b2b3-5feb2ed83104 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:13.131184 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdca8a-aaf0-4f2a-b2b3-5feb2ed83104 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:13.141760 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bdca8a-aaf0-4f2a-b2b3-5feb2ed83104 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:13.143248 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bdca8a-aaf0-4f2a-b2b3-5feb2ed83104 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:13.154180 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1466/2897] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:15:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:15:13.457937 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2400f-ce44-4246-b7ff-ec72b3537eb9 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:13.459788 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-abc2400f-ce44-4246-b7ff-ec72b3537eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:13.478434 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2400f-ce44-4246-b7ff-ec72b3537eb9 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:13.486639 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c76c3b-e18f-4e44-9171-540e144dca42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:13.488278 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c76c3b-e18f-4e44-9171-540e144dca42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:13.488737 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c76c3b-e18f-4e44-9171-540e144dca42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:13.488971 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c76c3b-e18f-4e44-9171-540e144dca42 admin admin] PATH_INFO: `/v3/projects/91bdba2d40e3428fa0f2a3e5cfd98a26` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:13.490707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c76c3b-e18f-4e44-9171-540e144dca42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91bdba2d40e3428fa0f2a3e5cfd98a26)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:13.493473 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c76c3b-e18f-4e44-9171-540e144dca42 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:13.548494 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-96c76c3b-e18f-4e44-9171-540e144dca42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91bdba2d40e3428fa0f2a3e5cfd98a26', 'request_id': 'req-96c76c3b-e18f-4e44-9171-540e144dca42'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:13.555044 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-96c76c3b-e18f-4e44-9171-540e144dca42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91bdba2d40e3428fa0f2a3e5cfd98a26', 'request_id': 'req-96c76c3b-e18f-4e44-9171-540e144dca42'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:13.561060 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-96c76c3b-e18f-4e44-9171-540e144dca42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91bdba2d40e3428fa0f2a3e5cfd98a26', 'request_id': 'req-96c76c3b-e18f-4e44-9171-540e144dca42'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:13.576142 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-96c76c3b-e18f-4e44-9171-540e144dca42 admin admin] The token cache is being invalidate because project 91bdba2d40e3428fa0f2a3e5cfd98a26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:15:13.576436 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-96c76c3b-e18f-4e44-9171-540e144dca42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:13.577144 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-96c76c3b-e18f-4e44-9171-540e144dca42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:13.579024 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1432/2898] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:15:13 2022] DELETE /identity/v3/projects/91bdba2d40e3428fa0f2a3e5cfd98a26 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:15:13.584556 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3634cf-c91b-49e1-b0cc-95db12156000 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:13.585111 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3634cf-c91b-49e1-b0cc-95db12156000 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:13.585241 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3634cf-c91b-49e1-b0cc-95db12156000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:13.606747 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-6b3634cf-c91b-49e1-b0cc-95db12156000 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:15:13.608121 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-6b3634cf-c91b-49e1-b0cc-95db12156000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:13.628606 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:15:13.677874 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1467/2899] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:15:13.686234 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41b580-bdb0-46b2-a9da-9545e306ec15 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:13.686771 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41b580-bdb0-46b2-a9da-9545e306ec15 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:13.686771 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41b580-bdb0-46b2-a9da-9545e306ec15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:13.706293 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-eb41b580-bdb0-46b2-a9da-9545e306ec15 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:15:13.707543 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-eb41b580-bdb0-46b2-a9da-9545e306ec15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:13.716261 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1433/2900] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:15:13.721769 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3634cf-c91b-49e1-b0cc-95db12156000 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:13.732479 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3634cf-c91b-49e1-b0cc-95db12156000 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:13.738286 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151a4db-b277-4f3c-91ae-ba342876c60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:13.738960 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151a4db-b277-4f3c-91ae-ba342876c60d admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:13.739240 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151a4db-b277-4f3c-91ae-ba342876c60d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:13.739516 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151a4db-b277-4f3c-91ae-ba342876c60d admin admin] PATH_INFO: `/v3/domains` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:13.740304 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6151a4db-b277-4f3c-91ae-ba342876c60d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:15:13.740618 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6151a4db-b277-4f3c-91ae-ba342876c60d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:13.742324 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6151a4db-b277-4f3c-91ae-ba342876c60d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:13.756171 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1468/2901] 10.222.0.85 () {58 vars in 1152 bytes} [Thu Jun 16 15:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:15:13.761072 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb41b580-bdb0-46b2-a9da-9545e306ec15 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:13.771593 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb41b580-bdb0-46b2-a9da-9545e306ec15 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:13.777338 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b8ebe-b8d3-4a2c-8b39-be2517f1e4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:13.778010 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b8ebe-b8d3-4a2c-8b39-be2517f1e4ac admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:13.778293 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b8ebe-b8d3-4a2c-8b39-be2517f1e4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:13.778570 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b8ebe-b8d3-4a2c-8b39-be2517f1e4ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:13.779282 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b8ebe-b8d3-4a2c-8b39-be2517f1e4ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:13.781343 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b8ebe-b8d3-4a2c-8b39-be2517f1e4ac admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:13.809401 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1434/2902] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 15:15:13 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:15:13.814495 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151a4db-b277-4f3c-91ae-ba342876c60d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:13.824993 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151a4db-b277-4f3c-91ae-ba342876c60d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:13.885399 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58d3a4-1207-42ed-9850-b23ae6bca108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:13.886082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58d3a4-1207-42ed-9850-b23ae6bca108 admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:13.886366 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58d3a4-1207-42ed-9850-b23ae6bca108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:13.886649 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58d3a4-1207-42ed-9850-b23ae6bca108 admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:13.887364 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58d3a4-1207-42ed-9850-b23ae6bca108 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:13.889411 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58d3a4-1207-42ed-9850-b23ae6bca108 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:13.911816 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1469/2903] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 15:15:13 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:15:13.916218 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b8ebe-b8d3-4a2c-8b39-be2517f1e4ac admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:13.927423 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b8ebe-b8d3-4a2c-8b39-be2517f1e4ac admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:13.932521 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5efb9f-005f-4c02-933f-19c77f91324c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:13.933127 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5efb9f-005f-4c02-933f-19c77f91324c admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:13.933405 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5efb9f-005f-4c02-933f-19c77f91324c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:13.933707 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5efb9f-005f-4c02-933f-19c77f91324c admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:13.934517 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5efb9f-005f-4c02-933f-19c77f91324c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:13.936249 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5efb9f-005f-4c02-933f-19c77f91324c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:13.948651 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1435/2904] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:15:13.953160 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58d3a4-1207-42ed-9850-b23ae6bca108 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:13.964497 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58d3a4-1207-42ed-9850-b23ae6bca108 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:13.970089 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332360c-b17c-4f2b-a05b-6f1c4a4ad976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:13.970823 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332360c-b17c-4f2b-a05b-6f1c4a4ad976 admin admin] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:13.971103 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332360c-b17c-4f2b-a05b-6f1c4a4ad976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:13.971378 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332360c-b17c-4f2b-a05b-6f1c4a4ad976 admin admin] PATH_INFO: `/v3/roles` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:13.972192 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332360c-b17c-4f2b-a05b-6f1c4a4ad976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:13.973841 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332360c-b17c-4f2b-a05b-6f1c4a4ad976 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:13.987114 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1470/2905] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:15:13.993255 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5efb9f-005f-4c02-933f-19c77f91324c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:14.006180 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5efb9f-005f-4c02-933f-19c77f91324c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:14.012500 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa9d05-0451-40a5-b463-ffaecc749160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:14.013395 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa9d05-0451-40a5-b463-ffaecc749160 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:14.013675 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa9d05-0451-40a5-b463-ffaecc749160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:14.013946 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa9d05-0451-40a5-b463-ffaecc749160 admin admin] PATH_INFO: `/v3/projects/89d7ddb238db457aa484f744387e1c1e/users/c0e6df42f67641389fcc2c7071e29156/roles/26e7e900cf574eaabe4fcf886acb0c46` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:14.037510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa9d05-0451-40a5-b463-ffaecc749160 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d7ddb238db457aa484f744387e1c1e, user_id=c0e6df42f67641389fcc2c7071e29156, role_id=26e7e900cf574eaabe4fcf886acb0c46)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:14.041211 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa9d05-0451-40a5-b463-ffaecc749160 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:14.056545 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1436/2906] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:15:13 2022] PUT /identity/v3/projects/89d7ddb238db457aa484f744387e1c1e/users/c0e6df42f67641389fcc2c7071e29156/roles/26e7e900cf574eaabe4fcf886acb0c46 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:15:14.062446 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d7556-158f-4718-a602-c3cebd2fddb3 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:14.062702 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d7556-158f-4718-a602-c3cebd2fddb3 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:14.063056 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d7556-158f-4718-a602-c3cebd2fddb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:14.083884 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-5c4d7556-158f-4718-a602-c3cebd2fddb3 None None] MFA Rules not processed for user `d15ddf8d03bc44188d865237c74fbf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:15:14.085107 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-5c4d7556-158f-4718-a602-c3cebd2fddb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:14.146805 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1471/2907] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:15:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:15:14.158391 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa9d05-0451-40a5-b463-ffaecc749160 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:14.160312 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-cfaa9d05-0451-40a5-b463-ffaecc749160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:14.183621 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:15:14.225459 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa9d05-0451-40a5-b463-ffaecc749160 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:14.230040 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a73c9d-3776-48f8-ae3a-0b0f2c173e59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:14.230730 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a73c9d-3776-48f8-ae3a-0b0f2c173e59 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:14.231007 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a73c9d-3776-48f8-ae3a-0b0f2c173e59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:14.231278 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a73c9d-3776-48f8-ae3a-0b0f2c173e59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:14.242145 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a73c9d-3776-48f8-ae3a-0b0f2c173e59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:14.243613 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a73c9d-3776-48f8-ae3a-0b0f2c173e59 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:14.254655 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1437/2908] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:15:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:15:18.863319 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5e7ea-0009-4de2-94a1-e5a366dbc9d7 None None] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:18.863996 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5e7ea-0009-4de2-94a1-e5a366dbc9d7 None None] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:18.864212 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5e7ea-0009-4de2-94a1-e5a366dbc9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:18.898312 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.auth.core [None req-4af5e7ea-0009-4de2-94a1-e5a366dbc9d7 None None] MFA Rules not processed for user `c0e6df42f67641389fcc2c7071e29156`. Rule list: `[]` (Enabled: `True`). {{(pid=80176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:15:18.899973 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-4af5e7ea-0009-4de2-94a1-e5a366dbc9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:18.929104 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:15:18.996067 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1472/2909] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:15:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:15:19.001306 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a73c9d-3776-48f8-ae3a-0b0f2c173e59 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:19.013202 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a73c9d-3776-48f8-ae3a-0b0f2c173e59 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:19.020190 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7857ee-507f-45b7-84ae-351878197c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:19.021428 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7857ee-507f-45b7-84ae-351878197c7a admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:19.021907 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7857ee-507f-45b7-84ae-351878197c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:19.022369 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7857ee-507f-45b7-84ae-351878197c7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:19.023576 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7857ee-507f-45b7-84ae-351878197c7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:19.025593 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7857ee-507f-45b7-84ae-351878197c7a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:19.055539 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1438/2910] 10.222.0.85 () {60 vars in 1152 bytes} [Thu Jun 16 15:15:18 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:15:19.059966 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af5e7ea-0009-4de2-94a1-e5a366dbc9d7 None None] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:19.071764 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af5e7ea-0009-4de2-94a1-e5a366dbc9d7 None None] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:19.132004 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff481b-51ef-4d0a-935c-9d3e7909f67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:19.132759 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff481b-51ef-4d0a-935c-9d3e7909f67e admin admin] REQUEST_METHOD: `POST` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:19.133043 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff481b-51ef-4d0a-935c-9d3e7909f67e admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:19.133319 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff481b-51ef-4d0a-935c-9d3e7909f67e admin admin] PATH_INFO: `/v3/users` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:19.134050 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff481b-51ef-4d0a-935c-9d3e7909f67e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:19.136269 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff481b-51ef-4d0a-935c-9d3e7909f67e admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:19.162234 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1473/2911] 10.222.0.85 () {60 vars in 1143 bytes} [Thu Jun 16 15:15:19 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:15:19.166358 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7857ee-507f-45b7-84ae-351878197c7a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:19.177233 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7857ee-507f-45b7-84ae-351878197c7a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:19.182373 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11417170-a858-41da-b8a3-34e2977f2caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:19.183076 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11417170-a858-41da-b8a3-34e2977f2caf admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:19.183400 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11417170-a858-41da-b8a3-34e2977f2caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:19.183672 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11417170-a858-41da-b8a3-34e2977f2caf admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:19.184490 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11417170-a858-41da-b8a3-34e2977f2caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:19.186187 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11417170-a858-41da-b8a3-34e2977f2caf admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:19.198115 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1439/2912] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:15:19.202492 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff481b-51ef-4d0a-935c-9d3e7909f67e admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:19.213277 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff481b-51ef-4d0a-935c-9d3e7909f67e admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:19.218365 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c3204-dfa6-4759-be37-e47c4be511d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:19.219274 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c3204-dfa6-4759-be37-e47c4be511d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:19.219558 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c3204-dfa6-4759-be37-e47c4be511d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:19.219837 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c3204-dfa6-4759-be37-e47c4be511d3 admin admin] PATH_INFO: `/v3/projects/73aa449de0b14cea9bf3f94e4123a619/users/81128c8c782c4ddcbee552e3b68510b8/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:19.236628 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c3204-dfa6-4759-be37-e47c4be511d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73aa449de0b14cea9bf3f94e4123a619, user_id=81128c8c782c4ddcbee552e3b68510b8, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:19.239838 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c3204-dfa6-4759-be37-e47c4be511d3 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:19.257501 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1474/2913] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:15:19 2022] PUT /identity/v3/projects/73aa449de0b14cea9bf3f94e4123a619/users/81128c8c782c4ddcbee552e3b68510b8/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:15:19.263421 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11417170-a858-41da-b8a3-34e2977f2caf admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:19.278330 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11417170-a858-41da-b8a3-34e2977f2caf admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:19.349277 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364d3bc-6852-4603-96c0-5af42cb502b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:19.350093 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364d3bc-6852-4603-96c0-5af42cb502b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:19.350495 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364d3bc-6852-4603-96c0-5af42cb502b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:19.350899 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364d3bc-6852-4603-96c0-5af42cb502b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:19.351799 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364d3bc-6852-4603-96c0-5af42cb502b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:19.353828 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364d3bc-6852-4603-96c0-5af42cb502b3 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:19.370788 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1440/2914] 10.222.0.85 () {58 vars in 1121 bytes} [Thu Jun 16 15:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:15:19.377468 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c3204-dfa6-4759-be37-e47c4be511d3 admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:19.392040 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c3204-dfa6-4759-be37-e47c4be511d3 admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:19.397170 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c02f64-b2b0-4400-bf22-b6317542e10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:19.398479 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c02f64-b2b0-4400-bf22-b6317542e10d admin admin] REQUEST_METHOD: `PUT` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:19.398757 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c02f64-b2b0-4400-bf22-b6317542e10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:19.399028 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c02f64-b2b0-4400-bf22-b6317542e10d admin admin] PATH_INFO: `/v3/projects/73aa449de0b14cea9bf3f94e4123a619/users/81128c8c782c4ddcbee552e3b68510b8/roles/95dcfa6c726a4d01a41d2642554fd338` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:19.401178 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c02f64-b2b0-4400-bf22-b6317542e10d admin admin] RBAC: Authorizing `identity:create_grant(project_id=73aa449de0b14cea9bf3f94e4123a619, user_id=81128c8c782c4ddcbee552e3b68510b8, role_id=95dcfa6c726a4d01a41d2642554fd338)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:19.403828 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c02f64-b2b0-4400-bf22-b6317542e10d admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:19.415652 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1475/2915] 10.222.0.85 () {60 vars in 1482 bytes} [Thu Jun 16 15:15:19 2022] PUT /identity/v3/projects/73aa449de0b14cea9bf3f94e4123a619/users/81128c8c782c4ddcbee552e3b68510b8/roles/95dcfa6c726a4d01a41d2642554fd338 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:15:24.495184 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8dedd-2b86-4e31-9f6a-52c64105bcc1 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:24.496535 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8dedd-2b86-4e31-9f6a-52c64105bcc1 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:24.496845 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8dedd-2b86-4e31-9f6a-52c64105bcc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:24.543211 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-dfb8dedd-2b86-4e31-9f6a-52c64105bcc1 None None] MFA Rules not processed for user `81128c8c782c4ddcbee552e3b68510b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:15:24.545352 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-dfb8dedd-2b86-4e31-9f6a-52c64105bcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:24.680369 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1441/2916] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:15:24 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:15:24.696558 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c02f64-b2b0-4400-bf22-b6317542e10d admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:24.699332 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-56c02f64-b2b0-4400-bf22-b6317542e10d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:24.818375 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c02f64-b2b0-4400-bf22-b6317542e10d admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:24.827522 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e68ae9-3c0b-4c79-badc-4e253138e2c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:24.828701 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e68ae9-3c0b-4c79-badc-4e253138e2c7 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:24.829089 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e68ae9-3c0b-4c79-badc-4e253138e2c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:24.829469 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e68ae9-3c0b-4c79-badc-4e253138e2c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:24.836852 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:15:24.910666 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e68ae9-3c0b-4c79-badc-4e253138e2c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:24.913651 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e68ae9-3c0b-4c79-badc-4e253138e2c7 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:24.927259 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1476/2917] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:15:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:15:26.186734 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d0339-8aec-4305-93f4-2c6a3d98902d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:26.187460 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d0339-8aec-4305-93f4-2c6a3d98902d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:26.187858 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d0339-8aec-4305-93f4-2c6a3d98902d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:26.207747 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-300d0339-8aec-4305-93f4-2c6a3d98902d None None] MFA Rules not processed for user `c0e6df42f67641389fcc2c7071e29156`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:15:26.209025 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-300d0339-8aec-4305-93f4-2c6a3d98902d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:26.216597 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1442/2918] 10.222.0.85 () {58 vars in 957 bytes} [Thu Jun 16 15:15:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:15:33.924212 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e68ae9-3c0b-4c79-badc-4e253138e2c7 service nova] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:33.926463 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-c9e68ae9-3c0b-4c79-badc-4e253138e2c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:34.013653 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e68ae9-3c0b-4c79-badc-4e253138e2c7 service nova] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:34.020214 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e97f7a-0889-43be-a90b-61bc8301653b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819ad532defb4adaa2f4fd06b47630d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:34.020870 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e97f7a-0889-43be-a90b-61bc8301653b service placement] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:34.021156 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e97f7a-0889-43be-a90b-61bc8301653b service placement] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:34.021432 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e97f7a-0889-43be-a90b-61bc8301653b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:34.023569 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-01e97f7a-0889-43be-a90b-61bc8301653b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:34.036439 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e97f7a-0889-43be-a90b-61bc8301653b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:34.038028 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e97f7a-0889-43be-a90b-61bc8301653b service placement] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:34.049071 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1477/2919] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:15:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:15:36.201261 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:15:44.044258 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=56 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:15:56.630283 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d0339-8aec-4305-93f4-2c6a3d98902d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:56.696087 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d0339-8aec-4305-93f4-2c6a3d98902d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:56.699988 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f493672-bdb6-46d0-b609-9bdc909fd116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:56.700826 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f493672-bdb6-46d0-b609-9bdc909fd116 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:56.701125 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f493672-bdb6-46d0-b609-9bdc909fd116 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:56.701371 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f493672-bdb6-46d0-b609-9bdc909fd116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:56.711033 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f493672-bdb6-46d0-b609-9bdc909fd116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:56.712533 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f493672-bdb6-46d0-b609-9bdc909fd116 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:56.722158 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1443/2920] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:15:56 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:16:06.717981 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=26 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:18:25.562657 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e97f7a-0889-43be-a90b-61bc8301653b service placement] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:18:25.565054 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-01e97f7a-0889-43be-a90b-61bc8301653b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:18:25.577999 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e97f7a-0889-43be-a90b-61bc8301653b service placement] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:18:25.582388 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e493b-03b6-43cc-b5ef-4b0d09bf4519 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:18:25.583040 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e493b-03b6-43cc-b5ef-4b0d09bf4519 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:18:25.583318 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e493b-03b6-43cc-b5ef-4b0d09bf4519 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:18:25.583600 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e493b-03b6-43cc-b5ef-4b0d09bf4519 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:18:25.585723 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-339e493b-03b6-43cc-b5ef-4b0d09bf4519 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:18:25.601606 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e493b-03b6-43cc-b5ef-4b0d09bf4519 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:18:25.603064 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e493b-03b6-43cc-b5ef-4b0d09bf4519 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:18:25.615469 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1478/2921] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:18:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:18:26.813590 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f493672-bdb6-46d0-b609-9bdc909fd116 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:18:26.823241 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f493672-bdb6-46d0-b609-9bdc909fd116 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:18:26.827530 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbf791-136d-4398-9d11-428d0d4795c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:18:26.828209 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbf791-136d-4398-9d11-428d0d4795c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:18:26.828490 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbf791-136d-4398-9d11-428d0d4795c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:18:26.828765 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbf791-136d-4398-9d11-428d0d4795c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:18:26.830744 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8bdbf791-136d-4398-9d11-428d0d4795c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:18:26.846006 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdbf791-136d-4398-9d11-428d0d4795c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:18:26.847436 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdbf791-136d-4398-9d11-428d0d4795c1 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:18:26.859418 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1444/2922] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:18:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:18:29.672264 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e493b-03b6-43cc-b5ef-4b0d09bf4519 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:18:29.682364 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e493b-03b6-43cc-b5ef-4b0d09bf4519 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:18:29.687760 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e628c8-e24d-4caf-8bf0-27090e3f6339 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:18:29.688445 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e628c8-e24d-4caf-8bf0-27090e3f6339 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:18:29.688862 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e628c8-e24d-4caf-8bf0-27090e3f6339 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:18:29.689300 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e628c8-e24d-4caf-8bf0-27090e3f6339 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:18:29.692089 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-32e628c8-e24d-4caf-8bf0-27090e3f6339 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:18:29.707188 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e628c8-e24d-4caf-8bf0-27090e3f6339 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:18:29.708679 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e628c8-e24d-4caf-8bf0-27090e3f6339 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:18:29.718203 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1479/2923] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:18:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:18:36.853901 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=6 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:18:38.978200 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbf791-136d-4398-9d11-428d0d4795c1 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:18:38.987496 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbf791-136d-4398-9d11-428d0d4795c1 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:18:38.991802 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66280f1e-263e-4e0e-81e9-09eab776c3a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:18:38.992487 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66280f1e-263e-4e0e-81e9-09eab776c3a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:18:38.992780 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66280f1e-263e-4e0e-81e9-09eab776c3a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:18:38.993061 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66280f1e-263e-4e0e-81e9-09eab776c3a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:18:38.994972 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-66280f1e-263e-4e0e-81e9-09eab776c3a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:18:39.005845 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66280f1e-263e-4e0e-81e9-09eab776c3a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:18:39.007304 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66280f1e-263e-4e0e-81e9-09eab776c3a8 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:18:39.016320 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1445/2924] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:18:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:18:39.104797 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e628c8-e24d-4caf-8bf0-27090e3f6339 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:18:39.114477 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e628c8-e24d-4caf-8bf0-27090e3f6339 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:18:39.120795 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64aae7-f3d6-4801-9484-368ea370645e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:18:39.121457 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64aae7-f3d6-4801-9484-368ea370645e service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:18:39.121737 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64aae7-f3d6-4801-9484-368ea370645e service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:18:39.122013 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64aae7-f3d6-4801-9484-368ea370645e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:18:39.124133 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-cb64aae7-f3d6-4801-9484-368ea370645e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:18:39.140050 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb64aae7-f3d6-4801-9484-368ea370645e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:18:39.141506 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb64aae7-f3d6-4801-9484-368ea370645e service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:18:39.153678 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1480/2925] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:18:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:18:39.220279 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66280f1e-263e-4e0e-81e9-09eab776c3a8 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:18:39.222069 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-66280f1e-263e-4e0e-81e9-09eab776c3a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:18:39.238730 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66280f1e-263e-4e0e-81e9-09eab776c3a8 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:18:39.244299 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91c340-3652-4654-9745-1f55a3fc9ecf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819ad532defb4adaa2f4fd06b47630d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:18:39.244947 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91c340-3652-4654-9745-1f55a3fc9ecf service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:18:39.245232 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91c340-3652-4654-9745-1f55a3fc9ecf service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:18:39.245510 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91c340-3652-4654-9745-1f55a3fc9ecf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:18:39.247459 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2a91c340-3652-4654-9745-1f55a3fc9ecf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:18:39.259296 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91c340-3652-4654-9745-1f55a3fc9ecf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:18:39.261273 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91c340-3652-4654-9745-1f55a3fc9ecf service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:18:39.271622 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1446/2926] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:18:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:18:43.161757 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64aae7-f3d6-4801-9484-368ea370645e service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:18:43.175504 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64aae7-f3d6-4801-9484-368ea370645e service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:18:43.181637 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5e4a2-429f-4b4c-9c9e-6cbaed5a7ff9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:18:43.182421 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5e4a2-429f-4b4c-9c9e-6cbaed5a7ff9 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:18:43.182784 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5e4a2-429f-4b4c-9c9e-6cbaed5a7ff9 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:18:43.183174 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5e4a2-429f-4b4c-9c9e-6cbaed5a7ff9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:18:43.185412 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-31b5e4a2-429f-4b4c-9c9e-6cbaed5a7ff9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:18:43.199584 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b5e4a2-429f-4b4c-9c9e-6cbaed5a7ff9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:18:43.201228 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b5e4a2-429f-4b4c-9c9e-6cbaed5a7ff9 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:18:43.212650 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1481/2927] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:18:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:18:49.267214 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=12 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:18:53.207800 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=24 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:20:30.770036 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91c340-3652-4654-9745-1f55a3fc9ecf service placement] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:20:30.781102 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91c340-3652-4654-9745-1f55a3fc9ecf service placement] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:20:30.785488 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afde7e-fb18-4026-aad9-3888e04a105c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:20:30.786132 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afde7e-fb18-4026-aad9-3888e04a105c service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:20:30.786419 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afde7e-fb18-4026-aad9-3888e04a105c service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:20:30.786691 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afde7e-fb18-4026-aad9-3888e04a105c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:20:30.796908 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59afde7e-fb18-4026-aad9-3888e04a105c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:20:30.798390 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59afde7e-fb18-4026-aad9-3888e04a105c service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:20:30.808407 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1447/2928] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:20:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:20:32.157195 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5e4a2-429f-4b4c-9c9e-6cbaed5a7ff9 service nova] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:20:32.206423 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5e4a2-429f-4b4c-9c9e-6cbaed5a7ff9 service nova] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:20:32.215192 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730b587-4675-4bce-9261-8ced76404684 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c74e4d1bdaa64ed280cc5f4c8e79b842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:20:32.216705 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730b587-4675-4bce-9261-8ced76404684 service nova] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:20:32.217198 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730b587-4675-4bce-9261-8ced76404684 service nova] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:20:32.217670 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730b587-4675-4bce-9261-8ced76404684 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:20:32.219846 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-9730b587-4675-4bce-9261-8ced76404684 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:20:32.260933 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730b587-4675-4bce-9261-8ced76404684 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:20:32.263227 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730b587-4675-4bce-9261-8ced76404684 service nova] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:20:32.276822 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1482/2929] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:20:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:20:35.291677 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afde7e-fb18-4026-aad9-3888e04a105c service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:20:35.335368 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afde7e-fb18-4026-aad9-3888e04a105c service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:20:35.340945 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd436cc-351f-4cd1-9b29-2ee43d0e157a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819ad532defb4adaa2f4fd06b47630d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:20:35.341604 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd436cc-351f-4cd1-9b29-2ee43d0e157a service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:20:35.341886 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd436cc-351f-4cd1-9b29-2ee43d0e157a service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:20:35.342162 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd436cc-351f-4cd1-9b29-2ee43d0e157a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:20:35.351393 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd436cc-351f-4cd1-9b29-2ee43d0e157a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:20:35.353034 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd436cc-351f-4cd1-9b29-2ee43d0e157a service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:20:35.364891 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1448/2930] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:20:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:20:36.176012 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730b587-4675-4bce-9261-8ced76404684 service nova] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:20:36.185699 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730b587-4675-4bce-9261-8ced76404684 service nova] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:20:36.189668 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c78859-3d5e-4f97-9ae2-4485744416e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3d59fabcf94718bbc005519cec6f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:20:36.190305 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c78859-3d5e-4f97-9ae2-4485744416e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:20:36.190587 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c78859-3d5e-4f97-9ae2-4485744416e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:20:36.190858 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c78859-3d5e-4f97-9ae2-4485744416e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:20:36.259022 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c78859-3d5e-4f97-9ae2-4485744416e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:20:36.260518 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c78859-3d5e-4f97-9ae2-4485744416e4 service neutron] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:20:36.270913 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1483/2931] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:20:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:20:39.448717 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd436cc-351f-4cd1-9b29-2ee43d0e157a service placement] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:20:39.460598 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd436cc-351f-4cd1-9b29-2ee43d0e157a service placement] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:20:39.466686 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea2976-51be-4982-a894-2e99c9adba7a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819ad532defb4adaa2f4fd06b47630d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:20:39.467332 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea2976-51be-4982-a894-2e99c9adba7a service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:20:39.467612 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea2976-51be-4982-a894-2e99c9adba7a service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:20:39.470338 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea2976-51be-4982-a894-2e99c9adba7a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:20:39.470338 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-36ea2976-51be-4982-a894-2e99c9adba7a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:20:39.496722 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea2976-51be-4982-a894-2e99c9adba7a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:20:39.498388 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea2976-51be-4982-a894-2e99c9adba7a service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:20:39.510150 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1449/2932] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:20:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:20:42.415553 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c78859-3d5e-4f97-9ae2-4485744416e4 service neutron] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:20:42.428223 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c78859-3d5e-4f97-9ae2-4485744416e4 service neutron] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:20:42.435264 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ecfaa-0081-401d-b273-b6de048104d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819ad532defb4adaa2f4fd06b47630d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:20:42.436633 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ecfaa-0081-401d-b273-b6de048104d8 service placement] REQUEST_METHOD: `GET` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:20:42.437191 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ecfaa-0081-401d-b273-b6de048104d8 service placement] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:20:42.437752 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ecfaa-0081-401d-b273-b6de048104d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:20:42.441077 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-270ecfaa-0081-401d-b273-b6de048104d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:20:42.457150 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ecfaa-0081-401d-b273-b6de048104d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:20:42.459844 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ecfaa-0081-401d-b273-b6de048104d8 service placement] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:20:42.474765 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1484/2933] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:20:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:20:42.533191 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea2976-51be-4982-a894-2e99c9adba7a service placement] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:20:42.544556 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea2976-51be-4982-a894-2e99c9adba7a service placement] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:20:42.549626 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663c64d-75bc-4faa-8b4c-161ebfeb7613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:20:42.550537 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663c64d-75bc-4faa-8b4c-161ebfeb7613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:20:42.550817 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663c64d-75bc-4faa-8b4c-161ebfeb7613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:20:42.551241 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663c64d-75bc-4faa-8b4c-161ebfeb7613 admin admin] PATH_INFO: `/v3/users/c0e6df42f67641389fcc2c7071e29156` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:20:42.552615 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663c64d-75bc-4faa-8b4c-161ebfeb7613 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0e6df42f67641389fcc2c7071e29156)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:20:42.554550 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663c64d-75bc-4faa-8b4c-161ebfeb7613 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:20:42.603664 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a663c64d-75bc-4faa-8b4c-161ebfeb7613 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0e6df42f67641389fcc2c7071e29156'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:20:42.610775 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a663c64d-75bc-4faa-8b4c-161ebfeb7613 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0e6df42f67641389fcc2c7071e29156'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:20:42.622441 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a663c64d-75bc-4faa-8b4c-161ebfeb7613 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0e6df42f67641389fcc2c7071e29156'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:20:42.636072 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a663c64d-75bc-4faa-8b4c-161ebfeb7613 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0e6df42f67641389fcc2c7071e29156'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:20:42.636761 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a663c64d-75bc-4faa-8b4c-161ebfeb7613 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0e6df42f67641389fcc2c7071e29156'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:20:42.643688 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1450/2934] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 15:20:42 2022] DELETE /identity/v3/users/c0e6df42f67641389fcc2c7071e29156 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:20:42.838758 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ecfaa-0081-401d-b273-b6de048104d8 service placement] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:20:42.849867 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ecfaa-0081-401d-b273-b6de048104d8 service placement] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:20:42.908358 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bc6ad-5b32-4365-87a5-0ea4c35100fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:20:42.909222 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bc6ad-5b32-4365-87a5-0ea4c35100fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:20:42.909502 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bc6ad-5b32-4365-87a5-0ea4c35100fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:20:42.909778 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bc6ad-5b32-4365-87a5-0ea4c35100fd admin admin] PATH_INFO: `/v3/projects/89d7ddb238db457aa484f744387e1c1e` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:20:42.910996 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739bc6ad-5b32-4365-87a5-0ea4c35100fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=89d7ddb238db457aa484f744387e1c1e)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:20:42.912968 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739bc6ad-5b32-4365-87a5-0ea4c35100fd admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:20:42.944019 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:20:42.961994 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-739bc6ad-5b32-4365-87a5-0ea4c35100fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89d7ddb238db457aa484f744387e1c1e', 'request_id': 'req-739bc6ad-5b32-4365-87a5-0ea4c35100fd'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:20:42.967692 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-739bc6ad-5b32-4365-87a5-0ea4c35100fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89d7ddb238db457aa484f744387e1c1e', 'request_id': 'req-739bc6ad-5b32-4365-87a5-0ea4c35100fd'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:20:42.974437 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-739bc6ad-5b32-4365-87a5-0ea4c35100fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89d7ddb238db457aa484f744387e1c1e', 'request_id': 'req-739bc6ad-5b32-4365-87a5-0ea4c35100fd'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:20:42.991711 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-739bc6ad-5b32-4365-87a5-0ea4c35100fd admin admin] The token cache is being invalidate because project 89d7ddb238db457aa484f744387e1c1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:20:42.992044 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-739bc6ad-5b32-4365-87a5-0ea4c35100fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:20:42.992816 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-739bc6ad-5b32-4365-87a5-0ea4c35100fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:20:42.994686 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1485/2935] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:20:42 2022] DELETE /identity/v3/projects/89d7ddb238db457aa484f744387e1c1e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:20:42.999519 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663c64d-75bc-4faa-8b4c-161ebfeb7613 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:20:43.001383 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a663c64d-75bc-4faa-8b4c-161ebfeb7613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:20:43.018919 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663c64d-75bc-4faa-8b4c-161ebfeb7613 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:20:43.082437 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:20:43.094194 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc9864-98b3-4e88-a159-d988c9491603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:20:43.095114 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc9864-98b3-4e88-a159-d988c9491603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:20:43.095400 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc9864-98b3-4e88-a159-d988c9491603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:20:43.095674 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc9864-98b3-4e88-a159-d988c9491603 admin admin] PATH_INFO: `/v3/users/81128c8c782c4ddcbee552e3b68510b8` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:20:43.096887 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc9864-98b3-4e88-a159-d988c9491603 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81128c8c782c4ddcbee552e3b68510b8)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:20:43.098842 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc9864-98b3-4e88-a159-d988c9491603 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:20:43.148940 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-37cc9864-98b3-4e88-a159-d988c9491603 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81128c8c782c4ddcbee552e3b68510b8'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:20:43.157229 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-37cc9864-98b3-4e88-a159-d988c9491603 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81128c8c782c4ddcbee552e3b68510b8'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:20:43.165408 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-37cc9864-98b3-4e88-a159-d988c9491603 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81128c8c782c4ddcbee552e3b68510b8'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:20:43.179201 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-37cc9864-98b3-4e88-a159-d988c9491603 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81128c8c782c4ddcbee552e3b68510b8'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:20:43.179851 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-37cc9864-98b3-4e88-a159-d988c9491603 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81128c8c782c4ddcbee552e3b68510b8'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:20:43.186415 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1451/2936] 10.222.0.85 () {58 vars in 1223 bytes} [Thu Jun 16 15:20:42 2022] DELETE /identity/v3/users/81128c8c782c4ddcbee552e3b68510b8 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:20:43.381282 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bc6ad-5b32-4365-87a5-0ea4c35100fd admin admin] Authenticating user token {{(pid=80176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:20:43.383160 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.fernet_utils [None req-739bc6ad-5b32-4365-87a5-0ea4c35100fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:20:43.396892 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bc6ad-5b32-4365-87a5-0ea4c35100fd admin admin] Validating token access rules against request {{(pid=80176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:20:43.465911 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43471d78-c814-49f3-aad3-962fe3602cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd15ddf8d03bc44188d865237c74fbf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f4fd10bac54b6ca305e8af48785eb7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:20:43.466783 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43471d78-c814-49f3-aad3-962fe3602cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:20:43.467066 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43471d78-c814-49f3-aad3-962fe3602cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:20:43.467345 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43471d78-c814-49f3-aad3-962fe3602cf3 admin admin] PATH_INFO: `/v3/projects/73aa449de0b14cea9bf3f94e4123a619` {{(pid=80176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:20:43.468752 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43471d78-c814-49f3-aad3-962fe3602cf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73aa449de0b14cea9bf3f94e4123a619)` {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:20:43.470764 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43471d78-c814-49f3-aad3-962fe3602cf3 admin admin] RBAC: Authorization granted {{(pid=80176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:20:43.519226 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-43471d78-c814-49f3-aad3-962fe3602cf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73aa449de0b14cea9bf3f94e4123a619', 'request_id': 'req-43471d78-c814-49f3-aad3-962fe3602cf3'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:20:43.525082 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-43471d78-c814-49f3-aad3-962fe3602cf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73aa449de0b14cea9bf3f94e4123a619', 'request_id': 'req-43471d78-c814-49f3-aad3-962fe3602cf3'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:20:43.531988 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-43471d78-c814-49f3-aad3-962fe3602cf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73aa449de0b14cea9bf3f94e4123a619', 'request_id': 'req-43471d78-c814-49f3-aad3-962fe3602cf3'} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:20:43.546863 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-43471d78-c814-49f3-aad3-962fe3602cf3 admin admin] The token cache is being invalidate because project 73aa449de0b14cea9bf3f94e4123a619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:20:43.547155 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-43471d78-c814-49f3-aad3-962fe3602cf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:20:43.547776 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG keystone.notifications [None req-43471d78-c814-49f3-aad3-962fe3602cf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:20:43.549392 dv-cinder-837165-3-smb devstack@keystone.service[80176]: [pid: 80176|app: 0|req: 1486/2937] 10.222.0.85 () {58 vars in 1232 bytes} [Thu Jun 16 15:20:43 2022] DELETE /identity/v3/projects/73aa449de0b14cea9bf3f94e4123a619 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:20:53.182723 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:20:53.543092 dv-cinder-837165-3-smb devstack@keystone.service[80176]: DEBUG dbcounter [-] [80176] Writing DB stats keystone:DELETE=13,keystone:SELECT=65,keystone:INSERT=2 {{(pid=80176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:25:46.845771 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc9864-98b3-4e88-a159-d988c9491603 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:25:46.847306 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-37cc9864-98b3-4e88-a159-d988c9491603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:25:46.927768 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc9864-98b3-4e88-a159-d988c9491603 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:25:47.006488 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cada175-7c83-4e44-bcb6-f2320e661d4b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819ad532defb4adaa2f4fd06b47630d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80e309a3b3784ba9943734a41949b222', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:25:47.007255 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cada175-7c83-4e44-bcb6-f2320e661d4b service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:25:47.007547 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cada175-7c83-4e44-bcb6-f2320e661d4b service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:25:47.007822 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cada175-7c83-4e44-bcb6-f2320e661d4b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:25:47.009973 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6cada175-7c83-4e44-bcb6-f2320e661d4b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:25:47.022240 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cada175-7c83-4e44-bcb6-f2320e661d4b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:25:47.024012 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cada175-7c83-4e44-bcb6-f2320e661d4b service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:25:47.034630 dv-cinder-837165-3-smb devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1452/2938] 10.222.0.85 () {60 vars in 1365 bytes} [Thu Jun 16 15:25:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:25:57.029961 dv-cinder-837165-3-smb devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=60 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}